00002000:00010000:0.0:1746066792.351224:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066792.351247:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3776:x1830882984811776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (232us total) trans 17179874943 rc 0/0 00000100:00100000:0.0:1746066792.352401:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18418 00000100:00100000:0.0:1746066792.352522:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18431 00000100:00100000:0.0:1746066792.352527:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882984812928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066792.352584:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3777:x1830882984812928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (252us total) trans 21474842339 rc 0/0 00000100:00100000:0.0:1746066792.352590:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18431 00000004:00080000:0.0:1746066792.352622:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5766300/2, rc 0, transno 17179874944 00000100:00100000:0.0:1746066792.352625:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984810880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066792.352632:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801500/2, rc 0, transno 17179874945 00000100:00100000:0.0:1746066792.352635:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984811392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066792.352640:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d800e00/2, rc 0, transno 17179874942 00000100:00100000:0.0:1746066792.352642:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984811264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066792.352647:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801f80/2, rc 0, transno 17179874943 00000100:00100000:0.0:1746066792.352650:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984811776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066792.354666:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.364781:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.365352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.365384:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.369427:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984721280 00000100:00100000:0.0:1746066792.369434:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984721280 00000100:00100000:0.0:1746066792.369482:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 891 00000100:00100000:0.0:1746066792.369489:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882984721280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.369499:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.369524:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a7c00/0xf1867c21abfad0ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d36 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.369548:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.369552:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.369581:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882984721280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.369587:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 891 00000100:00100000:0.0:1746066792.371834:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.373974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.382534:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.382578:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.382609:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.382797:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882984721536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10769us (10982us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066792.382808:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6796 00002000:00100000:0.0:1746066792.382836:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958ace00 x1830882984721536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.382847:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ace00 with x1830882984721536 ext(1048576->2097151) 00002000:00010000:0.0:1746066792.382853:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ace00 00000100:00100000:0.0:1746066792.386575:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.386602:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984722304 00000100:00100000:0.0:1746066792.386609:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984722304 00010000:00010000:0.0:1746066792.386645:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfad0e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d28 expref: 17 pid: 3528 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066792.386684:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8356 00000100:00100000:0.0:1746066792.387069:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882984722304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.387080:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.387099:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfad0e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d28 expref: 16 pid: 3528 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.387109:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfad0e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d28 expref: 16 pid: 3528 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.387127:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfad0e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d28 expref: 16 pid: 3528 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.387143:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.387157:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882984722304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.387162:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8356 00000100:00100000:0.0:1746066792.387559:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984722176 00000100:00100000:0.0:1746066792.387562:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984722176 00010000:00010000:0.0:1746066792.387575:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfacfdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cb8 expref: 10 pid: 12233 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066792.387590:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8357 00000100:00100000:0.0:1746066792.387596:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984722176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.387602:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.387608:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfacfdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cb8 expref: 10 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.387625:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfacfdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cb8 expref: 10 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.387636:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfacfdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cb8 expref: 10 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.387643:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.387662:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984722176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.387667:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8357 00000100:00100000:0.0:1746066792.391200:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.395493:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.397431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.401842:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.403593:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.412641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.412702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.416777:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.417608:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6266 00000100:00100000:0.0:1746066792.417616:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:8546:x1830882984724608:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066792.418048:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:8546:x1830882984724608:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 432us (1061us total) trans 8589937279 rc 0/0 00000100:00100000:0.0:1746066792.418054:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6266 00000100:00100000:0.0:1746066792.420311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.420416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.421054:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.421066:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984725120 00000100:00100000:0.0:1746066792.421069:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984725120 00010000:00010000:0.0:1746066792.421085:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfad0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cfe expref: 31 pid: 17253 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066792.421100:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8361 00000100:00100000:0.0:1746066792.421104:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882984725120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.421110:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.421113:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfad0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cfe expref: 31 pid: 17253 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.421120:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfad0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cfe expref: 31 pid: 17253 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.421130:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfad0a1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4cfe expref: 31 pid: 17253 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.421139:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.421141:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfad126 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.421148:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfad126 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.421155:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfad126 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.421173:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.421185:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882984725120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.421195:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8361 00000100:00100000:0.0:1746066792.422391:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.437448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.438127:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.438162:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.445246:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.447421:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.450469:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.450498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.465157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.465203:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.465248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.469074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.469187:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.471972:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.471982:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984727680 00000100:00100000:0.0:1746066792.471985:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984727680 00000100:00100000:0.0:1746066792.472013:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18445 00000100:00100000:0.0:1746066792.472018:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882984727680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.472024:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.472030:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfad181 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4da6 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.472038:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.472040:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.472049:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfad181 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4da6 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.472077:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfad181 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4da6 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.472086:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576bc00, rc 0) 00000100:00100000:0.0:1746066792.472105:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882984727680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.472110:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18445 00000100:00100000:0.0:1746066792.472381:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.475082:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.476879:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.476937:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.499874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.500573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.510149:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984729728 00000100:00100000:0.0:1746066792.510157:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984729728 00000100:00100000:0.0:1746066792.510194:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18453 00000100:00100000:0.0:1746066792.510200:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882984729728:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066792.510227:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.510242:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510250:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad188 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d9f expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510272:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510279:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.510280:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.510283:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.510305:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510314:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 15 pid: 11630 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066792.510325:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984816768:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066792.510377:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d9f expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510384:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d9f expref: 38 pid: 12233 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066792.510392:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984816896:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066792.510414:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.510430:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066792.510438:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984817024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.510460:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.521875:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535621:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535675:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984816384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.535702:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984816512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.535741:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984816640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066792.535758:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.535808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535863:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.535918:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984816768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.535944:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984816896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.535971:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984817024:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066792.535999:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.536038:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.536047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.536057:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.536073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.536123:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984731520 00000100:00100000:0.0:1746066792.536126:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984731520 00002000:00100000:0.0:1746066792.536153:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1200128->1531903) req@ffff88009586b480 x1830882984731520/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.536161:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586b480 with x1830882984731520 ext(1200128->1531903) 00010000:00010000:0.0:1746066792.536167:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfad103 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d4b expref: 16 pid: 11630 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536176:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfad103 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d4b expref: 16 pid: 11630 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746066792.536182:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009586b480 00000100:00100000:0.0:1746066792.536201:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1956 00000100:00100000:0.0:1746066792.536206:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882984731520:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066792.536336:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984817152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066792.536347:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066792.536383:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8373 00000100:00100000:0.0:1746066792.536393:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882984731776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.536399:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.536410:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 17 pid: 11630 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536417:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 17 pid: 11630 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536428:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfad15e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d83 expref: 17 pid: 11630 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536440:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.536455:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882984731776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.536460:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8373 00000100:00100000:0.0:1746066792.536471:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8374 00000100:00100000:0.0:1746066792.536475:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882984732032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.536481:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.536485:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfad19d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4db4 expref: 10 pid: 10125 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536492:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfad19d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4db4 expref: 10 pid: 10125 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536505:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfad19d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4db4 expref: 10 pid: 10125 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536521:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.536525:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.536533:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.536539:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.536550:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.536563:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882984732032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.536568:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8374 00000100:00100000:0.0:1746066792.536576:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8375 00000100:00100000:0.0:1746066792.536580:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+15:2013:x1830882984731904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.536585:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.536590:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536596:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536605:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfacfd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ccd expref: 15 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.536613:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.536630:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882984731904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.536635:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8375 00000100:00100000:0.0:1746066792.536645:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8376 00000100:00100000:0.0:1746066792.536648:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882984732160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.536653:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.536660:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfad10a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d52 expref: 30 pid: 11630 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536668:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfad10a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d52 expref: 30 pid: 11630 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536679:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfad10a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d52 expref: 30 pid: 11630 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.536686:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.536688:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.536691:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.536697:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.536710:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.536722:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882984732160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.536727:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8376 00000100:00100000:0.0:1746066792.536986:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882984728960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36265us (36413us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066792.536992:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6805 00002000:00100000:0.0:1746066792.536998:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095869500 x1830882984728960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.537004:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869500 with x1830882984728960 ext(2097152->4194303) 00010000:00010000:0.0:1746066792.537009:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d9f expref: 35 pid: 12233 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066792.537015:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d9f expref: 35 pid: 12233 timeout: 860 lvb_type: 1 00002000:00010000:0.0:1746066792.537020:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095869500 00010000:00010000:0.0:1746066792.537037:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537042:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537052:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537056:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537061:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537073:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0153a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066792.537075:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537081:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537089:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537094:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfad1c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.537373:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b55b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882984729472:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 28829us (29607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.537382:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18452 00010000:00010000:0.0:1746066792.537487:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537492:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066792.537507:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066792.537618:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537623:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537635:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537639:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c7a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066792.537641:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537645:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537653:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.537655:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066792.537658:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537662:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfad1ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537677:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537682:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537686:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537689:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537693:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c7e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066792.537695:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537707:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537713:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066792.537715:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066792.537717:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537721:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfad1dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537729:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537734:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537738:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537742:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c6600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066792.537744:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537748:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537754:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5744100) 00010000:00010000:0.0:1746066792.537756:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066792.537758:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537762:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6600/0xf1867c21abfad1e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066792.537808:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfad1d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dbb expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537828:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfad1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dbb expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.537835:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6e00, rc 0) 00000100:00100000:0.0:1746066792.537857:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2515:x1830882984730112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 15094us (15993us total) trans 8589937282 rc 301/301 00000100:00100000:0.0:1746066792.537864:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16866 00000100:00100000:0.0:1746066792.541251:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882984731520:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5033us (5431us total) trans 21474842343 rc 0/0 00000100:00100000:0.0:1746066792.541261:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1956 00002000:00100000:0.0:1746066792.541273:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1200128->1531903) req@ffff88009586b480 x1830882984731520/t21474842343(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.541282:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586b480 with x1830882984731520 ext(1200128->1531903) 00010000:00010000:0.0:1746066792.541291:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfad103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d4b expref: 17 pid: 11630 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066792.541302:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfad103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d4b expref: 17 pid: 11630 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746066792.541308:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009586b480 00000100:00100000:0.0:1746066792.544111:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.545584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.545682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066792.546830:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.546842:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547202:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547210:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547216:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547222:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066792.547224:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547230:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547240:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.547246:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfad1ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.547308:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984729728:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 37107us (39492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.547314:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18453 00010000:00010000:0.0:1746066792.550636:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550643:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550658:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550662:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550667:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550671:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066792.550675:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550681:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550692:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.550707:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad1ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.551313:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882984729344:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 45014us (45586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.551320:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18448 00000100:00100000:0.0:1746066792.553907:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.555664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.558990:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984733440 00000100:00100000:0.0:1746066792.558998:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984733440 00000100:00100000:0.0:1746066792.559050:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16867 00000100:00100000:0.0:1746066792.559059:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2512:x1830882984733440:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:0.0:1746066792.559107:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.559138:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfad173 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4d91 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.559156:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.559161:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.559225:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2512:x1830882984733440:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 166us (395us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746066792.559230:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16867 00000100:00100000:0.0:1746066792.563495:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.563583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.565950:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.566502:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984734592 00000100:00100000:0.0:1746066792.566511:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984734592 00002000:00100000:0.0:1746066792.566529:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1200128->1204223) req@ffff880097a8a680 x1830882984734592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.566536:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a680 with x1830882984734592 ext(1200128->1204223) 00002000:00010000:0.0:1746066792.566539:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a680 00000100:00100000:0.0:1746066792.566556:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6809 00000100:00100000:0.0:1746066792.566561:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882984734592:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066792.566668:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882984734592:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 106us (254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066792.566673:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6809 00002000:00100000:0.0:1746066792.566678:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1200128->1204223) req@ffff880097a8a680 x1830882984734592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.566684:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a680 with x1830882984734592 ext(1200128->1204223) 00002000:00010000:0.0:1746066792.566686:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a680 00000100:00100000:0.0:1746066792.567920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.567951:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.567969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.567983:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984734848 00000100:00100000:0.0:1746066792.567987:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984734848 00000100:00100000:0.0:1746066792.568015:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984735104 00000100:00100000:0.0:1746066792.568017:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984735104 00000100:00100000:0.0:1746066792.568032:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18457 00000100:00100000:0.0:1746066792.568037:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882984734848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.568047:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.568059:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfad230 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4de5 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.568108:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984817536:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066792.568162:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.568184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.568198:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984734976 00000100:00100000:0.0:1746066792.568200:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984734976 00000100:00100000:0.0:1746066792.568216:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18460 00000100:00100000:0.0:1746066792.568220:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882984734976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.568226:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.568233:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4dec expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066792.568246:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd69, atime: 0x6812dd69, ctime: 0x6812dd69, blocks: 0x800 00010000:00010000:0.0:1746066792.568253:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.568255:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.568260:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dec expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.568269:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dec expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.568275:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafe00, rc 0) 00000100:00100000:0.0:1746066792.568290:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882984734976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.568295:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18460 00000100:00100000:0.0:1746066792.568612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.570628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.573736:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.575544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.575579:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.575612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.575630:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984736640 00000100:00100000:0.0:1746066792.575634:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984736640 00000100:00100000:0.0:1746066792.575678:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6269 00000100:00100000:0.0:1746066792.575683:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2515:x1830882984736640:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066792.575838:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2515:x1830882984736640:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 153us (225us total) trans 8589937286 rc 0/0 00000100:00100000:0.0:1746066792.575844:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6269 00000100:00100000:0.0:1746066792.585865:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590421:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590641:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590656:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590669:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.590690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.591058:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18468 00000100:00100000:0.0:1746066792.591068:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882984737408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.591074:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.591080:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfad27d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4e2b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.591090:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.591091:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.591103:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfad27d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e2b expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.591111:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfad27d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e2b expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.591118:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafa00, rc 0) 00000100:00100000:0.0:1746066792.591132:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882984737408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.591137:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18468 00000100:00100000:0.0:1746066792.597855:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.600751:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.606421:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.606698:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.611011:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984738944 00000100:00100000:0.0:1746066792.611017:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984738944 00000100:00100000:0.0:1746066792.611063:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18472 00000100:00100000:0.0:1746066792.611068:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882984738944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.611081:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.611095:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfad299 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4e47 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.611116:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfad299 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e47 expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.611124:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfad299 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e47 expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.611145:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae000, rc 0) 00000100:00100000:0.0:1746066792.611176:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882984738944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 109us (305us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066792.611181:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18472 00000100:00100000:0.0:1746066792.695955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.722181:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.725790:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.736445:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.740934:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.740979:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984740096 00000100:00100000:0.0:1746066792.740987:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984740096 00002000:00100000:0.0:1746066792.741034:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2605056->2609151) req@ffff880095de0380 x1830882984740096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.741044:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095de0380 with x1830882984740096 ext(2605056->2609151) 00002000:00010000:0.0:1746066792.741050:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095de0380 00000100:00100000:0.0:1746066792.741070:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6817 00000100:00100000:0.0:1746066792.741077:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882984740096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066792.741209:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882984740096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 132us (286us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066792.741215:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6817 00002000:00100000:0.0:1746066792.741220:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2605056->2609151) req@ffff880095de0380 x1830882984740096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.741226:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095de0380 with x1830882984740096 ext(2605056->2609151) 00002000:00010000:0.0:1746066792.741237:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095de0380 00000100:00100000:0.0:1746066792.745557:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.750938:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.820861:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.822064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.834207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.838472:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.838538:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.838573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.838600:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984741504 00000100:00100000:0.0:1746066792.838609:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984741504 00010000:00010000:0.0:1746066792.838641:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfad2b5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e4e expref: 35 pid: 10125 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066792.838662:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984741632 00000100:00100000:0.0:1746066792.838663:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984741632 00010000:00010000:0.0:1746066792.838670:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfad222 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dd7 expref: 15 pid: 10125 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066792.838689:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8384 00000100:00100000:0.0:1746066792.838694:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882984741504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.838707:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.838712:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfad2b5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e4e expref: 35 pid: 10125 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066792.838721:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfad2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e4e expref: 35 pid: 10125 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066792.838742:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfad2b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e4e expref: 35 pid: 10125 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066792.838767:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066792.838772:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfad2df lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066792.838779:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfad2df lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066792.838784:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.838830:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882984741504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.838837:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8384 00000100:00100000:0.0:1746066792.845551:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.852442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.856983:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.861999:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984742400 00000100:00100000:0.0:1746066792.862010:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984742400 00000100:00100000:0.0:1746066792.862058:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18477 00000100:00100000:0.0:1746066792.862066:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2528:x1830882984742400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066792.862085:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.862104:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4e7f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.862135:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfad206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dd0 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.862143:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066792.862144:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066792.862158:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.862192:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfad206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dd0 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.862205:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfad206 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1531903) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dd0 expref: 28 pid: 13726 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066792.862217:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984818944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066792.862326:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.865231:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.867867:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.867924:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.867964:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.869021:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6822 00000100:00100000:0.0:1746066792.869029:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882984742912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066792.890679:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.896343:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.912031:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.921788:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.921858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.921927:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.944959:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.953302:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.960253:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.980988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.981051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066792.998850:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984746112 00000100:00100000:0.0:1746066792.998861:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984746112 00002000:00100000:0.0:1746066792.998923:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095869880 x1830882984746112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.998933:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869880 with x1830882984746112 ext(2097152->4194303) 00002000:00010000:0.0:1746066792.998938:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869880 00000100:00100000:0.0:1746066792.998966:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6829 00000100:00100000:0.0:1746066792.998974:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882984746112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066793.015366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066793.016785:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066793.050767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.068688:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.080245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.080791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.080865:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.086641:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.086679:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984747520 00000100:00100000:0.0:1746066793.086688:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984747520 00000100:00100000:0.0:1746066793.086736:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18483 00000100:00100000:0.0:1746066793.086745:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2528:x1830882984747520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066793.086766:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.086784:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5729000/0xf1867c21abfad364 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4eb0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.086827:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.086849:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.086851:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.086854:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5729000/0xf1867c21abfad364 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb0 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.086905:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.086918:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 20 pid: 9592 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066793.086931:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984820224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066793.087001:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.088430:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984820224:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066793.088451:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729000/0xf1867c21abfad364 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb0 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.088464:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729000, rc 0) 00000100:00100000:0.0:1746066793.088503:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2528:x1830882984747520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1757us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.088512:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18483 00000100:00100000:0.0:1746066793.094870:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984747776 00000100:00100000:0.0:1746066793.095230:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984747776 00002000:00100000:0.0:1746066793.095282:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->2195455) req@ffff880093c68a80 x1830882984747776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.095305:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68a80 with x1830882984747776 ext(2191360->2195455) 00010000:00010000:0.0:1746066793.095315:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 19 pid: 9592 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.095327:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 19 pid: 9592 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066793.095334:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c68a80 00000100:00100000:0.0:1746066793.095369:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1961 00000100:00100000:0.0:1746066793.095378:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882984747776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066793.096851:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882984747776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1465us (2150us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066793.096862:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1961 00002000:00100000:0.0:1746066793.096871:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->2195455) req@ffff880093c68a80 x1830882984747776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.096879:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68a80 with x1830882984747776 ext(2191360->2195455) 00010000:00010000:0.0:1746066793.096903:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 19 pid: 9592 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.096915:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfad356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ea2 expref: 19 pid: 9592 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066793.096921:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c68a80 00000100:00100000:0.0:1746066793.108183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.116147:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066793.116175:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984820352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066793.116249:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.127153:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.164495:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.169480:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.172678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.179223:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.189065:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984749184 00000100:00100000:0.0:1746066793.189076:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984749184 00002000:00100000:0.0:1746066793.189124:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->2195455) req@ffff880097a8b800 x1830882984749184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.189134:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882984749184 ext(2191360->2195455) 00002000:00010000:0.0:1746066793.189139:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:0.0:1746066793.189172:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6831 00000100:00100000:0.0:1746066793.189179:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882984749184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066793.189339:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882984749184:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (412us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066793.189346:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6831 00002000:00100000:0.0:1746066793.189351:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->2195455) req@ffff880097a8b800 x1830882984749184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.189358:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882984749184 ext(2191360->2195455) 00002000:00010000:0.0:1746066793.189361:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:0.0:1746066793.201152:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.206100:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984749696 00000100:00100000:0.0:1746066793.206123:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984749696 00000100:00100000:0.0:1746066793.206179:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6273 00000100:00100000:0.0:1746066793.206187:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2536:x1830882984749696:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066793.208555:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2536:x1830882984749696:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 2359us (2514us total) trans 8589937294 rc 0/0 00000100:00100000:0.0:1746066793.208565:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6273 00000100:00100000:0.0:1746066793.246572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.251538:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.304737:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.325684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.327965:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.335878:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.341601:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984751488 00000100:00100000:0.0:1746066793.341610:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984751488 00000100:00100000:0.0:1746066793.341670:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 894 00000100:00100000:0.0:1746066793.341678:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882984751488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066793.341694:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066793.341722:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfad3cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ecc expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.341745:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066793.341750:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.341792:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882984751488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.341809:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 894 00000100:00100000:0.0:1746066793.356721:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.370042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.375161:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984752128 00000100:00100000:0.0:1746066793.375176:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984752128 00000100:00100000:0.0:1746066793.375247:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16876 00000100:00100000:0.0:1746066793.375255:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2551:x1830882984752128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066793.375281:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.375299:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfad3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4eda expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.375378:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375391:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375401:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375414:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375420:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375425:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375526:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfad3f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375535:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfad3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375540:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfad3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066793.375556:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066793.375625:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375630:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375635:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375640:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375645:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066793.375648:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375653:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375662:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066793.375665:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066793.375668:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375672:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfad3e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375698:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375702:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375713:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375717:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5729a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066793.375719:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375723:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375727:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20500) 00010000:00010000:0.0:1746066793.375729:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066793.375730:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375734:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfad3f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066793.375764:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfad3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eda expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.375775:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfad3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eda expref: 43 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.375780:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066793.375782:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066793.375784:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729000, rc 0) 00000100:00100000:0.0:1746066793.375858:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2551:x1830882984752128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 603us (2663us total) trans 8589937301 rc 0/0 00000100:00100000:0.0:1746066793.375865:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16876 00000100:00100000:0.0:1746066793.376166:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882984751744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18659us (19454us total) trans 0 rc 1204224/1204224 00000100:00100000:0.0:1746066793.376175:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6833 00002000:00100000:0.0:1746066793.376183:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880098f54380 x1830882984751744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 504/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1204224/1204224 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.376193:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54380 with x1830882984751744 ext(2097152->4194303) 00002000:00010000:0.0:1746066793.376197:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f54380 00002000:00010000:0.0:1746066793.376266:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066793 -> 1746066794 00000100:00100000:0.0:1746066793.376278:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984820864:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066793.376306:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfad3db lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ed3 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.376315:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfad3db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ed3 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.376323:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44c00, rc 0) 00000100:00100000:0.0:1746066793.376351:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882984751872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5933us (6320us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066793.376358:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18485 00000100:00100000:0.0:1746066793.381986:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.384361:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.391433:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984752640 00000100:00100000:0.0:1746066793.391444:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984752640 00000100:00100000:0.0:1746066793.391495:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18486 00000100:00100000:0.0:1746066793.391503:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2549:x1830882984752640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066793.391529:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.391545:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfad405 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4ee1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.391576:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.391584:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.391586:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.391590:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfad405 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ee1 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.391619:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.391630:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 40 pid: 9590 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066793.391642:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984820992:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066793.391720:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.397704:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.397731:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984752768 00000100:00100000:0.0:1746066793.397740:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984752768 00002000:00100000:0.0:1746066793.397785:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->3084287) req@ffff880098f55500 x1830882984752768/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.397806:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882984752768 ext(2191360->3084287) 00010000:00010000:0.0:1746066793.397817:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 41 pid: 9590 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.397837:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 41 pid: 9590 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066793.397843:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098f55500 00000100:00100000:0.0:1746066793.397879:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1965 00000100:00100000:0.0:1746066793.397916:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882984752768:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066793.404759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.414979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.419202:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882984752768:12345-192.168.204.16@tcp:4:cat.0 Request processed in 21287us (21509us total) trans 17179874954 rc 0/0 00000100:00100000:0.0:1746066793.419211:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1965 00002000:00100000:0.0:1746066793.419219:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->3084287) req@ffff880098f55500 x1830882984752768/t17179874954(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.419228:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882984752768 ext(2191360->3084287) 00010000:00010000:0.0:1746066793.419233:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 42 pid: 9590 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.419245:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfad36b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4eb7 expref: 42 pid: 9590 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066793.419252:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098f55500 00000100:00100000:0.0:1746066793.429098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.445576:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.450152:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.450212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.457061:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.457100:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984753920 00000100:00100000:0.0:1746066793.457106:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984753920 00010000:00010000:0.0:1746066793.457139:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6800/0xf1867c21abfad1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dc2 expref: 20 pid: 20361 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066793.457170:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8394 00000100:00100000:0.0:1746066793.457178:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882984753920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066793.457190:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066793.457210:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6800/0xf1867c21abfad1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dc2 expref: 19 pid: 20361 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.457221:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c6800/0xf1867c21abfad1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dc2 expref: 19 pid: 20361 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.457245:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6800/0xf1867c21abfad1f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dc2 expref: 19 pid: 20361 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.457263:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.465593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.469301:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.471046:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066793.475723:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066793 -> 1746066794 00002000:00010000:0.0:1746066793.475727:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066793 -> 1746066794 00002000:00010000:0.0:1746066793.475728:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066793 -> 1746066794 00000100:00100000:0.0:1746066793.475748:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984821888:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066793.475787:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfad428 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f04 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.475810:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfad428 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f04 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.475822:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:0.0:1746066793.476768:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882984754304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5604us (5722us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066793.476777:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18491 00000100:00100000:0.0:1746066793.478207:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.482739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.482804:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.483344:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18493 00000100:00100000:0.0:1746066793.483350:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882984754944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066793.483371:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.483391:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfad42f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4f0b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.483426:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfad42f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f0b expref: 42 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.483487:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfad42f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f0b expref: 42 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.483507:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728a00, rc 0) 00000100:00100000:0.0:1746066793.483577:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882984754944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 226us (779us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066793.483583:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18493 00000100:00100000:0.0:1746066793.497691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.508067:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.521133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.531712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.531768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.545587:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.558506:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.558759:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.561294:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.563554:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.568116:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.570953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.574190:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.574254:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.581210:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984822784:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066793.581251:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfad460 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f43 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.581267:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfad460 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f43 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.581290:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67800, rc 0) 00000100:00100000:0.0:1746066793.581337:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882984757248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7010us (7091us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066793.581357:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18499 00000100:00100000:0.0:1746066793.582680:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882984756992:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11339us (11722us total) trans 21474842345 rc 0/0 00000100:00100000:0.0:1746066793.582690:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1967 00002000:00100000:0.0:1746066793.582699:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3194879) req@ffff880095868700 x1830882984756992/t21474842345(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.582709:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868700 with x1830882984756992 ext(3145728->3194879) 00010000:00010000:0.0:1746066793.582718:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45a00/0xf1867c21abfad41a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ef6 expref: 20 pid: 9592 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066793.582732:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa45a00/0xf1867c21abfad41a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4ef6 expref: 20 pid: 9592 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066793.582738:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095868700 00000100:00100000:0.0:1746066793.591706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.591853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.591937:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.598281:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984757888 00000100:00100000:0.0:1746066793.598289:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984757888 00002000:00100000:0.0:1746066793.598327:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3190784->3194879) req@ffff8800967aa680 x1830882984757888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.598337:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882984757888 ext(3190784->3194879) 00002000:00010000:0.0:1746066793.598342:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066793.598370:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6842 00000100:00100000:0.0:1746066793.598378:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882984757888:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066793.598866:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882984757888:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 488us (1150us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066793.599284:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6842 00002000:00100000:0.0:1746066793.599293:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3190784->3194879) req@ffff8800967aa680 x1830882984757888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.599300:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882984757888 ext(3190784->3194879) 00002000:00010000:0.0:1746066793.599304:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066793.604137:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.604225:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.611772:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.611829:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.733856:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.751849:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.751951:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.754363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.762671:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.767969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.775494:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.775573:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.812384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.815292:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.837507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.841460:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.844556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.844731:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.844757:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984761728 00000100:00100000:0.0:1746066793.844771:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984761728 00000100:00100000:0.0:1746066793.844827:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6280 00000100:00100000:0.0:1746066793.844831:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2565:x1830882984761728:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066793.845018:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2565:x1830882984761728:12345-192.168.204.16@tcp:35:cat.0 Request processed in 185us (286us total) trans 8589937309 rc 0/0 00000100:00100000:0.0:1746066793.845023:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6280 00000100:00100000:0.0:1746066793.851273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.851322:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.851362:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.851417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.851454:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984761984 00000100:00100000:0.0:1746066793.851464:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984761984 00002000:00100000:0.0:1746066793.851516:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880093c6a300 x1830882984761984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.851526:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6a300 with x1830882984761984 ext(3145728->4194303) 00010000:00010000:0.0:1746066793.851536:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66600/0xf1867c21abfad4f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f7b expref: 45 pid: 13726 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066793.851549:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66600/0xf1867c21abfad4f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f7b expref: 45 pid: 13726 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066793.851556:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c6a300 00000100:00100000:0.0:1746066793.851594:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6845 00000100:00100000:0.0:1746066793.851600:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882984762496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066793.878245:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.878429:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.883341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.890255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.890303:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.890335:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984763776 00000100:00100000:0.0:1746066793.890339:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984763776 00000100:00100000:0.0:1746066793.890365:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984763648 00000100:00100000:0.0:1746066793.890367:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984763648 00000100:00100000:0.0:1746066793.890380:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18511 00000100:00100000:0.0:1746066793.890385:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882984763776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066793.890397:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.890414:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeae00/0xf1867c21abfad540 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4fb3 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.891377:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984823936:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066793.891426:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.899538:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.902564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.903216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.903304:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.921652:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.921724:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984764544 00000100:00100000:0.0:1746066793.921733:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984764544 00002000:00100000:0.0:1746066793.921777:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4022272->4026367) req@ffff88006e210e00 x1830882984764544/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.921798:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210e00 with x1830882984764544 ext(4022272->4026367) 00002000:00010000:0.0:1746066793.921805:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210e00 00000100:00100000:0.0:1746066793.921826:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6847 00000100:00100000:0.0:1746066793.921845:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882984764544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066793.922041:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882984764544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 196us (400us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066793.922048:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6847 00002000:00100000:0.0:1746066793.922054:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4022272->4026367) req@ffff88006e210e00 x1830882984764544/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.922061:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210e00 with x1830882984764544 ext(4022272->4026367) 00002000:00010000:0.0:1746066793.922064:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210e00 00000100:00100000:0.0:1746066793.936413:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.944328:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984765056 00000100:00100000:0.0:1746066793.944334:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984765056 00002000:00100000:0.0:1746066793.944371:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4075520->4194303) req@ffff88011d857100 x1830882984765056/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.944379:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857100 with x1830882984765056 ext(4075520->4194303) 00010000:00010000:0.0:1746066793.944385:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfad51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f89 expref: 24 pid: 13726 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066793.944397:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfad51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4f89 expref: 24 pid: 13726 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066793.944403:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011d857100 00000100:00100000:0.0:1746066793.944426:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1972 00000100:00100000:0.0:1746066793.944432:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882984765056:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066793.950405:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.955181:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.963704:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.970717:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.970833:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.977823:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.982039:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066793.990504:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882984766080:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12261us (12673us total) trans 21474842347 rc 0/0 00000100:00100000:0.0:1746066793.990515:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1975 00002000:00100000:0.0:1746066793.990526:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4026367) req@ffff880098fbca80 x1830882984766080/t21474842347(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.990535:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882984766080 ext(3145728->4026367) 00010000:00010000:0.0:1746066793.990543:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfad54e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fba expref: 23 pid: 13726 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066793.990558:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfad54e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4026367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fba expref: 23 pid: 13726 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066793.990565:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbca80 00000100:00100000:0.0:1746066793.993290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.000708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.013301:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095874000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984825088:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066794.013325:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.013387:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882984766592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8572us (12688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.013397:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8404 00000100:00100000:0.0:1746066794.018395:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.020292:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984766976 00000100:00100000:0.0:1746066794.020297:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984766976 00000100:00100000:0.0:1746066794.020340:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18519 00000100:00100000:0.0:1746066794.020346:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2565:x1830882984766976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066794.020360:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.020377:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb800/0xf1867c21abfad578 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d4fe4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.020404:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589ac00/0xf1867c21abfad571 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4026367) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fdd expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.020411:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.020413:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.020416:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb800/0xf1867c21abfad578 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fe4 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.020447:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589ac00/0xf1867c21abfad571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4026367) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fdd expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.020458:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589ac00/0xf1867c21abfad571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4026367) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fdd expref: 32 pid: 3528 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.020470:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984825216:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.021048:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.024398:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.026703:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.053592:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.056503:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.063922:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.063970:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.066632:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984768512 00000100:00100000:0.0:1746066794.066636:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984768512 00002000:00100000:0.0:1746066794.066668:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011d854380 x1830882984768512/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.066678:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854380 with x1830882984768512 ext(3145728->4194303) 00002000:00010000:0.0:1746066794.066683:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d854380 00000100:00100000:0.0:1746066794.066699:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6851 00000100:00100000:0.0:1746066794.066704:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882984768512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.076776:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.080416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.086847:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.088756:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984769920 00000100:00100000:0.0:1746066794.088760:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984769920 00002000:00100000:0.0:1746066794.088782:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011d857480 x1830882984769920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.088796:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857480 with x1830882984769920 ext(3145728->4194303) 00002000:00010000:0.0:1746066794.088799:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d857480 00000100:00100000:0.0:1746066794.088822:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6853 00000100:00100000:0.0:1746066794.088827:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882984769920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.130250:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.130289:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.130315:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.130352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.130392:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984770304 00000100:00100000:0.0:1746066794.130395:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984770304 00010000:00010000:0.0:1746066794.130411:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb800/0xf1867c21abfad578 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4fe4 expref: 26 pid: 3528 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.130428:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8406 00000100:00100000:0.0:1746066794.130435:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882984770176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.130449:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.130469:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d93cc00/0xf1867c21abfad5a2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5000 expref: 35 pid: 3528 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746066794.130479:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d93cc00/0xf1867c21abfad5a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5000 expref: 35 pid: 3528 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746066794.131137:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.131179:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882984770176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 744us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.131184:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8406 00000100:00100000:0.0:1746066794.132068:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.135082:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984825856:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066794.135109:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.135148:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882984770560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4598us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.135158:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8408 00000100:00100000:0.0:1746066794.136658:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984770816 00000100:00100000:0.0:1746066794.136665:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984770816 00002000:00100000:0.0:1746066794.136701:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2990080->2994175) req@ffff8800a5b0df80 x1830882984770816/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.136719:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0df80 with x1830882984770816 ext(2990080->2994175) 00002000:00010000:0.0:1746066794.136724:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0df80 00000100:00100000:0.0:1746066794.136751:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6854 00000100:00100000:0.0:1746066794.136759:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882984770816:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066794.136916:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882984770816:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 157us (507us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066794.136921:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6854 00002000:00100000:0.0:1746066794.136926:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2990080->2994175) req@ffff8800a5b0df80 x1830882984770816/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.136933:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0df80 with x1830882984770816 ext(2990080->2994175) 00002000:00010000:0.0:1746066794.136936:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0df80 00000100:00100000:0.0:1746066794.138655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.140631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.144352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.145656:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.145684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.145717:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.148689:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984826624:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066794.148714:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800978a6600/0xf1867c21abfad5ef lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d502a expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.148725:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800978a6600/0xf1867c21abfad5ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d502a expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.148760:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800978a6600, rc 0) 00000100:00100000:0.0:1746066794.148792:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882984771584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2523us (3099us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066794.148798:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18526 00000100:00100000:0.0:1746066794.168274:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.172953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.175287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.178864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.184802:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.190654:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984773504 00000100:00100000:0.0:1746066794.190663:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984773504 00010000:00010000:0.0:1746066794.190705:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfad612 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5031 expref: 13 pid: 10125 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.191270:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8412 00000100:00100000:0.0:1746066794.191279:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984773504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.191295:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.191302:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfad612 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5031 expref: 13 pid: 10125 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.191315:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfad612 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5031 expref: 13 pid: 10125 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.191339:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfad612 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5031 expref: 13 pid: 10125 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.191382:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066794.191387:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfad64a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.191397:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfad64a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.191408:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfad64a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.191436:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.191493:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984773504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.191499:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8412 00000100:00100000:0.0:1746066794.196117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.199719:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.201748:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.201779:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.201813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.201837:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.201856:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984774016 00000100:00100000:0.0:1746066794.201861:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984774016 00000100:00100000:0.0:1746066794.201918:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984774272 00000100:00100000:0.0:1746066794.201921:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984774272 00000100:00100000:0.0:1746066794.201934:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984774528 00000100:00100000:0.0:1746066794.201935:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984774528 00000100:00100000:0.0:1746066794.201944:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984774144 00000100:00100000:0.0:1746066794.201946:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984774144 00000100:00100000:0.0:1746066794.201958:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18534 00000100:00100000:0.0:1746066794.201964:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984774016:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066794.202015:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbebe00/0xf1867c21abfad674 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202032:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06600/0xf1867c21abfad23e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dde expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202039:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfad619 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5038 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202046:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfad268 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e16 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202052:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202054:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202056:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbebe00/0xf1867c21abfad674 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202088:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfad268 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e16 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202100:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfad268 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e16 expref: 45 pid: 20361 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202118:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984827136:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202193:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfad619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5038 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202210:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfad619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5038 expref: 13 pid: 13726 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202218:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984827264:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202249:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d06600/0xf1867c21abfad23e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dde expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202255:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d06600/0xf1867c21abfad23e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dde expref: 25 pid: 1893 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202263:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984827392:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.202275:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.202292:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18535 00000100:00100000:0.0:1746066794.202297:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984774272:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066794.202317:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202326:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dec expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202333:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfad627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5046 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202340:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ee00/0xf1867c21abfad276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e24 expref: 33 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202350:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202351:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202354:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202369:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5ee00/0xf1867c21abfad276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e24 expref: 33 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202377:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ee00/0xf1867c21abfad276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e24 expref: 33 pid: 12255 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202385:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827520:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202412:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfad627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5046 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202419:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfad627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5046 expref: 11 pid: 9590 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202426:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827648:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202448:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dec expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202455:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfad245 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4dec expref: 21 pid: 11630 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202473:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827776:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.202491:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.202516:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.202534:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984774400 00000100:00100000:0.0:1746066794.202536:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984774400 00000100:00100000:0.0:1746066794.202555:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18537 00000100:00100000:0.0:1746066794.202559:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984774144:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066794.202576:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfad689 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202585:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202591:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202598:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfad31e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e86 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202603:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202605:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.202606:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfad689 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202629:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfad31e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e86 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202644:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfad31e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e86 expref: 33 pid: 9592 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.202652:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984828416:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202674:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.202681:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 11 pid: 13726 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066794.202688:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984828672:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.202705:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.202711:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.202717:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984828800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.202726:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.202795:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.209659:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827520:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.209670:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.209677:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984827776:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.209720:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.212941:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984828416:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.212969:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984828672:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.213062:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.213255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.213282:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.213369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.213387:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984775808 00000100:00100000:0.0:1746066794.213391:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984775808 00002000:00100000:0.0:1746066794.213424:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3506175) req@ffff8800a59dd880 x1830882984775808/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.213433:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59dd880 with x1830882984775808 ext(3145728->3506175) 00010000:00010000:0.0:1746066794.213440:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfad5e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d501c expref: 26 pid: 3528 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.213452:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfad5e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d501c expref: 26 pid: 3528 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066794.213459:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a59dd880 00000100:00100000:0.0:1746066794.213482:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8414 00000100:00100000:0.0:1746066794.213488:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2014:x1830882984775936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.214003:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.214016:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 13 pid: 13726 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746066794.214039:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 13 pid: 13726 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746066794.214099:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eaa00/0xf1867c21abfad620 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d503f expref: 13 pid: 13726 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746066794.214127:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.214144:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882984775936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 657us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.214149:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8414 00000100:00100000:0.0:1746066794.214185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214199:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984776448 00000100:00100000:0.0:1746066794.214202:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984776448 00010000:00010000:0.0:1746066794.214249:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.214274:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8416 00000100:00100000:0.0:1746066794.214280:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882984776448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.214287:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.214293:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.214301:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.214322:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfad317 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4e7f expref: 21 pid: 9592 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.214330:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.214345:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882984776448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.214350:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8416 00000100:00100000:0.0:1746066794.214410:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214457:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214492:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214552:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214603:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214624:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214662:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.214687:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066794.215578:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215586:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215610:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215627:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215636:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215644:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db76200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066794.215646:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215651:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215663:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.215669:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76200/0xf1867c21abfad67b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.215701:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984774272:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13399us (13917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.215708:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18535 00000100:00100000:0.0:1746066794.223657:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.226103:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.227819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.231280:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.231474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.231565:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.233238:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.233279:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066794.253492:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937318 is committed 00000004:00080000:0.0:1746066794.253506:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 921 committed 00000004:00080000:0.0:1746066794.253532:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 881 committed 00000004:00080000:0.0:1746066794.253549:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 880 committed 00000004:00080000:0.0:1746066794.253551:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 879 committed 00000004:00080000:0.0:1746066794.253553:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 878 committed 00000004:00080000:0.0:1746066794.253555:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 920 committed 00000004:00080000:0.0:1746066794.253558:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 877 committed 00000004:00080000:0.0:1746066794.253559:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 919 committed 00000004:00080000:0.0:1746066794.253561:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 876 committed 00000004:00080000:0.0:1746066794.253563:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 918 committed 00000004:00080000:0.0:1746066794.253564:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 917 committed 00000004:00080000:0.0:1746066794.253566:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 916 committed 00000004:00080000:0.0:1746066794.253568:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 875 committed 00000004:00080000:0.0:1746066794.253569:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 874 committed 00000004:00080000:0.0:1746066794.253570:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 915 committed 00000004:00080000:0.0:1746066794.253571:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 914 committed 00000004:00080000:0.0:1746066794.253573:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 873 committed 00000001:00080000:0.0:1746066794.253582:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937315 is committed 00000001:00080000:0.0:1746066794.253591:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937312 is committed 00000100:00100000:0.0:1746066794.255712:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.255737:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.261778:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830080 00000100:00100000:0.0:1746066794.261807:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830080 00000100:00100000:0.0:1746066794.261865:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830208 00000100:00100000:0.0:1746066794.261867:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830208 00000100:00100000:0.0:1746066794.261878:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830464 00000100:00100000:0.0:1746066794.261880:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830464 00000100:00100000:0.0:1746066794.261942:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18540 00000100:00100000:0.0:1746066794.261950:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3775:x1830882984830080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262134:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3775:x1830882984830080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (6500us total) trans 17179874960 rc 0/0 00000100:00100000:0.0:1746066794.262141:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18540 00000100:00100000:0.0:1746066794.262156:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18542 00000100:00100000:0.0:1746066794.262161:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3774:x1830882984830464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262221:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3774:x1830882984830464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1002us total) trans 17179874962 rc 0/0 00000100:00100000:0.0:1746066794.262226:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18542 00000004:00080000:0.0:1746066794.262266:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095876d80/2, rc 0, transno 17179874961 00000100:00100000:0.0:1746066794.262286:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262293:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262313:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.262329:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066794.262335:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.262363:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830336 00000100:00100000:0.0:1746066794.262365:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830336 00000100:00100000:0.0:1746066794.262378:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18544 00000100:00100000:0.0:1746066794.262381:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3776:x1830882984830720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262431:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882984830720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (117us total) trans 17179874964 rc 0/0 00000100:00100000:0.0:1746066794.262441:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18544 00000100:00100000:0.0:1746066794.262458:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262475:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.262488:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830848 00000100:00100000:0.0:1746066794.262490:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830848 00000100:00100000:0.0:1746066794.262503:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18546 00000100:00100000:0.0:1746066794.262506:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882984830848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.262560:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882984830848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (83us total) trans 17179874966 rc 0/0 00000100:00100000:0.0:1746066794.262565:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18546 00000004:00080000:0.0:1746066794.262584:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbd180/2, rc 0, transno 17179874966 00000100:00100000:0.0:1746066794.262587:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.262594:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095875f80/2, rc 0, transno 17179874964 00000100:00100000:0.0:1746066794.262596:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.262602:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095876a00/2, rc 0, transno 17179874965 00000100:00100000:0.0:1746066794.262604:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984830336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.265108:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093676a00/2, rc 0, transno 21474842352 00000100:00100000:0.0:1746066794.265115:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984831616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.265123:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093676d80/2, rc 0, transno 21474842350 00000100:00100000:0.0:1746066794.265126:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984831488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.265133:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093677800/2, rc 0, transno 21474842351 00000100:00100000:0.0:1746066794.265136:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093677800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984832000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.265401:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093677b80/2, rc 0, transno 21474842357 00000100:00100000:0.0:1746066794.265418:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984832128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.265460:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984831232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1978us (2256us total) trans 21474842356 rc 0/0 00000100:00100000:0.0:1746066794.265466:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18555 00000100:00100000:0.0:1746066794.287385:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.291456:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.300914:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.317186:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.328597:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.328933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.338236:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.338596:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.338628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.338792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.338956:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340125:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340580:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.340910:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.341198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.341212:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984780416 00000100:00100000:0.0:1746066794.341215:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984780416 00000100:00100000:0.0:1746066794.341230:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984780928 00000100:00100000:0.0:1746066794.341232:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984780928 00000100:00100000:0.0:1746066794.341243:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18564 00000100:00100000:0.0:1746066794.341248:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882984780544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066794.341263:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.341269:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfad723 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d50b6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.341281:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341282:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341286:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfad723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50b6 expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341296:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfad723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50b6 expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341304:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0400, rc 0) 00000100:00100000:0.0:1746066794.341318:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882984780544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.341324:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18564 00000100:00100000:0.0:1746066794.341335:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18566 00000100:00100000:0.0:1746066794.341339:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882984780416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066794.341343:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.341348:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d50af expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.341356:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341358:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341361:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341369:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341379:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1e00, rc 0) 00000100:00100000:0.0:1746066794.341392:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882984780416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.341397:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18566 00000100:00100000:0.0:1746066794.341406:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18568 00000100:00100000:0.0:1746066794.341409:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882984780928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066794.341414:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.341418:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0a00/0xf1867c21abfad73f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d50cb expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.341426:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341427:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.341430:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0a00/0xf1867c21abfad73f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50cb expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341437:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0a00/0xf1867c21abfad73f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50cb expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.341442:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0a00, rc 0) 00000100:00100000:0.0:1746066794.341453:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882984780928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.341457:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18568 00000100:00100000:0.0:1746066794.354771:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.354845:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.354872:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.354946:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.354997:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984781440 00000100:00100000:0.0:1746066794.355005:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984781440 00002000:00100000:0.0:1746066794.355051:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59d8700 x1830882984781440/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.355060:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59d8700 with x1830882984781440 ext(0->1048575) 00002000:00010000:0.0:1746066794.355066:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59d8700 00000100:00100000:0.0:1746066794.355082:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984782080 00000100:00100000:0.0:1746066794.355084:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984782080 00002000:00100000:0.0:1746066794.355094:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59d8380 x1830882984782080/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.355100:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59d8380 with x1830882984782080 ext(1048576->2097151) 00002000:00010000:0.0:1746066794.355103:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59d8380 00000100:00100000:0.0:1746066794.355110:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984782208 00000100:00100000:0.0:1746066794.355112:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984782208 00002000:00100000:0.0:1746066794.355119:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88006e210380 x1830882984782208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.355125:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210380 with x1830882984782208 ext(1048576->2097151) 00002000:00010000:0.0:1746066794.355128:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e210380 00000100:00100000:0.0:1746066794.355143:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6856 00000100:00100000:0.0:1746066794.355150:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882984781440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.355966:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6858 00000100:00100000:0.0:1746066794.355974:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882984782208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.373008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.373051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.373077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.373112:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.386340:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.386424:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.394404:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.394445:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.394537:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984783872 00000100:00100000:0.0:1746066794.394545:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984783872 00010000:00010000:0.0:1746066794.394575:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb000/0xf1867c21abfad6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d507e expref: 13 pid: 17253 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.395754:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984784000 00000100:00100000:0.0:1746066794.395762:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984784000 00010000:00010000:0.0:1746066794.395805:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eac00/0xf1867c21abfad6a5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5077 expref: 9 pid: 17253 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.395840:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8436 00000100:00100000:0.0:1746066794.395849:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882984783872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.395861:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.395867:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb000/0xf1867c21abfad6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d507e expref: 13 pid: 17253 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.395877:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb000/0xf1867c21abfad6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d507e expref: 13 pid: 17253 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.395912:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066794.395916:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.395941:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.395947:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.395953:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfad754 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066794.395957:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfad754 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066794.396130:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.396183:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882984783872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 335us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.396191:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8436 00010000:00010000:0.0:1746066794.396261:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.396268:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066794.396284:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066794.396383:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfad746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50e0 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.397622:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfad75b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50e0 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.397653:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066794.397655:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066794.397668:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf400, rc 0) 00000100:00100000:0.0:1746066794.402987:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.406826:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984832768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.406863:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.406880:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.406918:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.406933:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066794.406938:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984832896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.406953:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.406963:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.406976:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.406995:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984833024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.407014:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066794.410375:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c490000/2, rc 0, transno 21474842363 00000100:00100000:0.0:1746066794.410380:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984833024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.410386:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984833536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.410404:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.410426:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984833536 00000100:00100000:0.0:1746066794.410429:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984833536 00000100:00100000:0.0:1746066794.410447:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18577 00000100:00100000:0.0:1746066794.410451:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3775:x1830882984834688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066794.410499:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:0.0:1746066794.410502:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066794.410504:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066794.410505:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066794.410517:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066794.410535:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882984834688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (363us total) trans 17179874970 rc 0/0 00000100:00100000:0.0:1746066794.410541:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18577 00000100:00100000:0.0:1746066794.410550:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18578 00000100:00100000:0.0:1746066794.410555:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3775:x1830882984834048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066794.410590:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066794.410593:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066795 -> 1746066795 00002000:00010000:0.0:1746066794.410595:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066794.410596:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066795 -> 1746066795 00002000:00010000:0.0:1746066794.410598:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066794.410613:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882984834048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (392us total) trans 17179874971 rc 0/0 00000100:00100000:0.0:1746066794.410617:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18578 00000100:00100000:0.0:1746066794.410625:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18579 00000100:00100000:0.0:1746066794.410629:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3775:x1830882984834560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.410675:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882984834560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (401us total) trans 17179874972 rc 0/0 00000100:00100000:0.0:1746066794.410680:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18579 00000100:00100000:0.0:1746066794.410706:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.410726:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.410737:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984834304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.410750:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066794.410764:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d856300/2, rc 0, transno 21474842361 00000100:00100000:0.0:1746066794.410768:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984832896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.410794:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958afb80/2, rc 0, transno 21474842360 00000100:00100000:0.0:1746066794.410797:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.410804:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855500/2, rc 0, transno 21474842358 00000100:00100000:0.0:1746066794.410807:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984832768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066794.410813:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad180/2, rc 0, transno 21474842359 00000100:00100000:0.0:1746066794.410816:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.410822:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066794.410826:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.410840:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.410848:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984834432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066794.410858:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.410870:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984833920 00000100:00100000:0.0:1746066794.410873:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984833920 00000100:00100000:0.0:1746066794.410898:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984834432 00000100:00100000:0.0:1746066794.410900:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984834432 00000100:00100000:0.0:1746066794.410908:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18582 00000100:00100000:0.0:1746066794.410912:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882984834304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066794.410957:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066794.410959:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066794.410960:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066794.410962:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066794.410964:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066794.410980:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3776:x1830882984834304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (230us total) trans 17179874974 rc 0/0 00000100:00100000:0.0:1746066794.410985:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18582 00000004:00080000:0.0:1746066794.411010:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421f80/2, rc 0, transno 17179874976 00000100:00100000:0.0:1746066794.411016:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984834432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.411022:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093675180/2, rc 0, transno 17179874973 00000100:00100000:0.0:1746066794.411025:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.411030:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420700/2, rc 0, transno 17179874974 00000100:00100000:0.0:1746066794.411032:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984834304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.411137:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e422a00/2, rc 0, transno 17179874975 00000100:00100000:0.0:1746066794.411141:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984833920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066794.412112:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad880/2, rc 0, transno 21474842365 00000100:00100000:0.0:1746066794.412116:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984833536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066794.412485:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.413343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.428703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.430130:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.430172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.442467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.442510:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.442542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.442658:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984835200:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066794.442678:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.442722:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882984785408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8076us (9995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.442733:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8438 00000100:00100000:0.0:1746066794.449472:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.456989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.469428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.471645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.472318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.473853:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.473958:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.477970:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.478056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.481193:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984787840 00000100:00100000:0.0:1746066794.481198:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984787840 00002000:00100000:0.0:1746066794.481233:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1523712->1527807) req@ffff880094370a80 x1830882984787840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.481242:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370a80 with x1830882984787840 ext(1523712->1527807) 00010000:00010000:0.0:1746066794.481250:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfad77e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5103 expref: 23 pid: 1893 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.481260:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfad77e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5103 expref: 23 pid: 1893 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066794.481266:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094370a80 00000100:00100000:0.0:1746066794.481281:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1979 00000100:00100000:0.0:1746066794.481286:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882984787840:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066794.481481:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882984787840:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 193us (348us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066794.481488:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1979 00002000:00100000:0.0:1746066794.481700:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1523712->1527807) req@ffff880094370a80 x1830882984787840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.481725:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370a80 with x1830882984787840 ext(1523712->1527807) 00010000:00010000:0.0:1746066794.481732:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfad77e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5103 expref: 23 pid: 1893 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066794.481741:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfad77e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5103 expref: 23 pid: 1893 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066794.481746:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094370a80 00000100:00100000:0.0:1746066794.489558:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.489649:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.489928:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.500607:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.501426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.507631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.511570:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.526093:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.540051:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.544714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.544762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.544818:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984790784 00000100:00100000:0.0:1746066794.544826:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984790784 00000100:00100000:0.0:1746066794.544868:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18594 00000100:00100000:0.0:1746066794.544876:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009437dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2586:x1830882984790784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066794.544921:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.544940:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfad7af lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5134 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.544982:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfad777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50fc expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.544989:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.544990:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.544993:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfad7af lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5134 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.545023:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfad777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50fc expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.545034:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfad777 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50fc expref: 34 pid: 1893 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066794.545046:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009437df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984837248:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.545120:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.546191:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009437df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984837248:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.546203:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfad7af lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5134 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.546211:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2200, rc 0) 00000100:00100000:0.0:1746066794.546224:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009437dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2586:x1830882984790784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1350us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.546229:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18594 00000100:00100000:0.0:1746066794.548064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.549650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.554294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.555921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.566787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.566832:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.595197:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.595241:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.609458:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.610378:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.610824:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.610869:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.610907:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984792704 00000100:00100000:0.0:1746066794.610918:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984792704 00002000:00100000:0.0:1746066794.610970:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88008e435880 x1830882984792704/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.610980:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435880 with x1830882984792704 ext(2097152->4194303) 00002000:00010000:0.0:1746066794.610986:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435880 00000100:00100000:0.0:1746066794.611002:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984792960 00000100:00100000:0.0:1746066794.611004:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984792960 00002000:00100000:0.0:1746066794.611015:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88008e435c00 x1830882984792960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.611022:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435c00 with x1830882984792960 ext(2097152->4194303) 00002000:00010000:0.0:1746066794.611025:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e435c00 00000100:00100000:0.0:1746066794.611042:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6876 00000100:00100000:0.0:1746066794.611051:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882984792704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.635450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.657674:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.717637:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066794.717660:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066794.717729:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066794.720740:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984837632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066794.731454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.735928:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.746543:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.771823:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790694:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790726:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790768:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790842:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.790877:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984794624 00000100:00100000:0.0:1746066794.790904:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984794624 00000100:00100000:0.0:1746066794.790948:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18599 00000100:00100000:0.0:1746066794.790956:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984794624:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.790974:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.790992:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0d200/0xf1867c21abfad834 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d516c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791017:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791019:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791029:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0d200/0xf1867c21abfad834 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d516c expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791052:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0d200/0xf1867c21abfad834 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d516c expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791064:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d200, rc 0) 00000100:00100000:0.0:1746066794.791111:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984794624:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 155us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791117:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18599 00000100:00100000:0.0:1746066794.791131:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984794880 00000100:00100000:0.0:1746066794.791133:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984794880 00000100:00100000:0.0:1746066794.791148:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984795136 00000100:00100000:0.0:1746066794.791151:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984795136 00000100:00100000:0.0:1746066794.791164:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984794752 00000100:00100000:0.0:1746066794.791166:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984794752 00000100:00100000:0.0:1746066794.791180:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984795008 00000100:00100000:0.0:1746066794.791183:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984795008 00000100:00100000:0.0:1746066794.791196:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984795264 00000100:00100000:0.0:1746066794.791198:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984795264 00000100:00100000:0.0:1746066794.791213:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18600 00000100:00100000:0.0:1746066794.791219:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984794880:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.791227:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.791238:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d517a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791251:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791253:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791258:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d517a expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791275:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d517a expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791283:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0da00, rc 0) 00000100:00100000:0.0:1746066794.791305:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984794880:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791309:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18600 00000100:00100000:0.0:1746066794.791322:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18601 00000100:00100000:0.0:1746066794.791326:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984795136:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.791332:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.791338:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0de00/0xf1867c21abfad842 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5188 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791351:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791352:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791357:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0de00/0xf1867c21abfad842 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5188 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791367:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0de00/0xf1867c21abfad842 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5188 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791374:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0de00, rc 0) 00000100:00100000:0.0:1746066794.791394:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984795136:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 66us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791399:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18601 00000100:00100000:0.0:1746066794.791412:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18602 00000100:00100000:0.0:1746066794.791417:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984794752:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.791424:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.791432:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfad849 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5173 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791445:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791447:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791452:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfad849 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5173 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791461:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfad849 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5173 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791468:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0ce00, rc 0) 00000100:00100000:0.0:1746066794.791486:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984794752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 68us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791490:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18602 00000100:00100000:0.0:1746066794.791501:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18603 00000100:00100000:0.0:1746066794.791507:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984795008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.791514:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.791520:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5181 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791531:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791532:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791537:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791547:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791554:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c800, rc 0) 00000100:00100000:0.0:1746066794.791571:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984795008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 64us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791576:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18603 00000100:00100000:0.0:1746066794.791587:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18604 00000100:00100000:0.0:1746066794.791592:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984795264:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066794.791598:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.791605:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad857 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d518f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.791618:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791619:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.791624:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d518f expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791632:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c200/0xf1867c21abfad857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d518f expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.791639:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c200, rc 0) 00000100:00100000:0.0:1746066794.791657:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984795264:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 65us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.791662:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18604 00000100:00100000:0.0:1746066794.797824:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.807926:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.808203:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984837888:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.808225:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898400/0xf1867c21abfad865 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.809073:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898400/0xf1867c21abfad865 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066794.809079:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898400/0xf1867c21abfad865 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066794.809092:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066794.809142:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfad85e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5196 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.809170:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898400/0xf1867c21abfad865 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5196 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.809176:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066794.809178:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066794.809180:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898400, rc 0) 00000100:00100000:0.0:1746066794.809197:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2599:x1830882984795520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 10183us (11386us total) trans 8589937331 rc 0/0 00000100:00100000:0.0:1746066794.809208:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16898 00000100:00100000:0.0:1746066794.816226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.816273:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.816791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.817821:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984796416 00000100:00100000:0.0:1746066794.817826:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984796416 00000100:00100000:0.0:1746066794.817851:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6293 00000100:00100000:0.0:1746066794.817856:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2602:x1830882984796416:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066794.818274:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2602:x1830882984796416:12345-192.168.204.16@tcp:35:cat.0 Request processed in 416us (1482us total) trans 8589937332 rc 0/0 00000100:00100000:0.0:1746066794.818281:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6293 00000100:00100000:0.0:1746066794.830719:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.831283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.838825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.838864:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.844725:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.844755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.844814:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.844835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.844855:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984797824 00000100:00100000:0.0:1746066794.844858:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984797824 00010000:00010000:0.0:1746066794.844881:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d517a expref: 11 pid: 12255 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.844916:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984797952 00000100:00100000:0.0:1746066794.844917:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984797952 00010000:00010000:0.0:1746066794.844926:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfad78c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5111 expref: 39 pid: 1893 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066794.844939:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8453 00000100:00100000:0.0:1746066794.844945:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882984797824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.844958:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.844978:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d517a expref: 11 pid: 12255 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.844989:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfad83b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d517a expref: 11 pid: 12255 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.845012:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.845048:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882984797824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.845053:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8453 00000100:00100000:0.0:1746066794.845065:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8454 00000100:00100000:0.0:1746066794.845069:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882984797952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.845073:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.845077:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfad78c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5111 expref: 39 pid: 1893 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066794.845084:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfad78c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5111 expref: 39 pid: 1893 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066794.845092:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.845100:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882984797952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.845104:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8454 00000100:00100000:0.0:1746066794.886027:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.886075:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.886190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.886211:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984798848 00000100:00100000:0.0:1746066794.886214:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984798848 00010000:00010000:0.0:1746066794.886236:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfad7c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5149 expref: 26 pid: 9590 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.886256:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8455 00000100:00100000:0.0:1746066794.886261:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882984798848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.886271:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.886289:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfad7c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5149 expref: 26 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.886300:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfad7c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5149 expref: 26 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.886321:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfad7c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5149 expref: 26 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.886339:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.886341:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.886347:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfad8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.886354:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfad8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.886382:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfad8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.886394:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094378380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984838528:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066794.886456:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.893008:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094378380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984838528:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066794.893021:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.893053:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882984798848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6791us (6862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.893062:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8455 00000100:00100000:0.0:1746066794.897489:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.902278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.902327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.902378:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.902415:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984800000 00000100:00100000:0.0:1746066794.902424:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984800000 00000100:00100000:0.0:1746066794.902469:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18608 00000100:00100000:0.0:1746066794.902478:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2596:x1830882984800000:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066794.902498:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.902516:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfad8ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d51ce expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.902548:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.902557:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.902566:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.902577:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.902579:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.902583:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfad8ea lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ce expref: 48 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.902616:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.902627:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 27 pid: 9590 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.902640:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094378e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984838784:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.902739:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.902747:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 12 pid: 12255 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.902756:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094379180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984838912:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066794.902793:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.902801:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 48 pid: 3528 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066794.902814:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094379500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984839040:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066794.902838:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.913605:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.913632:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984800128 00000100:00100000:0.0:1746066794.913639:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984800128 00010000:00010000:0.0:1746066794.913674:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 49 pid: 3528 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066794.913701:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8456 00000100:00100000:0.0:1746066794.913708:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882984800128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.913723:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.913743:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 49 pid: 3528 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066794.913754:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfad7a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d512d expref: 49 pid: 3528 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066794.913792:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.913827:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882984800128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.913833:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8456 00000100:00100000:0.0:1746066794.914290:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.914304:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984800256 00000100:00100000:0.0:1746066794.914306:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984800256 00010000:00010000:0.0:1746066794.914320:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.914335:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8457 00000100:00100000:0.0:1746066794.914339:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984800256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.914345:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.914352:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.914359:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.914370:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c800/0xf1867c21abfad850 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5181 expref: 13 pid: 12255 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.914381:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.914396:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984800256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.914401:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8457 00000100:00100000:0.0:1746066794.914456:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.922356:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984800640 00000100:00100000:0.0:1746066794.922362:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984800640 00010000:00010000:0.0:1746066794.922386:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 28 pid: 9590 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066794.922408:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8458 00000100:00100000:0.0:1746066794.922413:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882984800640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.922427:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.922447:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 28 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.922457:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 28 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.922476:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771800/0xf1867c21abfad7cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5150 expref: 28 pid: 9590 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066794.922495:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.922497:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.922503:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfad8ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ce expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.922511:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfad8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ce expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.922544:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfad8ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ce expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.922555:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009437a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984839296:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066794.922607:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.926232:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882984799872:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 22714us (23890us total) trans 21474842368 rc 0/0 00000100:00100000:0.0:1746066794.926245:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1987 00002000:00100000:0.0:1746066794.926259:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1523712->2097151) req@ffff880094378700 x1830882984799872/t21474842368(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.926268:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094378700 with x1830882984799872 ext(1523712->2097151) 00010000:00010000:0.0:1746066794.926279:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfad8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ab expref: 39 pid: 1893 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066794.926292:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfad8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51ab expref: 39 pid: 1893 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066794.926299:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094378700 00000100:00100000:0.0:1746066794.929503:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009437a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984839296:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066794.929523:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.929560:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882984800640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7146us (10368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.929568:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8458 00000001:00080000:0.0:1746066794.931227:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842368 is committed 00000001:00080000:0.0:1746066794.931248:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842366 is committed 00000001:00080000:0.0:1746066794.931255:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842365 is committed 00000001:00080000:0.0:1746066794.931339:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842325 is committed 00000100:00100000:0.0:1746066794.943404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.947360:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.968988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.969069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066794.969571:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6887 00000100:00100000:0.0:1746066794.969584:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882984802560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066794.977002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.019116:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.019139:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984802944 00000100:00100000:0.0:1746066795.019147:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984802944 00000100:00100000:0.0:1746066795.036095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.046112:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984839680:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066795.046124:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984839808:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066795.047817:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.047879:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009437ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882984803072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11295us (11791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.047904:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8460 00000100:00100000:0.0:1746066795.048054:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984803456 00000100:00100000:0.0:1746066795.048059:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984803456 00002000:00100000:0.0:1746066795.048093:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880094371c00 x1830882984803456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.048103:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371c00 with x1830882984803456 ext(1048576->2097151) 00002000:00010000:0.0:1746066795.048109:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371c00 00000100:00100000:0.0:1746066795.048124:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6888 00000100:00100000:0.0:1746066795.048131:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882984803456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066795.054577:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984803712 00000100:00100000:0.0:1746066795.054587:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984803712 00002000:00100000:0.0:1746066795.054638:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880094371f80 x1830882984803712/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.054649:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371f80 with x1830882984803712 ext(1048576->2097151) 00002000:00010000:0.0:1746066795.054655:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371f80 00000100:00100000:0.0:1746066795.054780:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6889 00000100:00100000:0.0:1746066795.054790:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882984803712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066795.072288:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.072322:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.072342:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984803840 00000100:00100000:0.0:1746066795.072349:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984803840 00010000:00010000:0.0:1746066795.073198:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0de00/0xf1867c21abfad842 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5188 expref: 9 pid: 12255 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066795.075249:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882984803456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27111us (29135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066795.075259:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6888 00002000:00100000:0.0:1746066795.075268:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880094371c00 x1830882984803456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.075278:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371c00 with x1830882984803456 ext(1048576->2097151) 00002000:00010000:0.0:1746066795.075283:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371c00 00000100:00100000:0.0:1746066795.075420:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882984803712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 20632us (21338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066795.075425:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6889 00002000:00100000:0.0:1746066795.075430:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880094371f80 x1830882984803712/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.075436:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371f80 with x1830882984803712 ext(1048576->2097151) 00002000:00010000:0.0:1746066795.075439:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371f80 00000100:00100000:0.0:1746066795.084475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.087119:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.087439:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.087469:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984804736 00000100:00100000:0.0:1746066795.087474:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984804736 00002000:00100000:0.0:1746066795.087504:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880094378700 x1830882984804736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:201/0 lens 504/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.087513:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094378700 with x1830882984804736 ext(2097152->4194303) 00002000:00010000:0.0:1746066795.087517:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094378700 00000100:00100000:0.0:1746066795.087544:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6891 00000100:00100000:0.0:1746066795.087549:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882984804736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066795.110287:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.111705:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.116614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.120307:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.120447:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.148244:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.153198:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.164627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.166396:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.177142:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.177184:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.180958:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.182135:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.196558:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.196585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.197459:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8470 00000100:00100000:0.0:1746066795.197464:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882984808704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.197470:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.197474:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfad8dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51c7 expref: 38 pid: 17253 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066795.197484:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfad8dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51c7 expref: 38 pid: 17253 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066795.197502:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfad8dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d51c7 expref: 38 pid: 17253 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066795.197513:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066795.197517:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0bc00/0xf1867c21abfad945 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.197525:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0bc00/0xf1867c21abfad945 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.197530:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0bc00/0xf1867c21abfad945 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.197754:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.197786:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882984808704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 320us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.197792:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8470 00000100:00100000:0.0:1746066795.208567:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882984808576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25458us (26425us total) trans 0 rc 667648/667648 00000100:00100000:0.0:1746066795.208582:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6897 00002000:00100000:0.0:1746066795.208592:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5767480 x1830882984808576/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.208600:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767480 with x1830882984808576 ext(4194304->4861951) 00002000:00010000:0.0:1746066795.208605:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5767480 00000100:00100000:0.0:1746066795.218214:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.223976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.330215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.340755:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.345537:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.349594:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984809856 00000100:00100000:0.0:1746066795.349600:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984809856 00002000:00100000:0.0:1746066795.349633:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3895296->3899391) req@ffff880095dd5c00 x1830882984809856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.349642:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882984809856 ext(3895296->3899391) 00002000:00010000:0.0:1746066795.349646:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:0.0:1746066795.349676:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6899 00000100:00100000:0.0:1746066795.349682:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882984809856:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066795.349996:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882984809856:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 312us (471us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066795.350002:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6899 00002000:00100000:0.0:1746066795.350007:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3895296->3899391) req@ffff880095dd5c00 x1830882984809856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.350015:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882984809856 ext(3895296->3899391) 00002000:00010000:0.0:1746066795.350017:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:0.0:1746066795.356751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.358087:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.359125:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984842368:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066795.359133:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984842496:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066795.359156:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e0a600/0xf1867c21abfad961 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->3768319] (req 3145728->3768319) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5237 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.359167:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a600, rc 0) 00000100:00100000:0.0:1746066795.359198:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2610:x1830882984809984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2210us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.359204:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18622 00000100:00100000:0.0:1746066795.361160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.364735:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.365383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.365411:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984811136 00000100:00100000:0.0:1746066795.365417:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984811136 00000100:00100000:0.0:1746066795.365515:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18624 00000100:00100000:0.0:1746066795.365523:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882984811136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066795.365538:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.365551:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfad992 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d524c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.365594:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984842880:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066795.365634:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.370044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.376561:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.377671:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984811904 00000100:00100000:0.0:1746066795.377680:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984811904 00000100:00100000:0.0:1746066795.377723:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18625 00000100:00100000:0.0:1746066795.377730:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882984811904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066795.377748:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.377772:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfad9bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5261 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.377823:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984843008:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066795.377947:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.382043:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.389494:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.400752:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882984812288:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10688us (11255us total) trans 17179874982 rc 0/0 00000100:00100000:0.0:1746066795.400772:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1992 00002000:00100000:0.0:1746066795.400785:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3895296->4194303) req@ffff8800a5765f80 x1830882984812288/t17179874982(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.400794:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765f80 with x1830882984812288 ext(3895296->4194303) 00010000:00010000:0.0:1746066795.400805:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095dd1400/0xf1867c21abfad95a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5230 expref: 31 pid: 11630 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066795.400821:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095dd1400/0xf1867c21abfad95a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5230 expref: 31 pid: 11630 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066795.400827:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5765f80 00000100:00100000:0.0:1746066795.405013:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.414729:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.437727:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.457009:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.474311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.474419:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.481112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.484008:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.484019:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984813824 00000100:00100000:0.0:1746066795.484024:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984813824 00002000:00100000:0.0:1746066795.484043:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880095cece00 x1830882984813824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.484049:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882984813824 ext(3145728->4194303) 00002000:00010000:0.0:1746066795.484052:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cece00 00000100:00100000:0.0:1746066795.484062:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6903 00000100:00100000:0.0:1746066795.484066:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882984813824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066795.505426:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.508634:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.508697:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.508715:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984814208 00000100:00100000:0.0:1746066795.508720:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984814208 00002000:00100000:0.0:1746066795.508748:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800958ac000 x1830882984814208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.508767:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac000 with x1830882984814208 ext(2097152->4194303) 00002000:00010000:0.0:1746066795.508772:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ac000 00000100:00100000:0.0:1746066795.508791:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984814464 00000100:00100000:0.0:1746066795.508793:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984814464 00002000:00100000:0.0:1746066795.508803:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800958ac700 x1830882984814464/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.508809:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882984814464 ext(2097152->4194303) 00002000:00010000:0.0:1746066795.508812:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ac700 00000100:00100000:0.0:1746066795.508822:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6904 00000100:00100000:0.0:1746066795.508827:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882984814208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066795.549850:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882984814208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 41020us (41217us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066795.549860:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6904 00002000:00100000:0.0:1746066795.549870:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800958ac000 x1830882984814208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.549880:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac000 with x1830882984814208 ext(2097152->4194303) 00002000:00010000:0.0:1746066795.549896:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ac000 00000100:00100000:0.0:1746066795.558853:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.565307:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.565349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.574723:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.579351:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.591775:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.591817:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.591828:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984816768 00000100:00100000:0.0:1746066795.591833:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984816768 00010000:00010000:0.0:1746066795.591851:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 21 pid: 13726 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066795.591865:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8480 00000100:00100000:0.0:1746066795.591870:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882984816768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.591877:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.591902:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 21 pid: 13726 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.591911:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 21 pid: 13726 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.591924:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1e00/0xf1867c21abfad731 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d50af expref: 21 pid: 13726 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.591942:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.591958:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882984816768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.591962:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8480 00000100:00100000:0.0:1746066795.596962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.606027:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.607428:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094373800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984844672:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066795.607453:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4200/0xf1867c21abfada4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52c3 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.607463:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4200/0xf1867c21abfada4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52c3 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.607485:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4200, rc 0) 00000100:00100000:0.0:1746066795.607520:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882984817792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3540us (3676us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066795.607527:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18637 00000100:00100000:0.0:1746066795.611676:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.611706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.612502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.619634:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.623322:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.633384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.731608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.731658:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.745590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.752293:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.752388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.752414:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984819712 00000100:00100000:0.0:1746066795.752422:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984819712 00000100:00100000:0.0:1746066795.752463:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18642 00000100:00100000:0.0:1746066795.752471:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2626:x1830882984819712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066795.752493:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.752511:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096deb800/0xf1867c21abfada87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d52ed expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.752539:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.752546:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfada80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52e6 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.752552:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066795.752555:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096deb800/0xf1867c21abfada87 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52ed expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.752591:0:11630:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfada80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52e6 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.752608:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096deb800/0xf1867c21abfada87 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52ed expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.752620:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096deb800, rc 0) 00000100:00100000:0.0:1746066795.752661:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2626:x1830882984819712:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 191us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.752667:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18642 00000100:00100000:0.0:1746066795.775117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.775215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.775267:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984820096 00000100:00100000:0.0:1746066795.775276:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984820096 00000100:00100000:0.0:1746066795.777385:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16910 00000100:00100000:0.0:1746066795.777394:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2634:x1830882984820096:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066795.777416:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.777431:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096deb400/0xf1867c21abfada8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d52f4 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.777500:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777512:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777521:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777531:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777537:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777541:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777640:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfadaa3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777648:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfadaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777653:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfadaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066795.777661:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066795.777736:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777742:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777747:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777762:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777768:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9c000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066795.777772:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777778:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777787:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066795.777789:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066795.777793:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777798:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c000/0xf1867c21abfada95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777810:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777814:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777819:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777823:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9c600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066795.777826:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777830:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777836:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093a37400) 00010000:00010000:0.0:1746066795.777838:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066795.777839:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.777844:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfada9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066795.778178:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096deb400/0xf1867c21abfada8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52f4 expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.778190:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfadaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52f4 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.778196:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066795.778198:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066795.778200:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9da00, rc 0) 00000100:00100000:0.0:1746066795.785426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.785470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.785556:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.794399:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.794438:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984820864 00000100:00100000:0.0:1746066795.794445:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984820864 00010000:00010000:0.0:1746066795.794479:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9ce00/0xf1867c21abfada10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5292 expref: 10 pid: 1893 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066795.794502:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8486 00000100:00100000:0.0:1746066795.794508:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984820864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.794522:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.794541:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880098f9ce00/0xf1867c21abfada10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5292 expref: 10 pid: 1893 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.794551:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f9ce00/0xf1867c21abfada10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5292 expref: 10 pid: 1893 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.794575:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9ce00/0xf1867c21abfada10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5292 expref: 10 pid: 1893 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066795.794611:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.794638:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984820864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.794645:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8486 00000100:00100000:0.0:1746066795.799168:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.802047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.814230:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.820946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.820983:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.821019:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.821085:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.821830:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.832332:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984823424 00000100:00100000:0.0:1746066795.832339:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984823424 00000100:00100000:0.0:1746066795.832380:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18647 00000100:00100000:0.0:1746066795.832388:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+21:2626:x1830882984823424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066795.832403:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.832417:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfadaf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d531e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.832440:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.832445:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfadab8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5302 expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.832451:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066795.832455:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfadaf0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d531e expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.832489:0:13363:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfadab8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5302 expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.832503:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfadaf0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d531e expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.832512:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:0.0:1746066795.832547:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2626:x1830882984823424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 161us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.832553:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18647 00000100:00100000:0.0:1746066795.835115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.837131:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.840069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.858700:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.858737:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.858785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.867230:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.867293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.874150:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.878272:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.878357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.878399:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984825472 00000100:00100000:0.0:1746066795.878407:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984825472 00010000:00010000:0.0:1746066795.878441:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfadab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52fb expref: 12 pid: 9590 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066795.878834:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8493 00000100:00100000:0.0:1746066795.878842:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882984825472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.878856:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066795.878873:0:7230:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066795 -> 1746066796 00002000:00010000:0.0:1746066795.878876:0:7230:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066795 -> 1746066796 00010000:00010000:0.0:1746066795.878906:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfadab1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52fb expref: 12 pid: 9590 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066795.878917:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfadab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1417215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52fb expref: 12 pid: 9590 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066795.878941:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfadab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1417215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52fb expref: 12 pid: 9590 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066795.878956:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.878958:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.878965:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfadafe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d532c expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.878972:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfadafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d532c expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.879000:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfadafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d532c expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.879016:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095876680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984847872:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066795.879077:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.888104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.899570:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.904790:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.904904:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.920266:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.920387:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.922651:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.924819:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.925602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.939404:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.939436:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.939471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.953271:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.966126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.966176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066795.970984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.001478:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.013190:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.017794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.019712:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.019799:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066796.020121:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066796.024563:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.038477:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.089693:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066796.091034:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066796.099614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.100044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.100094:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.104503:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.104528:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984830976 00000100:00100000:0.0:1746066796.104535:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984830976 00002000:00100000:0.0:1746066796.104577:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1347584->1351679) req@ffff88006e210000 x1830882984830976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.104588:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882984830976 ext(1347584->1351679) 00002000:00010000:0.0:1746066796.104593:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210000 00000100:00100000:0.0:1746066796.105306:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6920 00000100:00100000:0.0:1746066796.105314:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882984830976:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.105459:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882984830976:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 145us (959us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066796.105465:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6920 00002000:00100000:0.0:1746066796.105470:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1347584->1351679) req@ffff88006e210000 x1830882984830976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:202/0 lens 488/4536 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.105477:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882984830976 ext(1347584->1351679) 00002000:00010000:0.0:1746066796.105480:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210000 00000100:00100000:0.0:1746066796.113030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.116693:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.145110:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984831616 00000100:00100000:0.0:1746066796.145115:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984831616 00000100:00100000:0.0:1746066796.145542:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18661 00000100:00100000:0.0:1746066796.145550:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882984831616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.145560:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.145572:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfadbc9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d53a3 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.145605:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984849792:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.145816:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.149482:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066796.149615:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066796 -> 1746066797 00002000:00010000:0.0:1746066796.149619:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066796 -> 1746066797 00000100:00100000:0.0:1746066796.149640:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984849664:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.149676:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77e00/0xf1867c21abfadbc2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d539c expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.149690:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db77e00/0xf1867c21abfadbc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d539c expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.149705:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77e00, rc 0) 00000100:00100000:0.0:1746066796.149758:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882984831488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5751us (7883us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.149767:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18660 00000100:00100000:0.0:1746066796.153879:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.162099:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984832384 00000100:00100000:0.0:1746066796.162108:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984832384 00002000:00100000:0.0:1746066796.162157:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd6680 x1830882984832384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.162172:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6680 with x1830882984832384 ext(1048576->2097151) 00002000:00010000:0.0:1746066796.162177:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd6680 00000100:00100000:0.0:1746066796.162213:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6922 00000100:00100000:0.0:1746066796.162220:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882984832384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066796.174033:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882984832384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11800us (12330us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066796.174046:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6922 00002000:00100000:0.0:1746066796.174057:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd6680 x1830882984832384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.174067:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6680 with x1830882984832384 ext(1048576->2097151) 00002000:00010000:0.0:1746066796.174072:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd6680 00000100:00100000:0.0:1746066796.191115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.191231:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.194640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.194706:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984833152 00000100:00100000:0.0:1746066796.194712:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984833152 00000100:00100000:0.0:1746066796.194756:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16918 00000100:00100000:0.0:1746066796.194764:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2658:x1830882984833152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.194785:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.194801:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfadbf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d53b8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.194872:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.194907:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.194917:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.194926:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.194932:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.194937:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195024:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfadc08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195033:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfadc08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195039:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfadc08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746066796.195047:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066796.195120:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195125:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195131:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195136:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195142:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095750800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066796.195146:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195152:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195162:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066796.195165:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.195169:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195173:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfadbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195189:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195194:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195198:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195202:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066796.195204:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195209:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195215:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855600) 00010000:00010000:0.0:1746066796.195217:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.195220:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195224:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfadc01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.195254:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfadbf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b8 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.195263:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfadc08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b8 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.195268:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.195270:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066796.195273:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.195278:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.195283:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751800, rc 0) 00000100:00100000:0.0:1746066796.195312:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2658:x1830882984833152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 549us (672us total) trans 8589937357 rc 0/0 00000100:00100000:0.0:1746066796.195318:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16918 00000100:00100000:0.0:1746066796.197248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.197871:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.199101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.199145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066796.200737:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200753:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066796.200792:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066796.200796:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066796.200809:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200818:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200829:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200835:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200840:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200845:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200851:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e429800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066796.200855:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200861:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200868:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066796.200870:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.200873:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200878:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200905:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200910:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200914:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200918:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e429000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066796.200921:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200925:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200931:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855600) 00010000:00010000:0.0:1746066796.200933:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.200936:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200940:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429000/0xf1867c21abfadbe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066796.200967:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428600/0xf1867c21abfadbd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.200977:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.200983:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.200986:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066796.200988:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428a00, rc 0) 00000100:00100000:0.0:1746066796.201015:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2656:x1830882984832640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9225us (9784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.201021:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16917 00000100:00100000:0.0:1746066796.203482:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.203532:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.203572:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.203593:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984833792 00000100:00100000:0.0:1746066796.203600:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984833792 00000100:00100000:0.0:1746066796.203642:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 973 00000100:00100000:0.0:1746066796.203649:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882984833792:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066796.203707:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882984833792:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.203713:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 973 00000100:00100000:0.0:1746066796.203723:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984834048 00000100:00100000:0.0:1746066796.203726:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984834048 00000100:00100000:0.0:1746066796.203740:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 974 00000100:00100000:0.0:1746066796.203754:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882984834048:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066796.210480:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.210517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.210533:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.210554:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984834176 00000100:00100000:0.0:1746066796.210565:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984834176 00000100:00100000:0.0:1746066796.210621:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984834304 00000100:00100000:0.0:1746066796.210624:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984834304 00000100:00100000:0.0:1746066796.210639:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18663 00000100:00100000:0.0:1746066796.210646:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882984834176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.210670:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.210688:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095750800/0xf1867c21abfadc16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d53bf expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.210756:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984850176:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.210837:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.210873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.210961:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984834432 00000100:00100000:0.0:1746066796.210964:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984834432 00000100:00100000:0.0:1746066796.210982:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18664 00000100:00100000:0.0:1746066796.210987:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882984834304:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066796.210995:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.211000:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095750a00/0xf1867c21abfadc1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d53c6 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.211023:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c775880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984850304:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.211058:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.211074:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18665 00000100:00100000:0.0:1746066796.211079:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984834432:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066796.211086:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.211095:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751000/0xf1867c21abfadc24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d53cd expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.211118:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984850432:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.211143:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.220237:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984850176:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.220275:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095750800/0xf1867c21abfadc16 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53bf expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.220291:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095750800/0xf1867c21abfadc16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53bf expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.220306:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750800, rc 0) 00000100:00100000:0.0:1746066796.220356:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882984834176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9708us (9836us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.220364:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18663 00000100:00100000:0.0:1746066796.222384:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984850432:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.222403:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751000/0xf1867c21abfadc24 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53cd expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.222412:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751000/0xf1867c21abfadc24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53cd expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.222420:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751000, rc 0) 00000100:00100000:0.0:1746066796.222454:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984834432:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 11374us (11580us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.222461:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18665 00000100:00100000:0.0:1746066796.239420:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.240768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.242636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.280183:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984850560:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066796.280211:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066796.280250:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984850688:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066796.280263:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.280306:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882984834816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 39220us (39540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.280316:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8505 00000100:00100000:0.0:1746066796.280340:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984835072 00000100:00100000:0.0:1746066796.280342:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984835072 00010000:00010000:0.0:1746066796.280363:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 15 pid: 17253 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.280381:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8506 00000100:00100000:0.0:1746066796.280387:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882984835072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.280399:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.280404:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 15 pid: 17253 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.280415:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 15 pid: 17253 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.280437:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfadbec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53b1 expref: 15 pid: 17253 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.280453:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.280457:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.280468:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.280474:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.280491:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.280506:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882984835072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.280512:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8506 00010000:00010000:0.0:1746066796.280535:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066796.280540:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746066796.280559:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066796.280688:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eac00/0xf1867c21abfadc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53d4 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.280702:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53d4 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.280708:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.280710:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066796.280712:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bac00, rc 0) 00000100:00100000:0.0:1746066796.285364:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:2656:x1830882984834688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 45762us (45950us total) trans 8589937359 rc 0/0 00000100:00100000:0.0:1746066796.285374:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16919 00000100:00100000:0.0:1746066796.291849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.302114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.302159:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984836352 00000100:00100000:0.0:1746066796.302168:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984836352 00010000:00010000:0.0:1746066796.302203:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53d4 expref: 16 pid: 7244 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.302246:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8507 00000100:00100000:0.0:1746066796.302253:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882984836352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.302269:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.302275:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53d4 expref: 16 pid: 7244 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.302289:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfadc32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53d4 expref: 16 pid: 7244 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.302314:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.302319:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadc71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 15 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066796.302330:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadc71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066796.302338:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfadc71 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066796.302355:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.302395:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882984836352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.302401:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8507 00000100:00100000:0.0:1746066796.330210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.333258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.333289:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.333630:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066796.338607:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066796 -> 1746066797 00000100:00100000:0.0:1746066796.338635:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984851328:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.338666:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce0000/0xf1867c21abfadc86 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5405 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.338679:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0000/0xf1867c21abfadc86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5405 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.338693:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0000, rc 0) 00000100:00100000:0.0:1746066796.338732:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882984836992:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4936us (5476us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.338740:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18669 00000100:00100000:0.0:1746066796.342698:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984837376 00000100:00100000:0.0:1746066796.342706:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984837376 00010000:00010000:0.0:1746066796.342736:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfadc39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53db expref: 16 pid: 1893 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.342775:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8508 00000100:00100000:0.0:1746066796.342783:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882984837376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.342797:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.342815:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfadc39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53db expref: 16 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.342831:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfadc39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53db expref: 16 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.343146:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfadc39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53db expref: 16 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.343158:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.343318:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882984837376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 534us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.343324:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8508 00000100:00100000:0.0:1746066796.343793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.358683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.358751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.380792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.380825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.380851:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984839296 00000100:00100000:0.0:1746066796.380857:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984839296 00010000:00010000:0.0:1746066796.380920:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfad9df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d527d expref: 25 pid: 3528 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066796.380945:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984839168 00000100:00100000:0.0:1746066796.380948:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984839168 00010000:00010000:0.0:1746066796.380958:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfada17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52a0 expref: 7 pid: 11630 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066796.380972:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8512 00000100:00100000:0.0:1746066796.380977:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882984839168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.380983:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.381002:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfada17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52a0 expref: 7 pid: 11630 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.381011:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfada17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52a0 expref: 7 pid: 11630 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.381869:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfada17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d52a0 expref: 7 pid: 11630 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.381908:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.381953:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882984839168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 975us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.381960:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8512 00000100:00100000:0.0:1746066796.382917:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984839552 00000100:00100000:0.0:1746066796.382920:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984839552 00010000:00010000:0.0:1746066796.382932:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfad9d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d526f expref: 16 pid: 3528 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.382951:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8513 00000100:00100000:0.0:1746066796.382956:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882984839552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.382963:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.382976:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfad9d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d526f expref: 16 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.382985:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfad9d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d526f expref: 16 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.382998:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfad9d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d526f expref: 16 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.383008:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.383009:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.383014:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575bc00/0xf1867c21abfadca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d541a expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.383021:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575bc00/0xf1867c21abfadca9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d541a expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.383040:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575bc00/0xf1867c21abfadca9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d541a expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.383048:0:8395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575bc00/0xf1867c21abfadca9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d541a expref: 15 pid: 11630 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.383056:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c775500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984852480:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066796.383077:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.385756:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.386616:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.387536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.387573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.387589:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984840320 00000100:00100000:0.0:1746066796.387593:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984840320 00010000:00010000:0.0:1746066796.387608:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153800/0xf1867c21abfadc78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53f0 expref: 35 pid: 1893 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.387630:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984840192 00000100:00100000:0.0:1746066796.387632:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984840192 00010000:00010000:0.0:1746066796.387641:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfadc94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d540c expref: 14 pid: 11630 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.387656:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8514 00000100:00100000:0.0:1746066796.387661:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882984840320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.387670:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.387685:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0153800/0xf1867c21abfadc78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53f0 expref: 35 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387693:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0153800/0xf1867c21abfadc78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53f0 expref: 35 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387713:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153800/0xf1867c21abfadc78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d53f0 expref: 35 pid: 1893 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387723:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.387750:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882984840320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.387756:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8514 00000100:00100000:0.0:1746066796.387785:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8515 00000100:00100000:0.0:1746066796.387789:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882984840192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.387794:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.387802:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfadc94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d540c expref: 14 pid: 11630 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387810:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfadc94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d540c expref: 14 pid: 11630 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387821:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfadc94 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d540c expref: 14 pid: 11630 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.387829:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.387831:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.387836:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfadcb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5428 expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.387844:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfadcb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5428 expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.387869:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfadcb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5428 expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.387879:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984852736:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066796.387949:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.392339:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984852736:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066796.392363:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.392420:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882984840192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4629us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.392431:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8515 00000100:00100000:0.0:1746066796.394126:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.396183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.403076:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.405143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.406989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.407011:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984841728 00000100:00100000:0.0:1746066796.407017:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984841728 00010000:00010000:0.0:1746066796.407042:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfad9ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5268 expref: 14 pid: 3528 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.407065:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8518 00000100:00100000:0.0:1746066796.407072:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882984841728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.407087:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.407103:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfad9ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5268 expref: 14 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.407113:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfad9ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5268 expref: 14 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.407130:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfad9ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5268 expref: 14 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.407145:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.407173:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882984841728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.407179:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8518 00000100:00100000:0.0:1746066796.407224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.407237:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984841600 00000100:00100000:0.0:1746066796.407240:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984841600 00010000:00010000:0.0:1746066796.407251:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0000/0xf1867c21abfad9d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5276 expref: 33 pid: 3528 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066796.407282:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8519 00000100:00100000:0.0:1746066796.407286:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882984841600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.407293:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.407299:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0000/0xf1867c21abfad9d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5276 expref: 33 pid: 3528 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.407308:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0000/0xf1867c21abfad9d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5276 expref: 33 pid: 3528 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.407319:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0000/0xf1867c21abfad9d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5276 expref: 33 pid: 3528 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066796.407327:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.407329:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.407334:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.407342:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.407374:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.407391:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984853504:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066796.407495:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.410528:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984853504:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066796.410549:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.410592:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882984841600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3303us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.410602:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8519 00000100:00100000:0.0:1746066796.411360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.413237:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984842240 00000100:00100000:0.0:1746066796.413244:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984842240 00002000:00100000:0.0:1746066796.413275:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88009666d180 x1830882984842240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.413284:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d180 with x1830882984842240 ext(2097152->3145727) 00002000:00010000:0.0:1746066796.413288:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666d180 00000100:00100000:0.0:1746066796.413727:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6931 00000100:00100000:0.0:1746066796.413735:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882984842240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066796.425182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.430270:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.430850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.439039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.439106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.454669:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984843648 00000100:00100000:0.0:1746066796.454677:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984843648 00010000:00010000:0.0:1746066796.454708:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 15 pid: 13363 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066796.454753:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8520 00000100:00100000:0.0:1746066796.454760:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882984843648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.454770:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066796.454783:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066796 -> 1746066797 00002000:00010000:0.0:1746066796.454785:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066796 -> 1746066797 00010000:00010000:0.0:1746066796.454790:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 15 pid: 13363 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.454801:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 15 pid: 13363 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.454819:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944000/0xf1867c21abfadcc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3387391) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5436 expref: 15 pid: 13363 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.454836:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.454838:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.454844:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7c00/0xf1867c21abfadccc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d543d expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.454851:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7c00/0xf1867c21abfadccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d543d expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.454877:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7c00/0xf1867c21abfadccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d543d expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.454911:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c774380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984853760:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066796.455138:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984843776 00000100:00100000:0.0:1746066796.455142:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984843776 00000100:00100000:0.0:1746066796.455193:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18679 00000100:00100000:0.0:1746066796.455199:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882984843904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.455206:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.455214:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfadcd3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d544b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.455238:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984853888:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.455255:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.460676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.460717:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.467051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.478978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.479067:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.489547:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.489623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.490002:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18684 00000100:00100000:0.0:1746066796.490009:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882984845568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.490021:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.490030:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfadcfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d546e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.490058:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984854528:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.490080:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.524614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.526349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.564251:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.571693:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.581371:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.600187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.600270:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.606810:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.622264:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.630105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.631877:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.632838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.635436:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.635456:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.637350:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984848256 00000100:00100000:0.0:1746066796.637353:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984848256 00000100:00100000:0.0:1746066796.637378:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 912 00000100:00100000:0.0:1746066796.637382:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882984848256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.637388:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.637400:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895400/0xf1867c21abfadd5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5491 expref: 32 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.637413:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066796.637417:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066796.637540:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882984848256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.637545:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 912 00000100:00100000:0.0:1746066796.641560:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.641985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.642021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.642760:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.642989:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.649400:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.649429:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.649449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.649472:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.649515:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984849664 00000100:00100000:0.0:1746066796.649517:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984849664 00000100:00100000:0.0:1746066796.649532:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18691 00000100:00100000:0.0:1746066796.649539:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882984849408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.649552:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.649564:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfadd90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d54b4 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.649600:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984856192:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.650085:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.654767:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984856192:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.654792:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfadd90 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d54b4 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.654805:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfadd90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d54b4 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.654816:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47200, rc 0) 00000100:00100000:0.0:1746066796.654852:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882984849408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5312us (5458us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.654858:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18691 00000100:00100000:0.0:1746066796.655281:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.655334:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.678294:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.683806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.699484:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.701141:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.704816:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.716226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.720474:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.725692:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.727700:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882984851712:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1702us (2006us total) trans 17179874987 rc 0/0 00000100:00100000:0.0:1746066796.727710:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2009 00002000:00100000:0.0:1746066796.727718:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1097727) req@ffff880098926d80 x1830882984851712/t17179874987(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:202/0 lens 488/448 e 0 to 0 dl 1746066807 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.727727:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882984851712 ext(1048576->1097727) 00010000:00010000:0.0:1746066796.727746:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfadcb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5428 expref: 35 pid: 13363 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.727760:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfadcb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5428 expref: 35 pid: 13363 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746066796.727767:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066796.731982:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.736934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.747019:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.749518:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.749602:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.749935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.757144:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.757667:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.764273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.764322:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.775003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.780273:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.788327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.790770:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882984853632:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9921us (10504us total) trans 21474842378 rc 0/0 00000100:00100000:0.0:1746066796.790782:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2011 00002000:00100000:0.0:1746066796.790793:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2801664->3145727) req@ffff880094306a00 x1830882984853632/t21474842378(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:202/0 lens 488/448 e 0 to 0 dl 1746066807 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.790803:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830882984853632 ext(2801664->3145727) 00010000:00010000:0.0:1746066796.790811:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfadd3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5483 expref: 29 pid: 3528 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066796.790831:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfadd3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5483 expref: 29 pid: 3528 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746066796.790838:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306a00 00000100:00100000:0.0:1746066796.794968:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.803000:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.803074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.803103:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984854272 00000100:00100000:0.0:1746066796.803109:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984854272 00002000:00100000:0.0:1746066796.803149:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88011f761500 x1830882984854272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.803158:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761500 with x1830882984854272 ext(2097152->3145727) 00002000:00010000:0.0:1746066796.803163:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f761500 00000100:00100000:0.0:1746066796.803175:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984854400 00000100:00100000:0.0:1746066796.803177:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984854400 00002000:00100000:0.0:1746066796.803187:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4042751) req@ffff88011f760700 x1830882984854400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.803193:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760700 with x1830882984854400 ext(3145728->4042751) 00002000:00010000:0.0:1746066796.803196:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f760700 00000100:00100000:0.0:1746066796.803203:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6949 00000100:00100000:0.0:1746066796.803208:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882984854272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066796.804662:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6950 00000100:00100000:0.0:1746066796.804671:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882984854400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066796.809279:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.817406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.825323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.861708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.862187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.869553:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.869588:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.869623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.871849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.874696:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984858496:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.874713:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5fe00/0xf1867c21abfade00 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5532 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.874722:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5fe00/0xf1867c21abfade00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5532 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.874744:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5fe00, rc 0) 00000100:00100000:0.0:1746066796.874785:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882984855808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4971us (5196us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.874793:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18708 00000100:00100000:0.0:1746066796.876748:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882984859008:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876799:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876824:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882984859520:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876838:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876848:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984860032:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876864:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876880:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746066796.876903:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984859136:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876920:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876930:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3776:1830882984859648:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876943:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876952:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984860160:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.876965:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.876988:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984859008 00000100:00100000:0.0:1746066796.876994:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984859008 00000100:00100000:0.0:1746066796.877022:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984859520 00000100:00100000:0.0:1746066796.877024:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984859520 00000100:00100000:0.0:1746066796.877041:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984859648 00000100:00100000:0.0:1746066796.877042:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984859648 00000100:00100000:0.0:1746066796.877054:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1746066796.877059:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882984859008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877096:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882984859008:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877101:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1746066796.877113:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1746066796.877117:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3776:x1830882984859520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877136:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3776:x1830882984859520:12345-0@lo:400:kworker.0 Request processed in 19us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877140:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1746066796.877147:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1746066796.877150:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3776:x1830882984859648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877166:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3776:x1830882984859648:12345-0@lo:400:kworker.0 Request processed in 15us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877173:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1746066796.877211:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3776:1830882984859648:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877219:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882984859008:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877226:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882984859520:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877248:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984860032 00000100:00100000:0.0:1746066796.877250:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984860032 00000100:00100000:0.0:1746066796.877268:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984859136 00000100:00100000:0.0:1746066796.877269:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984859136 00000100:00100000:0.0:1746066796.877279:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984860160 00000100:00100000:0.0:1746066796.877280:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984860160 00000100:00100000:0.0:1746066796.877291:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1746066796.877294:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984860032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877319:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984860032:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877324:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1746066796.877330:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1746066796.877333:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984859136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877349:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984859136:12345-0@lo:400:kworker.0 Request processed in 16us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877353:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1746066796.877358:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1746066796.877362:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984860160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877377:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984860160:12345-0@lo:400:kworker.0 Request processed in 15us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.877382:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1746066796.877395:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984859136:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877401:0:3776:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874977 gen 2 00000004:00080000:0.0:1746066796.877406:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7ea00, transno 17179874895 00000004:00080000:0.0:1746066796.877412:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7e680, transno 17179874896 00000004:00080000:0.0:1746066796.877414:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02300, transno 17179874897 00000004:00080000:0.0:1746066796.877417:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7c700, transno 17179874898 00000004:00080000:0.0:1746066796.877419:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7dc00, transno 17179874899 00000004:00080000:0.0:1746066796.877421:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b03100, transno 17179874900 00000004:00080000:0.0:1746066796.877424:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7c000, transno 17179874901 00000004:00080000:0.0:1746066796.877426:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7ca80, transno 17179874902 00000004:00080000:0.0:1746066796.877428:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925c00, transno 17179874903 00000004:00080000:0.0:1746066796.877431:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925500, transno 17179874904 00000004:00080000:0.0:1746066796.877433:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00700, transno 17179874905 00000004:00080000:0.0:1746066796.877435:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925880, transno 17179874906 00000004:00080000:0.0:1746066796.877437:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00380, transno 17179874907 00000004:00080000:0.0:1746066796.877440:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00e00, transno 17179874908 00000004:00080000:0.0:1746066796.877442:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01f80, transno 17179874909 00000004:00080000:0.0:1746066796.877444:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01500, transno 17179874910 00000004:00080000:0.0:1746066796.877446:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098926a00, transno 17179874911 00000004:00080000:0.0:1746066796.877448:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e2d80, transno 17179874912 00000004:00080000:0.0:1746066796.877451:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306680, transno 17179874921 00000004:00080000:0.0:1746066796.877453:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e1c00, transno 17179874922 00000004:00080000:0.0:1746066796.877455:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306d80, transno 17179874923 00000004:00080000:0.0:1746066796.877457:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304700, transno 17179874924 00000004:00080000:0.0:1746066796.877459:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305f80, transno 17179874925 00000004:00080000:0.0:1746066796.877461:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e2d80, transno 17179874926 00000004:00080000:0.0:1746066796.877463:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305880, transno 17179874927 00000004:00080000:0.0:1746066796.877465:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307480, transno 17179874928 00000004:00080000:0.0:1746066796.877468:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e0000, transno 17179874929 00000004:00080000:0.0:1746066796.877471:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5f80, transno 17179874933 00000004:00080000:0.0:1746066796.877473:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7100, transno 17179874934 00000004:00080000:0.0:1746066796.877475:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54c380, transno 17179874935 00000004:00080000:0.0:1746066796.877478:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a4e00, transno 17179874936 00000004:00080000:0.0:1746066796.877479:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7b80, transno 17179874937 00000004:00080000:0.0:1746066796.877481:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a4a80, transno 17179874938 00000004:00080000:0.0:1746066796.877483:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54ea00, transno 17179874939 00000004:00080000:0.0:1746066796.877485:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5500, transno 17179874940 00000004:00080000:0.0:1746066796.877487:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54ed80, transno 17179874941 00000004:00080000:0.0:1746066796.877490:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800e00, transno 17179874942 00000004:00080000:0.0:1746066796.877492:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801f80, transno 17179874943 00000004:00080000:0.0:1746066796.877495:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5766300, transno 17179874944 00000004:00080000:0.0:1746066796.877496:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801500, transno 17179874945 00000004:00080000:0.0:1746066796.877499:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803800, transno 17179874946 00000004:00080000:0.0:1746066796.877501:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d802a00, transno 17179874947 00000004:00080000:0.0:1746066796.877503:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095801880, transno 17179874948 00000004:00080000:0.0:1746066796.877505:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803100, transno 17179874949 00000004:00080000:0.0:1746066796.877507:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89c00, transno 17179874950 00000004:00080000:0.0:1746066796.877509:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095876300, transno 17179874960 00000004:00080000:0.0:1746066796.877511:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095876d80, transno 17179874961 00000004:00080000:0.0:1746066796.877513:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095874380, transno 17179874962 00000004:00080000:0.0:1746066796.877515:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd880, transno 17179874963 00000004:00080000:0.0:1746066796.877517:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095875f80, transno 17179874964 00000004:00080000:0.0:1746066796.877519:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095876a00, transno 17179874965 00000004:00080000:0.0:1746066796.877522:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd180, transno 17179874966 00000004:00080000:0.0:1746066796.877524:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093675c00, transno 17179874967 00000004:00080000:0.0:1746066796.877526:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095874000, transno 17179874968 00000004:00080000:0.0:1746066796.877529:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422300, transno 17179874969 00000004:00080000:0.0:1746066796.877531:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421500, transno 17179874970 00000004:00080000:0.0:1746066796.877533:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420000, transno 17179874971 00000004:00080000:0.0:1746066796.877536:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421c00, transno 17179874972 00000004:00080000:0.0:1746066796.877538:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093675180, transno 17179874973 00000004:00080000:0.0:1746066796.877539:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420700, transno 17179874974 00000004:00080000:0.0:1746066796.877541:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422a00, transno 17179874975 00000004:00080000:0.0:1746066796.877543:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421f80, transno 17179874976 00000004:00080000:0.0:1746066796.877545:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096eca300, transno 17179874977 00000100:00100000:0.0:1746066796.877548:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984860160:0@lo:400:kworker.0 00000100:00100000:0.0:1746066796.877555:0:3776:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842365 gen 2 00000004:00080000:0.0:1746066796.877557:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36300, transno 21474842292 00000004:00080000:0.0:1746066796.877563:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35c00, transno 21474842293 00000004:00080000:0.0:1746066796.877565:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34700, transno 21474842294 00000004:00080000:0.0:1746066796.877566:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35500, transno 21474842295 00000004:00080000:0.0:1746066796.877568:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37800, transno 21474842296 00000004:00080000:0.0:1746066796.877570:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35f80, transno 21474842297 00000004:00080000:0.0:1746066796.877572:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36a00, transno 21474842298 00000004:00080000:0.0:1746066796.877575:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34a80, transno 21474842299 00000004:00080000:0.0:1746066796.877576:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ca80, transno 21474842300 00000004:00080000:0.0:1746066796.877578:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ed80, transno 21474842301 00000004:00080000:0.0:1746066796.877580:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666e300, transno 21474842302 00000004:00080000:0.0:1746066796.877582:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666df80, transno 21474842303 00000004:00080000:0.0:1746066796.877584:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713100, transno 21474842304 00000004:00080000:0.0:1746066796.877586:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f712d80, transno 21474842305 00000004:00080000:0.0:1746066796.877588:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666c380, transno 21474842306 00000004:00080000:0.0:1746066796.877590:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666fb80, transno 21474842307 00000004:00080000:0.0:1746066796.877592:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887480, transno 21474842315 00000004:00080000:0.0:1746066796.877594:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887b80, transno 21474842316 00000004:00080000:0.0:1746066796.877595:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5886d80, transno 21474842317 00000004:00080000:0.0:1746066796.877598:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885180, transno 21474842318 00000004:00080000:0.0:1746066796.877600:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885500, transno 21474842319 00000004:00080000:0.0:1746066796.877602:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884a80, transno 21474842320 00000004:00080000:0.0:1746066796.877605:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884000, transno 21474842321 00000004:00080000:0.0:1746066796.877607:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887800, transno 21474842322 00000004:00080000:0.0:1746066796.877609:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedf80, transno 21474842326 00000004:00080000:0.0:1746066796.877611:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cefb80, transno 21474842327 00000004:00080000:0.0:1746066796.877613:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedc00, transno 21474842328 00000004:00080000:0.0:1746066796.877615:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cec700, transno 21474842329 00000004:00080000:0.0:1746066796.877617:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cee300, transno 21474842330 00000004:00080000:0.0:1746066796.877619:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cef100, transno 21474842331 00000004:00080000:0.0:1746066796.877621:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095ceed80, transno 21474842332 00000004:00080000:0.0:1746066796.877623:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095ced180, transno 21474842333 00000004:00080000:0.0:1746066796.877625:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4f480, transno 21474842334 00000004:00080000:0.0:1746066796.877627:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4df80, transno 21474842335 00000004:00080000:0.0:1746066796.877629:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887100, transno 21474842336 00000004:00080000:0.0:1746066796.877630:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885880, transno 21474842337 00000004:00080000:0.0:1746066796.877632:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5886a00, transno 21474842338 00000004:00080000:0.0:1746066796.877634:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b559880, transno 21474842339 00000004:00080000:0.0:1746066796.877636:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4ea00, transno 21474842340 00000004:00080000:0.0:1746066796.877638:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711f80, transno 21474842341 00000004:00080000:0.0:1746066796.877640:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093676d80, transno 21474842350 00000004:00080000:0.0:1746066796.877642:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093677800, transno 21474842351 00000004:00080000:0.0:1746066796.877644:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093676a00, transno 21474842352 00000004:00080000:0.0:1746066796.877646:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093677100, transno 21474842353 00000004:00080000:0.0:1746066796.877648:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093676680, transno 21474842354 00000004:00080000:0.0:1746066796.877649:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093677480, transno 21474842355 00000004:00080000:0.0:1746066796.877651:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093675500, transno 21474842356 00000004:00080000:0.0:1746066796.877653:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093677b80, transno 21474842357 00000004:00080000:0.0:1746066796.877655:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855500, transno 21474842358 00000004:00080000:0.0:1746066796.877658:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad180, transno 21474842359 00000004:00080000:0.0:1746066796.877660:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958afb80, transno 21474842360 00000004:00080000:0.0:1746066796.877663:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d856300, transno 21474842361 00000004:00080000:0.0:1746066796.877665:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88380, transno 21474842362 00000004:00080000:0.0:1746066796.877667:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c490000, transno 21474842363 00000004:00080000:0.0:1746066796.877670:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095de3b80, transno 21474842364 00000004:00080000:0.0:1746066796.877672:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad880, transno 21474842365 00000100:00100000:0.0:1746066796.877675:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984860032:0@lo:400:kworker.0 00000004:00080000:0.0:1746066796.878029:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:0.0:1746066796.891006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.891059:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.894061:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984860544:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.894083:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfade15 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5540 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.894097:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfade15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5540 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.894123:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07600, rc 0) 00000100:00100000:0.0:1746066796.895313:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.895612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.898162:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18713 00000100:00100000:0.0:1746066796.898168:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882984857088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066796.898175:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.898185:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfade23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d554e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.898207:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984861184:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066796.898233:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.904627:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984861184:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066796.904666:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfade23 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d554e expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.904681:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfade23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d554e expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.904694:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9e00, rc 0) 00000100:00100000:0.0:1746066796.904762:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882984857088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6593us (6912us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066796.904770:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18713 00000100:00100000:0.0:1746066796.922455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.924548:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984861440 00000100:00100000:0.0:1746066796.924555:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984861440 00000100:00100000:0.0:1746066796.925298:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1746066796.925307:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984861440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066796.925340:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 176128 granted 1263398208 pending 1638400 free 3906400256 avail 3674877952 00000100:00100000:0.0:1746066796.925390:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984861440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.925396:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1746066796.940431:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.958653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.964537:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.977629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.982385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.990763:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.991982:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066796.997452:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.015533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.020431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.020482:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066797.021436:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066797.023788:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.036332:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.039168:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.040825:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066797.041095:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066797.045044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.045085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.045131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.047486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.057144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.057185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.057221:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.057264:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.068653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.068688:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.068780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.071862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.083980:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.084019:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.084049:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.097242:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.111203:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984863360 00000100:00100000:0.0:1746066797.111212:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984863360 00000100:00100000:0.0:1746066797.111258:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18732 00000100:00100000:0.0:1746066797.111264:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882984863360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066797.111281:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.111298:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfadeee lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d55e1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.111342:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984863872:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.112962:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.129742:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.140063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.149483:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.171156:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.175337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.176415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.183755:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.183802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.189652:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.192025:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.200341:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.203282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.204984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.212191:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.215736:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.225185:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.228839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066797.229653:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066797.231633:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.235734:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.236200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.236264:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.236283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.236298:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984867072 00000100:00100000:0.0:1746066797.236301:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984867072 00000100:00100000:0.0:1746066797.236319:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984867200 00000100:00100000:0.0:1746066797.236320:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984867200 00000100:00100000:0.0:1746066797.236329:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984867328 00000100:00100000:0.0:1746066797.236330:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984867328 00000100:00100000:0.0:1746066797.236340:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18737 00000100:00100000:0.0:1746066797.236346:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882984867072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.236353:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.236364:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeae00/0xf1867c21abfadf2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d560b expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.236392:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984865280:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.236417:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.236432:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18738 00000100:00100000:0.0:1746066797.236438:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882984867200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.236444:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.236451:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfadf34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5612 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.236462:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.236464:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.236674:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfadf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5612 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.236687:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfadf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5612 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.236694:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbebc00, rc 0) 00000100:00100000:0.0:1746066797.236710:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882984867200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 273us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.236715:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18738 00000100:00100000:0.0:1746066797.244369:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984867712 00000100:00100000:0.0:1746066797.244378:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984867712 00010000:00010000:0.0:1746066797.244418:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfadf1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d55fd expref: 17 pid: 10125 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066797.244462:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8541 00000100:00100000:0.0:1746066797.244470:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+17:2013:x1830882984867712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.244483:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.244489:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfadf1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d55fd expref: 17 pid: 10125 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.244499:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfadf1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d55fd expref: 17 pid: 10125 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.244706:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfadf1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d55fd expref: 17 pid: 10125 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.244742:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066797.244748:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e200/0xf1867c21abfadf49 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.244759:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e200/0xf1867c21abfadf49 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.244766:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e200/0xf1867c21abfadf49 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.244795:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.244838:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+16:2013:x1830882984867712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 367us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.244845:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8541 00000100:00100000:0.0:1746066797.248803:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.252342:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.255948:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.256083:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868096 00000100:00100000:0.0:1746066797.256093:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868096 00000100:00100000:0.0:1746066797.256134:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868224 00000100:00100000:0.0:1746066797.256136:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868224 00000100:00100000:0.0:1746066797.256151:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18740 00000100:00100000:0.0:1746066797.256158:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882984868096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.256177:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.256194:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfadf65 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d562e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.256244:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984865664:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.256320:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.268186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.268226:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.268253:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.268284:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.268311:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868736 00000100:00100000:0.0:1746066797.268319:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868736 00000100:00100000:0.0:1746066797.268410:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868608 00000100:00100000:0.0:1746066797.268412:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868608 00000100:00100000:0.0:1746066797.268429:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18743 00000100:00100000:0.0:1746066797.268434:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882984868736:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066797.268464:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfadf8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.268481:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfadaf7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5325 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.268489:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfadb44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5356 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.268496:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfadb0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d533a expref: 29 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.268502:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.268503:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.268505:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfadf8f lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.268526:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfadb0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d533a expref: 29 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.268898:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfadb0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d533a expref: 29 pid: 13363 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746066797.268911:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984865920:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066797.268957:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfadb44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5356 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.268965:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfadb44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5356 expref: 8 pid: 9590 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746066797.268973:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984866432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066797.268996:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfadaf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5325 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.269004:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfadaf7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5325 expref: 20 pid: 3528 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066797.269011:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984866688:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066797.269026:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.276468:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.276504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.276517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.276532:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.276545:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.276837:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984869632 00000100:00100000:0.0:1746066797.276843:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984869632 00010000:00010000:0.0:1746066797.277003:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfadb44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5356 expref: 11 pid: 9590 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746066797.277442:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984866944:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066797.278269:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.278702:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8550 00000100:00100000:0.0:1746066797.278708:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882984870656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.278715:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.278737:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfade38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5563 expref: 40 pid: 11630 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.278747:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfade38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5563 expref: 40 pid: 11630 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.278760:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfade38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5563 expref: 40 pid: 11630 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066797.278772:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.278904:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882984870656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 196us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.279103:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8550 00000100:00100000:0.0:1746066797.279114:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984870912 00000100:00100000:0.0:1746066797.279116:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984870912 00010000:00010000:0.0:1746066797.279126:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfad6f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d508c expref: 21 pid: 13726 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746066797.279148:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8552 00000100:00100000:0.0:1746066797.279152:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882984870912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.279157:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.279163:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfad6f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d508c expref: 21 pid: 13726 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066797.279170:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfad6f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d508c expref: 21 pid: 13726 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066797.279181:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfad6f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d508c expref: 21 pid: 13726 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066797.279190:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.279191:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.279194:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b32400/0xf1867c21abfadf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.279201:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32400/0xf1867c21abfadf9d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.279213:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.279230:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882984870912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.279236:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8552 00010000:00010000:0.0:1746066797.280435:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280448:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280461:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280467:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280473:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280479:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009326d200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066797.280481:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280487:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280495:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.280501:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfadf96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.280548:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882984869248:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11899us (12294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.280555:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18744 00000100:00100000:0.0:1746066797.290174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.294567:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.297189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.298708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.300370:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882984872320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 903us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.300377:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8561 00000100:00100000:0.0:1746066797.303634:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868992 00000100:00100000:0.0:1746066797.303641:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868992 00000100:00100000:0.0:1746066797.303675:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984869504 00000100:00100000:0.0:1746066797.303677:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984869504 00000100:00100000:0.0:1746066797.303688:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984870016 00000100:00100000:0.0:1746066797.303690:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984870016 00000100:00100000:0.0:1746066797.303701:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984870528 00000100:00100000:0.0:1746066797.303702:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984870528 00000100:00100000:0.0:1746066797.303711:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984868864 00000100:00100000:0.0:1746066797.303713:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984868864 00000100:00100000:0.0:1746066797.303722:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984869376 00000100:00100000:0.0:1746066797.303734:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984869376 00000100:00100000:0.0:1746066797.303746:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18748 00000100:00100000:0.0:1746066797.303752:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3777:x1830882984868992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.303905:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984868992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (359us total) trans 17179874992 rc 0/0 00000100:00100000:0.0:1746066797.303911:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18748 00000100:00100000:0.0:1746066797.303918:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18752 00000100:00100000:0.0:1746066797.303921:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984868864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.303972:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882984868864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (275us total) trans 21474842384 rc 0/0 00000100:00100000:0.0:1746066797.303977:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18752 00000100:00100000:0.0:1746066797.303987:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18753 00000100:00100000:0.0:1746066797.303991:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984869376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.304040:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984869376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (322us total) trans 17179874993 rc 0/0 00000100:00100000:0.0:1746066797.304045:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18753 00000100:00100000:0.0:1746066797.304053:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18754 00000100:00100000:0.0:1746066797.304057:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984869888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.304343:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882984869888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (588us total) trans 17179874994 rc 0/0 00000100:00100000:0.0:1746066797.304349:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18754 00000100:00100000:0.0:1746066797.305109:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066797.305116:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984870784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.305135:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066797.305364:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e435f80/2, rc 0, transno 17179875000 00000100:00100000:0.0:1746066797.305612:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984870784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.305744:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677c700/2, rc 0, transno 17179874998 00000100:00100000:0.0:1746066797.305747:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984869120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.306570:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.308805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312269:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312284:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312325:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.312348:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317775:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317816:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317837:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317866:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.317910:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984874112 00000100:00100000:0.0:1746066797.317913:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984874112 00000100:00100000:0.0:1746066797.323139:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.323172:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.323193:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.323213:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.323233:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984874496 00000100:00100000:0.0:1746066797.323242:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984874496 00000100:00100000:0.0:1746066797.323273:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984874752 00000100:00100000:0.0:1746066797.323275:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984874752 00000100:00100000:0.0:1746066797.323648:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984875008 00000100:00100000:0.0:1746066797.323652:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984875008 00000100:00100000:0.0:1746066797.323674:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18777 00000100:00100000:0.0:1746066797.323682:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984874496:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066797.323825:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984874496:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 142us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.323831:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18777 00000100:00100000:0.0:1746066797.323862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.323944:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.328152:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.336006:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6969 00000100:00100000:0.0:1746066797.336014:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984875904:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066797.336074:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfae006 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.336081:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.336082:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.336085:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfae006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.336092:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfae006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.341771:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6973 00000100:00100000:0.0:1746066797.341780:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882984876928:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066797.341800:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfae022 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.341808:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.341809:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.341812:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfae022 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.341821:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfae022 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.342493:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6974 00000100:00100000:0.0:1746066797.342500:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882984877184:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066797.342517:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ae00/0xf1867c21abfae029 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.342525:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.342526:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.342529:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ae00/0xf1867c21abfae029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.342536:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575ae00/0xf1867c21abfae029 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.384237:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388412:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388610:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388812:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388853:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.388878:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18783 00000100:00100000:0.0:1746066797.389173:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984877696:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066797.389235:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066797.389238:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066796 -> 1746066798 00002000:00010000:0.0:1746066797.389240:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066796 -> 1746066798 00002000:00010000:0.0:1746066797.389242:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066796 -> 1746066798 00002000:00010000:0.0:1746066797.389244:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066797.389533:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882984877696:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 468us (1164us total) trans 21474842390 rc 0/0 00000100:00100000:0.0:1746066797.389538:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18783 00000100:00100000:0.0:1746066797.389557:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18787 00000100:00100000:0.0:1746066797.389562:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984877824:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066797.389610:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066797.389612:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.389614:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066797 -> 1746066798 00002000:00010000:0.0:1746066797.389615:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.389617:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066797.390276:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882984877824:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 713us (1421us total) trans 21474842391 rc 0/0 00000100:00100000:0.0:1746066797.390282:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18787 00000100:00100000:0.0:1746066797.392481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.395932:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066797.399735:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399747:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399754:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399759:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe2800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066797.399763:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399770:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399788:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066797.399791:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.399795:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.399803:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfae030 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066797.401637:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984871296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.401677:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984871424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.401698:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.402436:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984871936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.402451:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.402466:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.402478:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.402487:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.402497:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.402506:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066797.402509:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.402519:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.402526:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.402537:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746066797.402558:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402567:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402573:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402578:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066797.402583:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402589:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402603:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066797.402605:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066797.402608:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00010000:00010000:0.0:1746066797.402613:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfae037 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746066797.402632:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984871040 00000100:00100000:0.0:1746066797.402639:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984871040 00000100:00100000:0.0:1746066797.402666:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984871552 00000100:00100000:0.0:1746066797.402668:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984871552 00000100:00100000:0.0:1746066797.402676:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984871168 00000100:00100000:0.0:1746066797.402678:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984871168 00000100:00100000:0.0:1746066797.402685:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984871424 00000100:00100000:0.0:1746066797.402687:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984871424 00000100:00100000:0.0:1746066797.402691:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984871936 00000100:00100000:0.0:1746066797.402692:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984871936 00000100:00100000:0.0:1746066797.402697:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984872448 00000100:00100000:0.0:1746066797.402698:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984872448 00000100:00100000:0.0:1746066797.402703:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984872960 00000100:00100000:0.0:1746066797.402704:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984872960 00000100:00100000:0.0:1746066797.402708:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984872320 00000100:00100000:0.0:1746066797.402709:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984872320 00000100:00100000:0.0:1746066797.402713:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984872832 00000100:00100000:0.0:1746066797.402714:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984872832 00000100:00100000:0.0:1746066797.402721:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18789 00000100:00100000:0.0:1746066797.402737:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984871040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.402869:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066797.402872:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.402874:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.402876:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.402877:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066797.403015:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882984871040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 279us (2479us total) trans 17179875004 rc 0/0 00000100:00100000:0.0:1746066797.403020:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18789 00000100:00100000:0.0:1746066797.403032:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18790 00000100:00100000:0.0:1746066797.403035:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984871552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.403072:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066797.403074:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.403076:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066797.403077:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.403079:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066797.403092:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882984871552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (2507us total) trans 17179875005 rc 0/0 00000100:00100000:0.0:1746066797.403096:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18790 00000100:00100000:0.0:1746066797.403102:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18791 00000100:00100000:0.0:1746066797.403106:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984871168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.403134:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066797.403136:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403138:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403139:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403141:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066797.403154:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882984871168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (2534us total) trans 17179875006 rc 0/0 00000100:00100000:0.0:1746066797.403158:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18791 00000100:00100000:0.0:1746066797.403165:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18792 00000100:00100000:0.0:1746066797.403169:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984871424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.403206:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984871424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (1509us total) trans 17179875007 rc 0/0 00000100:00100000:0.0:1746066797.403210:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18792 00000100:00100000:0.0:1746066797.403216:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18793 00000100:00100000:0.0:1746066797.403220:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984871936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.403245:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:0.0:1746066797.403247:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.403248:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066797.403250:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.403252:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066797.403264:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984871936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (812us total) trans 17179875008 rc 0/0 00000100:00100000:0.0:1746066797.403267:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18793 00000100:00100000:0.0:1746066797.403273:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18794 00000100:00100000:0.0:1746066797.403277:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984872448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.403330:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984872448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (851us total) trans 21474842393 rc 0/0 00000100:00100000:0.0:1746066797.403334:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18794 00000100:00100000:0.0:1746066797.403340:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18795 00000100:00100000:0.0:1746066797.403343:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984872960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.403381:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984872960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (882us total) trans 21474842394 rc 0/0 00000100:00100000:0.0:1746066797.403385:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18795 00000100:00100000:0.0:1746066797.403391:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18796 00000100:00100000:0.0:1746066797.403394:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984872320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066797.403421:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066797.403423:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403425:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403426:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.403428:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066797.403441:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984872320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (920us total) trans 21474842395 rc 0/0 00000100:00100000:0.0:1746066797.403444:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18796 00000100:00100000:0.0:1746066797.403451:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18797 00000100:00100000:0.0:1746066797.403454:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984872832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.403494:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984872832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (955us total) trans 21474842396 rc 0/0 00000100:00100000:0.0:1746066797.403498:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18797 00000004:00080000:0.0:1746066797.403526:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81180/2, rc 0, transno 21474842395 00000100:00100000:0.0:1746066797.403531:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.403537:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711880/2, rc 0, transno 21474842396 00000100:00100000:0.0:1746066797.403539:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.403543:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713100/2, rc 0, transno 21474842393 00000100:00100000:0.0:1746066797.403545:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.403550:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710000/2, rc 0, transno 21474842394 00000100:00100000:0.0:1746066797.403552:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984872960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.403560:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009666d500/2, rc 0, transno 17179875007 00000100:00100000:0.0:1746066797.403566:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984871424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.403570:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009666ed80/2, rc 0, transno 17179875008 00000100:00100000:0.0:1746066797.403572:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984871936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.412523:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.441541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.442925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.448004:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.454518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.464216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.464255:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.468921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.469343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.469708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.476163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.477366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.484002:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.489266:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.489357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.500967:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.505029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.505092:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.541084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.541465:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984882816 00000100:00100000:0.0:1746066797.541469:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984882816 00000100:00100000:0.0:1746066797.541489:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16944 00000100:00100000:0.0:1746066797.541494:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2707:x1830882984882816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066797.541501:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.541511:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf000/0xf1867c21abfae0df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d56d6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.541953:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfae0ed lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066797.541961:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf000/0xf1867c21abfae0df lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56d6 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.544085:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984873984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.544249:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.544271:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984874496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.544288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.544639:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984875136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.544744:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984875008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.544760:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.544774:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984875520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.544952:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066797.544973:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711180/2, rc 0, transno 21474842407 00000100:00100000:0.0:1746066797.544977:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984873984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.544982:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd4380/2, rc 0, transno 21474842408 00000100:00100000:0.0:1746066797.544985:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984874496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.544997:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984874752 00000100:00100000:0.0:1746066797.545000:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984874752 00000100:00100000:0.0:1746066797.545014:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984875520 00000100:00100000:0.0:1746066797.545016:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984875520 00000100:00100000:0.0:1746066797.545025:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18820 00000100:00100000:0.0:1746066797.545029:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984875008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.545073:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066797.545076:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.545078:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.545079:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066797.545081:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066797.545100:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984875008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (339us total) trans 17179875014 rc 0/0 00000100:00100000:0.0:1746066797.545105:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18820 00000100:00100000:0.0:1746066797.545441:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18822 00000100:00100000:0.0:1746066797.545447:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984875520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.545498:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984875520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (545us total) trans 17179875016 rc 0/0 00000100:00100000:0.0:1746066797.545504:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18822 00000100:00100000:0.0:1746066797.545514:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18824 00000100:00100000:0.0:1746066797.545518:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3777:x1830882984875264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066797.545554:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066797.545556:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.545558:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066797.545560:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066797.545561:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066797.545582:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984875264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (223us total) trans 17179875017 rc 0/0 00000100:00100000:0.0:1746066797.545586:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18824 00000100:00100000:0.0:1746066797.545622:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.545635:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984875648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.545662:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984875776 00000100:00100000:0.0:1746066797.545665:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984875776 00000100:00100000:0.0:1746066797.545679:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18826 00000100:00100000:0.0:1746066797.545683:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984875776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.545743:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984875776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (100us total) trans 17179875020 rc 0/0 00000100:00100000:0.0:1746066797.545748:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18826 00000100:00100000:0.0:1746066797.545760:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066797.545784:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5885880/2, rc 0, transno 17179875019 00000100:00100000:0.0:1746066797.545788:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984875136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.545804:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5887100/2, rc 0, transno 17179875014 00000100:00100000:0.0:1746066797.545806:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984875008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.545811:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5884380/2, rc 0, transno 17179875016 00000100:00100000:0.0:1746066797.545813:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984875520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.545858:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5885c00/2, rc 0, transno 17179875021 00000100:00100000:0.0:1746066797.545861:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984875648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.547253:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.548604:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.549679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.556089:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984876288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.557164:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984876160 00000100:00100000:0.0:1746066797.557166:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984876160 00000100:00100000:0.0:1746066797.557193:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984877184 00000100:00100000:0.0:1746066797.557195:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984877184 00000100:00100000:0.0:1746066797.557205:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984877696 00000100:00100000:0.0:1746066797.557207:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984877696 00000100:00100000:0.0:1746066797.557216:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18838 00000100:00100000:0.0:1746066797.557219:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882984876672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.557252:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18839 00000100:00100000:0.0:1746066797.557256:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984877184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.557298:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3775:x1830882984877184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (139us total) trans 17179875026 rc 0/0 00000100:00100000:0.0:1746066797.557303:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18839 00000100:00100000:0.0:1746066797.557332:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882984876672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (195us total) trans 21474842413 rc 0/0 00000100:00100000:0.0:1746066797.557337:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18838 00000100:00100000:0.0:1746066797.557373:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.557394:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984876800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.557408:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.557421:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984877312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066797.557432:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.557440:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984877824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.557451:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066797.557582:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0380/2, rc 0, transno 21474842415 00000100:00100000:0.0:1746066797.557585:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984876288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.557591:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01500/2, rc 0, transno 17179875028 00000100:00100000:0.0:1746066797.557594:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984876800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066797.557645:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491880/2, rc 0, transno 21474842416 00000100:00100000:0.0:1746066797.557648:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984877312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066797.557655:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b03800/2, rc 0, transno 17179875029 00000100:00100000:0.0:1746066797.557657:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984877824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066797.560163:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984883456 00000100:00100000:0.0:1746066797.560168:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984883456 00000100:00100000:0.0:1746066797.560192:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984883584 00000100:00100000:0.0:1746066797.560194:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984883584 00000100:00100000:0.0:1746066797.560208:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6319 00000100:00100000:0.0:1746066797.560214:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2707:x1830882984883456:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066797.560267:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2707:x1830882984883456:12345-192.168.204.16@tcp:49:cat.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.560272:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6319 00000100:00100000:0.0:1746066797.561271:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.566430:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.566546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.568956:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.569479:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984884608 00000100:00100000:0.0:1746066797.569482:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984884608 00002000:00100000:0.0:1746066797.569507:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880098f54380 x1830882984884608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.569517:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54380 with x1830882984884608 ext(1048576->2097151) 00002000:00010000:0.0:1746066797.569521:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f54380 00000100:00100000:0.0:1746066797.569542:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6980 00000100:00100000:0.0:1746066797.569548:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882984884608:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066797.573848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.573912:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.579619:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.581847:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.582097:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.582932:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.586797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.586916:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.587079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.587712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.587790:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.587824:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.587837:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984886784 00000100:00100000:0.0:1746066797.587840:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984886784 00002000:00100000:0.0:1746066797.587856:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880093c4ea00 x1830882984886784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.587862:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ea00 with x1830882984886784 ext(1048576->2097151) 00002000:00010000:0.0:1746066797.587865:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4ea00 00000100:00100000:0.0:1746066797.587875:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6984 00000100:00100000:0.0:1746066797.587880:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882984886784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066797.591008:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.607613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.607976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.608337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.608783:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.608809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.608833:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.608859:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.612201:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.612596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.612641:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.620001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.621326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.621813:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.624923:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.674234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.674275:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.682651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.685971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.693583:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.694094:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984890752 00000100:00100000:0.0:1746066797.694100:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984890752 00000100:00100000:0.0:1746066797.694136:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984890624 00000100:00100000:0.0:1746066797.694138:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984890624 00000100:00100000:0.0:1746066797.694154:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18860 00000100:00100000:0.0:1746066797.694162:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882984890752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066797.694176:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.694190:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfae16b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d575b expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.694237:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984880640:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.694314:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.701963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.701992:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.702154:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18863 00000100:00100000:0.0:1746066797.702160:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882984891264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066797.702166:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.702174:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfae180 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5769 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.702193:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984881024:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.702344:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.703490:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.710245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.816198:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.821578:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.829011:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.837556:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984892544 00000100:00100000:0.0:1746066797.837564:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984892544 00010000:00010000:0.0:1746066797.837594:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfae0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56ac expref: 31 pid: 9592 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066797.837618:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8579 00000100:00100000:0.0:1746066797.837624:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882984892544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.837638:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.837657:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfae0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56ac expref: 31 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066797.837668:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfae0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56ac expref: 31 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066797.837695:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfae0b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56ac expref: 31 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066797.837710:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.837753:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882984892544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.837759:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8579 00000100:00100000:0.0:1746066797.858755:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.858793:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.859636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.867813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.870191:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.873526:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.877552:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.883139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.888561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.910866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.913698:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.915409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.916584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.923528:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.923571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.931096:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.934213:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.935200:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.935221:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984896640 00000100:00100000:0.0:1746066797.935228:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984896640 00002000:00100000:0.0:1746066797.935273:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095801880 x1830882984896640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.935283:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801880 with x1830882984896640 ext(1048576->2097151) 00002000:00010000:0.0:1746066797.935288:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801880 00000100:00100000:0.0:1746066797.935316:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6997 00000100:00100000:0.0:1746066797.935323:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882984896640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066797.935905:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.939372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.949662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.949763:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.957558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.957586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.957612:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.957633:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984897792 00000100:00100000:0.0:1746066797.957640:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984897792 00000100:00100000:0.0:1746066797.957698:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984898048 00000100:00100000:0.0:1746066797.957700:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984898048 00000100:00100000:0.0:1746066797.957954:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984898176 00000100:00100000:0.0:1746066797.957958:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984898176 00000100:00100000:0.0:1746066797.957977:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18875 00000100:00100000:0.0:1746066797.957982:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882984898176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066797.957988:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.957996:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfae260 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d57d9 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.958020:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984883200:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066797.958064:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.961659:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984883200:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066797.961676:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfae260 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57d9 expref: 21 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.961685:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfae260 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57d9 expref: 21 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.961731:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1600, rc 0) 00000100:00100000:0.0:1746066797.961756:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882984898176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3773us (3843us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.961762:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18875 00000100:00100000:0.0:1746066797.965974:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.970955:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.979737:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.985618:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.988297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.991685:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066797.991958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.024841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066798.025527:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066798.035179:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.045368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066798.045730:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066798.049683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.049774:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.049820:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8586 00000100:00100000:0.0:1746066798.049829:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882984900224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.049839:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.049856:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfae110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56f9 expref: 33 pid: 11630 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.049865:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfae110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56f9 expref: 33 pid: 11630 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.049880:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfae110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56f9 expref: 33 pid: 11630 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.049914:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.049915:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.049920:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfae291 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57ee expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.050655:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfae291 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57ee expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.050680:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfae291 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57ee expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.050691:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009437b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984883840:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066798.050750:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.053308:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009437b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984883840:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066798.053324:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.054607:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.054635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.054656:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.054986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066798.055001:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066798.055004:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066798.055029:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18880 00000100:00100000:0.0:1746066798.055035:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984900736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066798.055042:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.055050:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfae2c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d580a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.055065:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.055067:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.055072:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfae2c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d580a expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.055083:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfae2c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d580a expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.055090:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1600, rc 0) 00000100:00100000:0.0:1746066798.055123:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882984900736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.055129:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18880 00000100:00100000:0.0:1746066798.056948:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.068063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.073639:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.076224:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066798.078025:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066798.081230:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.091230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.095774:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.101417:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.101471:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.107055:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.107092:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.107125:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.114741:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.114782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.114827:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.115171:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7005 00000100:00100000:0.0:1746066798.115177:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882984904064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066798.124419:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984884480 00000100:00100000:0.0:1746066798.124428:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984884480 00000100:00100000:0.0:1746066798.124487:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1746066798.124496:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882984884480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746066798.124522:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1194404288 pending 8400896 free 3909910528 avail 3678388224 00000100:00100000:0.0:1746066798.124574:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882984884480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.124581:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1746066798.133136:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.136173:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.136199:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.136224:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.136574:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8591 00000100:00100000:0.0:1746066798.136585:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882984904576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.136593:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.136605:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfae2bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5803 expref: 11 pid: 12233 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066798.136613:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfae2bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5803 expref: 11 pid: 12233 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066798.136624:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943ea000/0xf1867c21abfae2bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5803 expref: 11 pid: 12233 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066798.136637:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.136672:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882984904576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.136678:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8591 00000100:00100000:0.0:1746066798.138045:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.140056:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.148788:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.148847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.156610:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.156627:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.156664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.157060:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8595 00000100:00100000:0.0:1746066798.157068:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882984906240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.157075:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.157085:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfae291 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57ee expref: 28 pid: 20361 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.157096:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfae291 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d57ee expref: 28 pid: 20361 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.157108:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.157110:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.157117:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfae340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5857 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.157126:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfae340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5857 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.157155:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfae340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5857 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.157166:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984885632:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066798.157231:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.159986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.160762:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.162067:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984906880 00000100:00100000:0.0:1746066798.162072:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984906880 00000100:00100000:0.0:1746066798.162108:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6330 00000100:00100000:0.0:1746066798.162115:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2728:x1830882984906880:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066798.163287:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2728:x1830882984906880:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1169us (1249us total) trans 8589937402 rc 0/0 00000100:00100000:0.0:1746066798.163294:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6330 00000100:00100000:0.0:1746066798.164016:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.169936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.181912:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.184578:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.185082:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.187976:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.188036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.192047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.193788:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.282518:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.286527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.289071:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.294285:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.296502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.301195:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.306320:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.335246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.337925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.341657:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984910848 00000100:00100000:0.0:1746066798.341667:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984910848 00000100:00100000:0.0:1746066798.342150:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6332 00000100:00100000:0.0:1746066798.342157:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2750:x1830882984910848:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066798.342332:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2750:x1830882984910848:12345-192.168.204.16@tcp:35:cat.0 Request processed in 175us (731us total) trans 8589937406 rc 0/0 00000100:00100000:0.0:1746066798.342491:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6332 00000100:00100000:0.0:1746066798.344431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.344475:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.345401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.349555:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.352409:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.354357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.363696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.363761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.364153:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7015 00000100:00100000:0.0:1746066798.364168:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882984912256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066798.418544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.422660:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8603 00000100:00100000:0.0:1746066798.422668:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882984913152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.422676:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.422684:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfae3be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d588f expref: 36 pid: 20361 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.422694:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfae3be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d588f expref: 36 pid: 20361 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.422717:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfae3be lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d588f expref: 36 pid: 20361 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.422729:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.422731:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.422737:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095751000/0xf1867c21abfae3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ab expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.422745:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095751000/0xf1867c21abfae3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ab expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.422774:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095751000/0xf1867c21abfae3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ab expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.422785:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984887552:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066798.422826:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.424929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.429522:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984887680:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066798.429535:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984887808:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066798.429544:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984887936:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066798.429571:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [917504->995327] (req 917504->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.429585:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778000, rc 0) 00000100:00100000:0.0:1746066798.429632:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2754:x1830882984913536:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3093us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.429639:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18898 00000100:00100000:0.0:1746066798.431776:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.434997:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984914304 00000100:00100000:0.0:1746066798.435004:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984914304 00002000:00100000:0.0:1746066798.435038:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (917504->921599) req@ffff880098925880 x1830882984914304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.435047:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925880 with x1830882984914304 ext(917504->921599) 00002000:00010000:0.0:1746066798.435051:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098925880 00000100:00100000:0.0:1746066798.435066:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7017 00000100:00100000:0.0:1746066798.435071:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882984914304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066798.435182:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882984914304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (557us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066798.435188:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7017 00002000:00100000:0.0:1746066798.435193:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (917504->921599) req@ffff880098925880 x1830882984914304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.435200:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925880 with x1830882984914304 ext(917504->921599) 00002000:00010000:0.0:1746066798.435202:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098925880 00000100:00100000:0.0:1746066798.437036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.437528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.442089:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.442601:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.442715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.445433:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.593483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.602880:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.603096:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.603134:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984915712 00000100:00100000:0.0:1746066798.603140:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984915712 00000100:00100000:0.0:1746066798.603177:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18901 00000100:00100000:0.0:1746066798.603185:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2762:x1830882984915712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066798.603201:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.603217:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfae419 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d58ce expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.603249:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.603256:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066798.603258:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066798.603261:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfae419 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ce expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.603284:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.603294:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 21 pid: 9592 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066798.603304:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984888704:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066798.603373:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.607813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.610236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.612477:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882984916096:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4418us (4658us total) trans 17179875034 rc 0/0 00000100:00100000:0.0:1746066798.612487:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2032 00002000:00100000:0.0:1746066798.612498:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (917504->995327) req@ffff8800958a7480 x1830882984916096/t17179875034(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.612507:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882984916096 ext(917504->995327) 00010000:00010000:0.0:1746066798.612516:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 24 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.612529:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfae404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58b9 expref: 24 pid: 9592 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066798.612535:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a7480 00000100:00100000:0.0:1746066798.614535:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.614558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.614600:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.614631:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984916608 00000100:00100000:0.0:1746066798.614639:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984916608 00000100:00100000:0.0:1746066798.614672:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984916736 00000100:00100000:0.0:1746066798.614675:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984916736 00000100:00100000:0.0:1746066798.614686:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984916864 00000100:00100000:0.0:1746066798.614687:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984916864 00000100:00100000:0.0:1746066798.614709:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18902 00000100:00100000:0.0:1746066798.614716:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882984916608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066798.614731:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.614748:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c5600/0xf1867c21abfae443 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d58dc expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.614800:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984888832:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066798.614872:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.614982:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18903 00000100:00100000:0.0:1746066798.614987:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882984916736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066798.614995:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.615003:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfae44a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d58e3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.615032:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984888960:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066798.615065:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800930a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.615088:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18904 00000100:00100000:0.0:1746066798.615093:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882984916864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066798.615099:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.615105:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778a00/0xf1867c21abfae451 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d58ea expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.615126:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984889088:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066798.615144:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066798.615164:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066798.616851:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.625911:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.625932:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984917504 00000100:00100000:0.0:1746066798.625938:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984917504 00002000:00100000:0.0:1746066798.625983:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1056768->2097151) req@ffff880093c4ed80 x1830882984917504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.625993:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ed80 with x1830882984917504 ext(1056768->2097151) 00002000:00010000:0.0:1746066798.625998:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ed80 00000100:00100000:0.0:1746066798.626014:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984917376 00000100:00100000:0.0:1746066798.626016:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984917376 00002000:00100000:0.0:1746066798.626026:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1208319) req@ffff88012e421880 x1830882984917376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.626033:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421880 with x1830882984917376 ext(1048576->1208319) 00002000:00010000:0.0:1746066798.626037:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421880 00000100:00100000:0.0:1746066798.626049:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7020 00000100:00100000:0.0:1746066798.626055:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882984917504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066798.634061:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984917888 00000100:00100000:0.0:1746066798.634072:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984917888 00000100:00100000:0.0:1746066798.634134:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18905 00000100:00100000:0.0:1746066798.634142:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2765:x1830882984917888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066798.634158:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.634173:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfae458 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d58f1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.634194:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.634196:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.634204:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfae458 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58f1 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.634728:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfae458 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58f1 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.634739:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418600, rc 0) 00000100:00100000:0.0:1746066798.636681:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2765:x1830882984917888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2532us (3404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.636690:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18905 00000100:00100000:0.0:1746066798.641872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.663116:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.667296:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.668446:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.686770:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.690978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.697049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.706181:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.706272:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.706354:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.707322:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8612 00000100:00100000:0.0:1746066798.707329:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882984919680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.707336:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.707347:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfae419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ce expref: 44 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.707354:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfae419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ce expref: 44 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.707367:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfae419 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58ce expref: 44 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.707378:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.707380:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.707385:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfae489 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5906 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.707392:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfae489 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5906 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.707412:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfae489 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5906 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.707420:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984889984:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066798.707451:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.709402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.709484:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984889984:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066798.709626:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.709648:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882984919680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2318us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.709656:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8612 00000100:00100000:0.0:1746066798.709723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.709742:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984919808 00000100:00100000:0.0:1746066798.709748:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984919808 00002000:00100000:0.0:1746066798.709784:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1056767) req@ffff88012b164e00 x1830882984919808/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 8680/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.709793:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164e00 with x1830882984919808 ext(1048576->1056767) 00010000:00010000:0.0:1746066798.709801:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfae40b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58c0 expref: 36 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.709812:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfae40b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58c0 expref: 36 pid: 9592 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066798.709817:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b164e00 00000100:00100000:0.0:1746066798.709841:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2034 00000100:00100000:0.0:1746066798.709846:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882984919808:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066798.712311:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882984919808:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2452us (2903us total) trans 21474842424 rc 0/0 00000100:00100000:0.0:1746066798.712323:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2034 00002000:00100000:0.0:1746066798.712334:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1056767) req@ffff88012b164e00 x1830882984919808/t21474842424(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 8680/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.712343:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164e00 with x1830882984919808 ext(1048576->1056767) 00010000:00010000:0.0:1746066798.712352:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfae40b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58c0 expref: 38 pid: 9592 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066798.712366:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfae40b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d58c0 expref: 38 pid: 9592 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066798.712372:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b164e00 00000100:00100000:0.0:1746066798.714039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.715384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.720588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.737820:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.744363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.745230:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.745690:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.748518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.750567:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.753297:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.766969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.771651:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.771730:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.776063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.789955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.796032:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.813866:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.820658:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984923392 00000100:00100000:0.0:1746066798.820668:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984923392 00002000:00100000:0.0:1746066798.820726:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e436d80 x1830882984923392/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.820736:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436d80 with x1830882984923392 ext(4194304->4861951) 00002000:00010000:0.0:1746066798.820742:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436d80 00000100:00100000:0.0:1746066798.820772:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7032 00000100:00100000:0.0:1746066798.820779:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882984923392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066798.828657:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.878366:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.878473:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.878506:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.890960:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.891979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.895832:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.912645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.916294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.919179:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882984924800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21022us (23357us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066798.919187:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7035 00002000:00100000:0.0:1746066798.919195:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c492d80 x1830882984924800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.919204:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882984924800 ext(1048576->2097151) 00002000:00010000:0.0:1746066798.919208:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492d80 00000100:00100000:0.0:1746066798.922719:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.924216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.925656:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.925708:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.927392:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18920 00000100:00100000:0.0:1746066798.927399:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882984926080:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066798.927406:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.927413:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfae523 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d596f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.927423:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.927425:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.927430:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfae523 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d596f expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.927438:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfae523 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d596f expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.927445:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7400, rc 0) 00000100:00100000:0.0:1746066798.927465:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882984926080:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.927470:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18920 00000100:00100000:0.0:1746066798.927482:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18922 00000100:00100000:0.0:1746066798.927486:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882984926336:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066798.927491:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.927496:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfae531 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d597d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.927509:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.927510:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.927514:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfae531 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d597d expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.927521:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfae531 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d597d expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.927527:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:0.0:1746066798.927542:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882984926336:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.927546:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18922 00000100:00100000:0.0:1746066798.933411:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984926592 00000100:00100000:0.0:1746066798.933420:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984926592 00002000:00100000:0.0:1746066798.933464:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800958a5180 x1830882984926592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.933473:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882984926592 ext(2097152->4194303) 00002000:00010000:0.0:1746066798.933478:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:0.0:1746066798.933631:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7036 00000100:00100000:0.0:1746066798.933639:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882984926592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066798.937330:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.955334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.955439:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984891648:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066798.955459:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ae00/0xf1867c21abfae53f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066798.961734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.963217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.967619:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.968925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.968973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.971748:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.972923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.980388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.980594:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.989239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.992138:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066798.996047:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882984929152:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3470us (3907us total) trans 17179875036 rc 0/0 00000100:00100000:0.0:1746066798.996058:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2036 00002000:00100000:0.0:1746066798.996068:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (917504->995327) req@ffff880094304a80 x1830882984929152/t17179875036(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.996077:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830882984929152 ext(917504->995327) 00010000:00010000:0.0:1746066798.996086:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfae489 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5906 expref: 45 pid: 20361 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066798.996099:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfae489 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->995327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5906 expref: 45 pid: 20361 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746066798.996105:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304a80 00000100:00100000:0.0:1746066798.999282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.006246:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.024683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.043680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.043738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.043761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.043791:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.043933:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8623 00000100:00100000:0.0:1746066799.043941:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882984929920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.043953:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.043971:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfae2e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d581f expref: 28 pid: 9590 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.043982:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfae2e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d581f expref: 28 pid: 9590 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.044003:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfae2e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d581f expref: 28 pid: 9590 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.044021:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.044052:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882984929920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.044058:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8623 00000100:00100000:0.0:1746066799.058814:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.059268:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.060481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.065511:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.069475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.071858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.078422:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.087031:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984893440:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066799.087050:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.087100:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882984931328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7317us (8677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.087110:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8628 00000100:00100000:0.0:1746066799.100765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.119360:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.119614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.119638:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.119659:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984932608 00000100:00100000:0.0:1746066799.119665:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984932608 00000100:00100000:0.0:1746066799.119707:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984932736 00000100:00100000:0.0:1746066799.119710:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984932736 00000100:00100000:0.0:1746066799.119726:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18929 00000100:00100000:0.0:1746066799.119734:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882984932608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.119760:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.119773:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae5bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d59ca expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.119823:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984893568:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066799.119921:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.130256:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.155575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.157161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.157755:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.162474:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.162513:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.162552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.172007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.175520:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.179562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.182123:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.200010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.205118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.205164:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.211800:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.213796:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882984935040:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8098us (8623us total) trans 17179875038 rc 0/0 00000100:00100000:0.0:1746066799.213807:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2038 00002000:00100000:0.0:1746066799.213818:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2457599) req@ffff880095876a00 x1830882984935040/t17179875038(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:205/0 lens 488/448 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.213826:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095876a00 with x1830882984935040 ext(2097152->2457599) 00010000:00010000:0.0:1746066799.213835:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfae5af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3244031] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d59bc expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.213848:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfae5af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3244031] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d59bc expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746066799.213854:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095876a00 00000100:00100000:0.0:1746066799.215834:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.216659:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.225986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.226019:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984935936 00000100:00100000:0.0:1746066799.226024:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984935936 00002000:00100000:0.0:1746066799.226059:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880095874a80 x1830882984935936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.226068:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095874a80 with x1830882984935936 ext(2097152->3145727) 00002000:00010000:0.0:1746066799.226073:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095874a80 00000100:00100000:0.0:1746066799.226097:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7046 00000100:00100000:0.0:1746066799.226104:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882984935936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066799.269527:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.270527:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.270712:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18938 00000100:00100000:0.0:1746066799.270723:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2795:x1830882984936704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.270732:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.270750:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5a1e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.270780:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfae5a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3268608->18446744073709551615] (req 3268608->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d59b5 expref: 46 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.270788:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.270790:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.270793:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.270824:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfae5a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3268608->18446744073709551615] (req 3268608->3944447) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d59b5 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.270840:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfae5a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3268608->18446744073709551615] (req 3268608->3944447) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d59b5 expref: 47 pid: 20361 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.270852:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984894848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.272799:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.274570:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.289681:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.289763:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.307994:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.325154:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.325199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.329373:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.329442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.329480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.334045:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984939392 00000100:00100000:0.0:1746066799.334061:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984939392 00000100:00100000:0.0:1746066799.334123:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18942 00000100:00100000:0.0:1746066799.334132:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2800:x1830882984939392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066799.334150:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.334167:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5a3a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334198:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334211:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfae649 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a17 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334216:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.334218:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.334221:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4194304->4603903] (req 4194304->4603903) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334251:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfae649 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a17 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334261:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfae649 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a17 expref: 47 pid: 11630 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.334273:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984896256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.334372:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.334380:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.334387:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984896384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.334405:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.336061:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984939520 00000100:00100000:0.0:1746066799.336066:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984939520 00002000:00100000:0.0:1746066799.336101:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (4128768->4194303) req@ffff880097a88e00 x1830882984939520/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.336110:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88e00 with x1830882984939520 ext(4128768->4194303) 00010000:00010000:0.0:1746066799.336117:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.336127:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746066799.336132:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a88e00 00000100:00100000:0.0:1746066799.336160:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2041 00000100:00100000:0.0:1746066799.337934:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882984939520:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066799.341588:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.342519:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2016:x1830882984938880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12853us (13157us total) trans 0 rc 983040/983040 00000100:00100000:0.0:1746066799.342528:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2040 00002000:00100000:0.0:1746066799.342537:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4128767) req@ffff880096ec8e00 x1830882984938880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 983040/983040 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.342546:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882984938880 ext(3145728->4128767) 00010000:00010000:0.0:1746066799.342553:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 34 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.342562:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 34 pid: 9592 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746066799.343795:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066799.347011:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.347121:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.348104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.348189:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8638 00000100:00100000:0.0:1746066799.348198:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882984939776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.348212:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.348235:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.348379:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.349024:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfae642 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a1e expref: 31 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.349047:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.349049:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.349055:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.349063:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.349070:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.349076:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.349079:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.349086:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.349115:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.349127:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984896640:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066799.349184:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.349191:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984896768:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066799.349209:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.353933:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.353974:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.354002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.354124:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984896640:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066799.354158:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984896768:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066799.354182:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.354222:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882984939776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6026us (7222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.354233:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8638 00000100:00100000:0.0:1746066799.354318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.354332:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984940544 00000100:00100000:0.0:1746066799.354337:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984940544 00010000:00010000:0.0:1746066799.354363:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.354381:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8641 00000100:00100000:0.0:1746066799.354387:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882984940544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.354398:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066799.354413:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066798 -> 1746066800 00002000:00010000:0.0:1746066799.354415:0:7232:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066798 -> 1746066800 00010000:00010000:0.0:1746066799.354421:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.354431:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.354452:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfae650 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a25 expref: 32 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.354464:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.354466:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.354473:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfae65e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a33 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.354481:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfae65e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a33 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.354511:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfae65e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a33 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.354524:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984896896:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066799.354578:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.354641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.358210:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984896896:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066799.358231:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.358267:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882984940544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3880us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.358277:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8641 00000100:00100000:0.0:1746066799.367734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.378171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.379023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.379064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.379086:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984941696 00000100:00100000:0.0:1746066799.379095:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984941696 00000100:00100000:0.0:1746066799.380076:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984941952 00000100:00100000:0.0:1746066799.380082:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984941952 00000100:00100000:0.0:1746066799.381772:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18949 00000100:00100000:0.0:1746066799.381778:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882984941824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.381783:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.381789:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfae696 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5a64 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.381807:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984897536:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066799.382119:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.383478:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984897536:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066799.383510:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfae696 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a64 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.383524:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfae696 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a64 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.383549:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb800, rc 0) 00000100:00100000:0.0:1746066799.383581:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882984941824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1803us (4516us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066799.383590:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 18949 00000100:00100000:0.0:1746066799.386603:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.386944:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.387132:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18950 00000100:00100000:0.0:1746066799.387143:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2792:x1830882984942080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.387161:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.387175:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfae69d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5a72 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.387200:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.387207:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.387209:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.387211:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfae69d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->4861951] (req 4194304->4861951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a72 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.387233:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.387243:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfae665 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4603903) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a3a expref: 30 pid: 11630 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.387252:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984897664:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.387306:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.387336:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.389602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.395589:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.399029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.406086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.428511:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.432179:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.432837:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984943744 00000100:00100000:0.0:1746066799.432841:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984943744 00000100:00100000:0.0:1746066799.432870:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6343 00000100:00100000:0.0:1746066799.432875:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:313:x1830882984943744:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066799.433109:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:313:x1830882984943744:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 233us (338us total) trans 8589937427 rc 0/0 00000100:00100000:0.0:1746066799.433114:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6343 00000100:00100000:0.0:1746066799.434028:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.435348:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984944000 00000100:00100000:0.0:1746066799.435353:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984944000 00010000:00010000:0.0:1746066799.435369:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfae634 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a10 expref: 36 pid: 13370 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.435387:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8644 00000100:00100000:0.0:1746066799.435392:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2015:x1830882984944000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.435400:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.435404:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfae634 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a10 expref: 36 pid: 13370 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.435413:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfae634 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a10 expref: 36 pid: 13370 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.435430:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfae634 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a10 expref: 36 pid: 13370 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.435440:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066799.435443:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066799.435449:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066799.435456:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066799.435480:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.435512:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882984944000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.435517:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8644 00000100:00100000:0.0:1746066799.447053:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984944768 00000100:00100000:0.0:1746066799.447061:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984944768 00000100:00100000:0.0:1746066799.447112:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16972 00000100:00100000:0.0:1746066799.447120:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2806:x1830882984944768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066799.447135:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.447150:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfae6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5ab8 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.447236:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e200/0xf1867c21abfae6ff lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066799.447250:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a95 expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.447257:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e200/0xf1867c21abfae6ff lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066799.447283:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a95 expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.447293:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfae6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a95 expref: 12 pid: 13370 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.447304:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984898560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.447379:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.449935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.453428:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.457738:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.463927:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984945664 00000100:00100000:0.0:1746066799.463932:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984945664 00000100:00100000:0.0:1746066799.463966:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984945920 00000100:00100000:0.0:1746066799.463968:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984945920 00000100:00100000:0.0:1746066799.463985:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 18964 00000100:00100000:0.0:1746066799.463990:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984945920:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066799.464009:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfae74c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464020:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464028:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xf1867c21abfae611 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2457600->3244031] (req 2457600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a02 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464034:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfae69d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a72 expref: 47 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464039:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746066799.464040:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746066799.464043:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfae74c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464062:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfae69d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a72 expref: 47 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464069:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfae69d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a72 expref: 47 pid: 3528 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.464079:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900096:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.464186:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xf1867c21abfae611 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2457600->3244031] (req 2457600->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a02 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464195:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779e00/0xf1867c21abfae611 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2457600->3244031] (req 2457600->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a02 expref: 30 pid: 9592 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.464202:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900480:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.464222:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.464227:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfae66c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a41 expref: 47 pid: 9592 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.464234:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900608:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.464249:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.469369:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469386:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469399:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469411:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469438:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469449:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.469489:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.474750:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094378a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984899968:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.474761:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009437b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984900224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.474768:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094378380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984900352:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.474792:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.474814:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.474822:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.474828:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984900608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.474842:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfae74c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475444:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475451:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475462:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475468:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475473:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475478:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093507e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066799.475481:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475488:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475496:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.475503:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfae745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.482113:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984948224 00000100:00100000:0.0:1746066799.482120:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984948224 00010000:00010000:0.0:1746066799.482149:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfae657 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a2c expref: 51 pid: 9592 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.482220:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8660 00000100:00100000:0.0:1746066799.482228:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:2014:x1830882984948224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.482240:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.482253:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfae657 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a2c expref: 51 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.482262:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfae657 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a2c expref: 51 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.482280:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfae657 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5a2c expref: 51 pid: 9592 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.482296:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.482298:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.482301:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfae73e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.482308:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfae73e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.482539:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.482727:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882984948224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 500us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.482734:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8660 00000100:00100000:0.0:1746066799.484964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.487455:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.490411:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.491524:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.491566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.491758:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8666 00000100:00100000:0.0:1746066799.491765:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882984949248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.491772:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.491776:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfae0ed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56cf expref: 41 pid: 10125 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.491784:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfae0ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56cf expref: 41 pid: 10125 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.491800:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfae0ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d56cf expref: 41 pid: 10125 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066799.491816:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066799.491819:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae753 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066799.491825:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae753 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066799.491830:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae753 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066799.491844:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.491861:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882984949248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.491867:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8666 00000100:00100000:0.0:1746066799.498270:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984903424 00000100:00100000:0.0:1746066799.498274:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984903424 00000100:00100000:0.0:1746066799.498297:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18981 00000100:00100000:0.0:1746066799.498303:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3776:x1830882984903424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.498361:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3776:x1830882984903424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (144us total) trans 17179875051 rc 0/0 00000100:00100000:0.0:1746066799.498366:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18981 00000100:00100000:0.0:1746066799.499355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.502434:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.505128:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.510698:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984950016 00000100:00100000:0.0:1746066799.510707:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984950016 00000100:00100000:0.0:1746066799.510756:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6345 00000100:00100000:0.0:1746066799.510764:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2806:x1830882984950016:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:0.0:1746066799.532111:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.534234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.558790:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.558840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.566296:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.566347:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.567744:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7060 00000100:00100000:0.0:1746066799.588861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.591968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.592007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.600187:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984904192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.600545:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.600575:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984904704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.600593:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.600842:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984905216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.600864:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.600875:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984905728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.600903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.600922:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984905216 00000100:00100000:0.0:1746066799.600925:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984905216 00000100:00100000:0.0:1746066799.600938:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984905728 00000100:00100000:0.0:1746066799.600939:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984905728 00000100:00100000:0.0:1746066799.600947:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18990 00000100:00100000:0.0:1746066799.600951:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3774:x1830882984903936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066799.601240:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066799.601243:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066799 -> 1746066799 00002000:00010000:0.0:1746066799.601244:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066799 -> 1746066799 00002000:00010000:0.0:1746066799.601246:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066799 -> 1746066799 00002000:00010000:0.0:1746066799.601247:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066799.601271:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3774:x1830882984903936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (540us total) trans 17179875053 rc 0/0 00000100:00100000:0.0:1746066799.603775:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18990 00000100:00100000:0.0:1746066799.604325:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.605912:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.605950:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.616158:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.622945:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.624954:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.631184:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.631223:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.646563:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.647449:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.659129:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.660925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.660964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.661238:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19008 00000100:00100000:0.0:1746066799.661244:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882984956032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.661251:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.661258:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfae841 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b3d expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.661282:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984906624:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066799.661297:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.664641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066799.664720:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066798 -> 1746066800 00000100:00100000:0.0:1746066799.664739:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984906624:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066799.664767:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfae841 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b3d expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.664779:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfae841 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b3d expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.664807:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507400, rc 0) 00000100:00100000:0.0:1746066799.664844:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882984956032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3599us (3879us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066799.664851:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19008 00000100:00100000:0.0:1746066799.664872:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984956160 00000100:00100000:0.0:1746066799.664877:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984956160 00000100:00100000:0.0:1746066799.664924:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19009 00000100:00100000:0.0:1746066799.664930:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2815:x1830882984956160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066799.664942:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.664952:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507200/0xf1867c21abfae848 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b44 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.664974:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b1a expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.664981:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.664982:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066799.664985:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507200/0xf1867c21abfae848 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2588672->3088383] (req 2588672->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b44 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.665007:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae802 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b1a expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.665017:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5729c00/0xf1867c21abfae802 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b1a expref: 36 pid: 20361 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066799.665027:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984906752:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.665078:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.665101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.665992:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.666029:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.666061:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.671489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.671957:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.680127:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.680144:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.680411:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.680517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.680549:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.692163:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.695344:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.704073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.707161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.707213:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.721925:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984959488 00000100:00100000:0.0:1746066799.721935:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984959488 00000100:00100000:0.0:1746066799.721978:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984959616 00000100:00100000:0.0:1746066799.721979:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984959616 00000100:00100000:0.0:1746066799.721998:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19015 00000100:00100000:0.0:1746066799.722005:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882984959488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.722024:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.722047:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b6e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.722072:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.722074:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.722083:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b6e expref: 53 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.722099:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b6e expref: 53 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.722110:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7200, rc 0) 00000100:00100000:0.0:1746066799.722159:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882984959488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 154us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.722166:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19015 00000100:00100000:0.0:1746066799.722181:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19016 00000100:00100000:0.0:1746066799.722185:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882984959616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066799.722193:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.722202:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfae879 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b75 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.722245:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984907264:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066799.723282:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00080000:0.0:1746066799.726513:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066799.731005:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.731062:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.731653:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7075 00000100:00100000:0.0:1746066799.731662:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882984960384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066799.733345:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.748986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.750870:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.751635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.764560:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.767961:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.773124:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.782116:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.782173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.808002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.840248:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848034:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.848186:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984962816 00000100:00100000:0.0:1746066799.848196:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984962816 00000100:00100000:0.0:1746066799.848233:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984962944 00000100:00100000:0.0:1746066799.848235:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984962944 00000100:00100000:0.0:1746066799.848245:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984963072 00000100:00100000:0.0:1746066799.848246:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984963072 00000100:00100000:0.0:1746066799.848255:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984963200 00000100:00100000:0.0:1746066799.848257:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984963200 00000100:00100000:0.0:1746066799.848264:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984963328 00000100:00100000:0.0:1746066799.848265:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984963328 00000100:00100000:0.0:1746066799.848272:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984963456 00000100:00100000:0.0:1746066799.848274:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984963456 00000100:00100000:0.0:1746066799.848284:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19020 00000100:00100000:0.0:1746066799.848291:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984962816:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848310:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848327:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b98 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848351:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848353:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848363:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848379:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848389:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fa00, rc 0) 00000100:00100000:0.0:1746066799.848433:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984962816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 142us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848439:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19020 00000100:00100000:0.0:1746066799.848454:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19021 00000100:00100000:0.0:1746066799.848458:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984962944:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848464:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848473:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5b9f expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848484:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848485:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848489:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b9f expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848498:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b9f expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848504:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f600, rc 0) 00000100:00100000:0.0:1746066799.848517:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984962944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 58us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848521:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19021 00000100:00100000:0.0:1746066799.848528:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19022 00000100:00100000:0.0:1746066799.848532:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984963072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848536:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848541:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfae8bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5ba6 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848549:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848550:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848554:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfae8bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ba6 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848563:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfae8bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ba6 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848570:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:0.0:1746066799.848584:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984963072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848589:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19022 00000100:00100000:0.0:1746066799.848598:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19023 00000100:00100000:0.0:1746066799.848603:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984963200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848608:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848613:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5bad expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848623:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848624:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848629:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848637:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848644:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e800, rc 0) 00000100:00100000:0.0:1746066799.848657:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984963200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848661:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19023 00000100:00100000:0.0:1746066799.848670:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19024 00000100:00100000:0.0:1746066799.848675:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984963328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848690:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848695:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfae8cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5bb4 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848705:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848706:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848710:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfae8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bb4 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848718:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfae8cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bb4 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848724:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e400, rc 0) 00000100:00100000:0.0:1746066799.848737:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984963328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848741:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19024 00000100:00100000:0.0:1746066799.848749:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19025 00000100:00100000:0.0:1746066799.848753:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984963456:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.848758:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.848763:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfae8d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5bbb expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.848772:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848773:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.848776:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfae8d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bbb expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848785:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfae8d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bbb expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.848790:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ea00, rc 0) 00000100:00100000:0.0:1746066799.848802:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882984963456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 49us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.848806:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19025 00000100:00100000:0.0:1746066799.854034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.857131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.857208:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.862441:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.865072:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.872575:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876141:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876771:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876849:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.876942:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984964608 00000100:00100000:0.0:1746066799.876951:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984964608 00000100:00100000:0.0:1746066799.877093:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984964992 00000100:00100000:0.0:1746066799.877096:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984964992 00000100:00100000:0.0:1746066799.877109:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19027 00000100:00100000:0.0:1746066799.877113:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882984964608:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066799.877145:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.877165:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097392000/0xf1867c21abfae7a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ae2 expref: 31 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.877172:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.877180:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfae84f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b4b expref: 52 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.877186:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.877188:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.877190:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.877220:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfae84f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b4b expref: 52 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.877232:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfae84f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b4b expref: 52 pid: 1893 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.877245:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984908416:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.878225:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 15 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.878233:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 15 pid: 9591 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.878245:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984909952:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.878265:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097392000/0xf1867c21abfae7a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ae2 expref: 31 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.878272:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097392000/0xf1867c21abfae7a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ae2 expref: 31 pid: 12233 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.878279:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984910208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066799.878291:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.887200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.887217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.887238:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984965632 00000100:00100000:0.0:1746066799.887243:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984965632 00010000:00010000:0.0:1746066799.887276:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac800/0xf1867c21abfae85d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b59 expref: 41 pid: 9592 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.887298:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8677 00000100:00100000:0.0:1746066799.887305:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882984965632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.887320:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.887343:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fac800/0xf1867c21abfae85d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b59 expref: 41 pid: 9592 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887354:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fac800/0xf1867c21abfae85d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b59 expref: 41 pid: 9592 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887375:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fac800/0xf1867c21abfae85d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b59 expref: 41 pid: 9592 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887389:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.887420:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882984965632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.887426:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8677 00000100:00100000:0.0:1746066799.887835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.887875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.887909:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8679 00000100:00100000:0.0:1746066799.887914:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882984965376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.887923:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.887931:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b9f expref: 14 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887940:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b9f expref: 14 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887951:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfae8b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b9f expref: 14 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.887967:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.887978:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984965376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.887983:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8679 00000100:00100000:0.0:1746066799.888014:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.888022:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984966400 00000100:00100000:0.0:1746066799.888025:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984966400 00010000:00010000:0.0:1746066799.888034:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfae86b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b67 expref: 32 pid: 13363 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066799.888046:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8681 00000100:00100000:0.0:1746066799.888049:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882984966400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.888055:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.888062:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfae86b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b67 expref: 32 pid: 13363 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066799.888068:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfae86b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b67 expref: 32 pid: 13363 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066799.888078:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfae86b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b67 expref: 32 pid: 13363 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066799.888086:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.888097:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882984966400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.888102:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8681 00000100:00100000:0.0:1746066799.888109:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984965504 00000100:00100000:0.0:1746066799.888111:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984965504 00010000:00010000:0.0:1746066799.888117:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfae8bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ba6 expref: 13 pid: 9591 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.889227:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984966784 00000100:00100000:0.0:1746066799.889231:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984966784 00010000:00010000:0.0:1746066799.889241:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 16 pid: 9591 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.889266:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984967168 00000100:00100000:0.0:1746066799.889268:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984967168 00010000:00010000:0.0:1746066799.889275:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097392000/0xf1867c21abfae7a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ae2 expref: 32 pid: 12233 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.889284:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8688 00000100:00100000:0.0:1746066799.889288:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882984966784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.889293:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.889299:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 16 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889306:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 16 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889315:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e800/0xf1867c21abfae8c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bad expref: 16 pid: 9591 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889336:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.889349:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882984966784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.889418:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8688 00000100:00100000:0.0:1746066799.889434:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8691 00000100:00100000:0.0:1746066799.889438:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882984967424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.889445:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.889450:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b6e expref: 52 pid: 1893 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889457:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b6e expref: 52 pid: 1893 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889466:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfae872 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b6e expref: 52 pid: 1893 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066799.889474:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.889475:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.889477:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfae92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889483:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfae92f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889495:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.889505:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882984967424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.889510:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8691 00010000:00010000:0.0:1746066799.889533:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfae8b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5b98 expref: 13 pid: 9591 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.889541:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984909952:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.889548:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097392000/0xf1867c21abfae7a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ae2 expref: 29 pid: 12233 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066799.889556:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984910208:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066799.889571:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889577:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889582:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889592:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889599:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889605:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889610:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80fc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066799.889612:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889619:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889632:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.889637:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfae91a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.889668:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984964608:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12554us (13536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.889673:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19027 00000100:00100000:0.0:1746066799.890129:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.892953:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.895622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.896049:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.902602:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984910976 00000100:00100000:0.0:1746066799.902609:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984910976 00000100:00100000:0.0:1746066799.902638:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984911488 00000100:00100000:0.0:1746066799.902640:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984911488 00000100:00100000:0.0:1746066799.902650:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984910848 00000100:00100000:0.0:1746066799.902651:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984910848 00000100:00100000:0.0:1746066799.902663:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19032 00000100:00100000:0.0:1746066799.902669:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984910976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.903782:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3776:x1830882984910976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1113us (1302us total) trans 21474842444 rc 0/0 00000100:00100000:0.0:1746066799.903787:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19032 00000100:00100000:0.0:1746066799.903814:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984911616 00000100:00100000:0.0:1746066799.903816:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984911616 00000100:00100000:0.0:1746066799.903827:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984912128 00000100:00100000:0.0:1746066799.903829:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984912128 00000100:00100000:0.0:1746066799.903838:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19037 00000100:00100000:0.0:1746066799.903841:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3777:x1830882984911616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.903907:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3777:x1830882984911616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (109us total) trans 17179875065 rc 0/0 00000100:00100000:0.0:1746066799.903913:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19037 00000100:00100000:0.0:1746066799.903926:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19039 00000100:00100000:0.0:1746066799.903930:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3777:x1830882984912640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.904491:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984912640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 560us (643us total) trans 21474842446 rc 0/0 00000100:00100000:0.0:1746066799.904496:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19039 00000100:00100000:0.0:1746066799.904510:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19043 00000100:00100000:0.0:1746066799.904513:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3775:x1830882984911744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066799.905026:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066799.905029:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066799.905031:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066799.905032:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066799.905034:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066799.905054:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3775:x1830882984911744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 540us (825us total) trans 17179875069 rc 0/0 00000100:00100000:0.0:1746066799.905059:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19043 00000100:00100000:0.0:1746066799.905215:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984912896 00000100:00100000:0.0:1746066799.905218:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984912896 00000100:00100000:0.0:1746066799.905229:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19048 00000100:00100000:0.0:1746066799.905233:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3774:x1830882984912896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.905304:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882984912896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (218us total) trans 17179875070 rc 0/0 00000100:00100000:0.0:1746066799.905310:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19048 00000100:00100000:0.0:1746066799.907498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.909581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.910512:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.910540:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.910715:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.910985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.911620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.916224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.916260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.916304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.917184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.917198:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984969600 00000100:00100000:0.0:1746066799.917200:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984969600 00000100:00100000:0.0:1746066799.917232:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19058 00000100:00100000:0.0:1746066799.917237:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984969600:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066799.917271:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984969600:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.917276:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19058 00000100:00100000:0.0:1746066799.917323:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.917331:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984969728 00000100:00100000:0.0:1746066799.917333:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984969728 00000100:00100000:0.0:1746066799.917354:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19059 00000100:00100000:0.0:1746066799.917358:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984969728:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066799.917385:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984969728:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.917796:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19059 00000100:00100000:0.0:1746066799.922331:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922357:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922442:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.922556:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19061 00000100:00100000:0.0:1746066799.922570:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984970112:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066799.922822:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882984970112:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 253us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.922859:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19061 00000100:00100000:0.0:1746066799.922872:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19066 00000100:00100000:0.0:1746066799.922877:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984970624:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066799.922926:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882984970624:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.922931:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19066 00000100:00100000:0.0:1746066799.927102:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.929820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.933793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.934531:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066799.997497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.001736:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984972928 00000100:00100000:0.0:1746066800.001745:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984972928 00000100:00100000:0.0:1746066800.001811:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19067 00000100:00100000:0.0:1746066800.001820:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2824:x1830882984972928:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.001837:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.001855:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507400/0xf1867c21abfae9bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5c0f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.001905:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfae959 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5be5 expref: 14 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.001912:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.001914:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.001917:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507400/0xf1867c21abfae9bb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c0f expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.001948:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfae959 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5be5 expref: 14 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.001960:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfae959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5be5 expref: 14 pid: 13363 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066800.001971:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984913024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066800.002062:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.004120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.007470:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066800.008048:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066800.010002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.013940:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.016569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.018663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.022148:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.025375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.028561:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.031043:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.033404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038240:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038254:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038267:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038280:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.038305:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066800.040869:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066800.046275:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00010000:0.0:1746066800.051990:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801310f3100 reply state ffff88009849a400 transno 8589937446 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfae9e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066800.052021:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfae9e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066800.052129:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066800.052132:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746066800.052136:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746066800.052142:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066800.052144:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066800.052149:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfae905 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5bd0 expref: 7 pid: 13370 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746066800.052240:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746066800.052251:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2824:x1830882984975360:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 11382us (11593us total) trans 8589937446 rc 0/0 00000100:00100000:0.0:1746066800.052264:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6350 00000100:00100000:0.0:1746066800.052648:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052662:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.052696:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052716:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.052733:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052750:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984916352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.052763:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052775:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746066800.052779:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.052791:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052801:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.052815:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052820:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984916224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.052830:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.052844:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984915712 00000100:00100000:0.0:1746066800.052846:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984915712 00000100:00100000:0.0:1746066800.052858:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984916224 00000100:00100000:0.0:1746066800.052860:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984916224 00000100:00100000:0.0:1746066800.052867:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19083 00000100:00100000:0.0:1746066800.052871:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3777:x1830882984915840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066800.053280:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066800.053283:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.053284:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.053286:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066801 -> 1746066801 00002000:00010000:0.0:1746066800.053288:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066800.053307:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3777:x1830882984915840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 436us (573us total) trans 21474842457 rc 0/0 00000100:00100000:0.0:1746066800.053313:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19083 00000100:00100000:0.0:1746066800.053343:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875070 gen 2 00000004:00080000:0.0:1746066800.053347:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677e300, transno 17179874992 00000004:00080000:0.0:1746066800.053444:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ea00, transno 17179874993 00000004:00080000:0.0:1746066800.053447:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c776300, transno 17179874994 00000004:00080000:0.0:1746066800.053450:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c774000, transno 17179874995 00000004:00080000:0.0:1746066800.053452:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677d880, transno 17179874996 00000004:00080000:0.0:1746066800.053454:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094373480, transno 17179874997 00000004:00080000:0.0:1746066800.053455:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677c700, transno 17179874998 00000004:00080000:0.0:1746066800.053458:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c777800, transno 17179874999 00000004:00080000:0.0:1746066800.053460:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e435f80, transno 17179875000 00000004:00080000:0.0:1746066800.053462:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f56a00, transno 17179875004 00000004:00080000:0.0:1746066800.053464:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666f480, transno 17179875005 00000004:00080000:0.0:1746066800.053466:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f56680, transno 17179875006 00000004:00080000:0.0:1746066800.053469:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666d500, transno 17179875007 00000004:00080000:0.0:1746066800.053470:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ed80, transno 17179875008 00000004:00080000:0.0:1746066800.053472:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666f800, transno 17179875009 00000004:00080000:0.0:1746066800.053474:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ca80, transno 17179875010 00000004:00080000:0.0:1746066800.053476:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666d880, transno 17179875011 00000004:00080000:0.0:1746066800.053478:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666e300, transno 17179875012 00000004:00080000:0.0:1746066800.053481:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887800, transno 17179875013 00000004:00080000:0.0:1746066800.053483:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887100, transno 17179875014 00000004:00080000:0.0:1746066800.053485:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884000, transno 17179875015 00000004:00080000:0.0:1746066800.053487:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884380, transno 17179875016 00000004:00080000:0.0:1746066800.053490:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5886a00, transno 17179875017 00000004:00080000:0.0:1746066800.053492:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884700, transno 17179875018 00000004:00080000:0.0:1746066800.053494:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885880, transno 17179875019 00000004:00080000:0.0:1746066800.053497:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884e00, transno 17179875020 00000004:00080000:0.0:1746066800.053499:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885c00, transno 17179875021 00000004:00080000:0.0:1746066800.053501:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01180, transno 17179875022 00000004:00080000:0.0:1746066800.053503:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02680, transno 17179875023 00000004:00080000:0.0:1746066800.053505:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01f80, transno 17179875024 00000004:00080000:0.0:1746066800.053507:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00000, transno 17179875025 00000004:00080000:0.0:1746066800.053509:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02a00, transno 17179875026 00000004:00080000:0.0:1746066800.053512:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02d80, transno 17179875027 00000004:00080000:0.0:1746066800.053514:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01500, transno 17179875028 00000004:00080000:0.0:1746066800.053516:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b03800, transno 17179875029 00000004:00080000:0.0:1746066800.053518:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01c00, transno 17179875030 00000004:00080000:0.0:1746066800.053520:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5766d80, transno 17179875043 00000004:00080000:0.0:1746066800.053522:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767100, transno 17179875044 00000004:00080000:0.0:1746066800.053524:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765c00, transno 17179875045 00000004:00080000:0.0:1746066800.053526:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764000, transno 17179875046 00000004:00080000:0.0:1746066800.053528:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765880, transno 17179875047 00000004:00080000:0.0:1746066800.053530:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767b80, transno 17179875048 00000004:00080000:0.0:1746066800.053532:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765180, transno 17179875049 00000004:00080000:0.0:1746066800.053534:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096eca680, transno 17179875050 00000004:00080000:0.0:1746066800.053537:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8380, transno 17179875051 00000004:00080000:0.0:1746066800.053539:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedf80, transno 17179875052 00000004:00080000:0.0:1746066800.053541:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095ceca80, transno 17179875053 00000004:00080000:0.0:1746066800.053543:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedc00, transno 17179875054 00000004:00080000:0.0:1746066800.053545:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cee300, transno 17179875055 00000004:00080000:0.0:1746066800.053548:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cefb80, transno 17179875056 00000004:00080000:0.0:1746066800.053550:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cef100, transno 17179875057 00000004:00080000:0.0:1746066800.053552:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967a8a80, transno 17179875058 00000004:00080000:0.0:1746066800.053555:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cec380, transno 17179875059 00000004:00080000:0.0:1746066800.053557:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cec700, transno 17179875060 00000004:00080000:0.0:1746066800.053559:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211f80, transno 17179875062 00000004:00080000:0.0:1746066800.053561:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213480, transno 17179875063 00000004:00080000:0.0:1746066800.053563:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213100, transno 17179875064 00000004:00080000:0.0:1746066800.053565:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e1180, transno 17179875065 00000004:00080000:0.0:1746066800.053567:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e0a80, transno 17179875066 00000004:00080000:0.0:1746066800.053568:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e0000, transno 17179875067 00000004:00080000:0.0:1746066800.053570:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e3b80, transno 17179875068 00000004:00080000:0.0:1746066800.053572:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e0380, transno 17179875069 00000004:00080000:0.0:1746066800.053574:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305180, transno 17179875070 00000100:00100000:0.0:1746066800.053580:0:3777:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880098fbce00 x1830882984915200/t17179875078(17179875078) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066816 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066800.053589:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbce00/2, rc 0, transno 17179875078 00000100:00100000:0.0:1746066800.053593:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.053605:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbf800/2, rc 0, transno 21474842456 00000100:00100000:0.0:1746066800.053608:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.053613:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f763b80/2, rc 0, transno 21474842458 00000100:00100000:0.0:1746066800.053615:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984916224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.053621:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094371500/2, rc 0, transno 21474842455 00000100:00100000:0.0:1746066800.053623:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984916352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.053630:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbd180/2, rc 0, transno 17179875077 00000100:00100000:0.0:1746066800.053633:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984914816:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.053638:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212300/2, rc 0, transno 21474842457 00000100:00100000:0.0:1746066800.053641:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984915840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.053656:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19090 00000100:00100000:0.0:1746066800.053661:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3774:x1830882984915968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066800.053721:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066800.053724:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.053726:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.053728:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066801 -> 1746066801 00002000:00010000:0.0:1746066800.053729:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066800.053752:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882984915968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (208us total) trans 21474842459 rc 0/0 00000100:00100000:0.0:1746066800.053757:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19090 00000004:00080000:0.0:1746066800.054044:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 3 in flight, 63 done 00000100:00100000:0.0:1746066800.055205:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984975616 00000100:00100000:0.0:1746066800.055209:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984975616 00000100:00100000:0.0:1746066800.055238:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16991 00000100:00100000:0.0:1746066800.055254:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2824:x1830882984975616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.055269:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.055284:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507000/0xf1867c21abfae9ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5c39 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.055331:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507000/0xf1867c21abfae9ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c39 expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.055343:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507000/0xf1867c21abfae9ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c39 expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.055360:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066800.055362:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066800.055366:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:0.0:1746066800.056550:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2824:x1830882984975616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1303us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.056558:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16991 00000100:00100000:0.0:1746066800.056906:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19095 00000100:00100000:0.0:1746066800.056910:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882984916608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.057020:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3775:x1830882984916608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1435us total) trans 21474842461 rc 0/0 00000100:00100000:0.0:1746066800.057025:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19095 00000100:00100000:0.0:1746066800.060326:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984975872 00000100:00100000:0.0:1746066800.060336:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984975872 00000100:00100000:0.0:1746066800.060391:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6351 00000100:00100000:0.0:1746066800.060398:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2824:x1830882984975872:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066800.060605:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2824:x1830882984975872:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 207us (691us total) trans 8589937447 rc 0/0 00000100:00100000:0.0:1746066800.060611:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6351 00000100:00100000:0.0:1746066800.076155:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.077959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.079503:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.084215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.084317:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.084364:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.084382:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984977280 00000100:00100000:0.0:1746066800.084385:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984977280 00000100:00100000:0.0:1746066800.084405:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16994 00000100:00100000:0.0:1746066800.084409:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2831:x1830882984977280:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066800.084419:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.084433:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32000/0xf1867c21abfaea39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5c55 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.084488:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32400/0xf1867c21abfaea40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066800.084500:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaea08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c40 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.084505:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfaea2b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c47 expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.084510:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32400/0xf1867c21abfaea40 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066800.084533:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfaea2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c47 expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.084542:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0c00/0xf1867c21abfaea2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c47 expref: 10 pid: 13370 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.084552:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984916864:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066800.084618:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaea08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c40 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.084626:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaea08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c40 expref: 31 pid: 13370 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.084633:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984916992:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066800.084654:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.086749:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.086915:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984917120:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066800.086933:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfaea47 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c4e expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.086944:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4200, rc 0) 00000100:00100000:0.0:1746066800.086970:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2835:x1830882984977024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2244us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.086976:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19096 00000100:00100000:0.0:1746066800.087319:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.087420:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.087452:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.087720:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8705 00000100:00100000:0.0:1746066800.087726:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882984977792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.087733:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.087745:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093507400/0xf1867c21abfae9bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c0f expref: 10 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.087752:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093507400/0xf1867c21abfae9bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c0f expref: 10 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.087763:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507400/0xf1867c21abfae9bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c0f expref: 10 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.087775:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.087777:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.087782:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfaea47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c4e expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.087792:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfaea47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c4e expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.087811:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfaea47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c4e expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.087819:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984917248:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066800.088174:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.093800:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.093921:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.093939:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984978304 00000100:00100000:0.0:1746066800.093942:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984978304 00000100:00080000:0.0:1746066800.093960:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066800.093981:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19097 00000100:00100000:0.0:1746066800.093988:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2836:x1830882984978304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066800.094001:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.094014:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5c71 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.094033:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.094034:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.094041:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 6 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.094054:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 6 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.094068:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540000, rc 0) 00000100:00100000:0.0:1746066800.094101:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+6:2836:x1830882984978304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.094106:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19097 00000100:00100000:0.0:1746066800.099352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.103904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.111148:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.114414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.115093:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.118207:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.119947:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.119980:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.121308:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066800.122643:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066800.125235:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984918016 00000100:00100000:0.0:1746066800.125241:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984918016 00000100:00100000:0.0:1746066800.125273:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19100 00000100:00100000:0.0:1746066800.125280:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3774:x1830882984918016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066800.125400:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066800.125403:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.125405:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.125408:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066801 -> 1746066801 00002000:00010000:0.0:1746066800.125410:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066800.125441:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3774:x1830882984918016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (267us total) trans 21474842463 rc 0/0 00000100:00100000:0.0:1746066800.125451:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19100 00000100:00100000:0.0:1746066800.125566:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984918528 00000100:00100000:0.0:1746066800.125569:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984918528 00000100:00100000:0.0:1746066800.125771:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984919040 00000100:00100000:0.0:1746066800.125775:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984919040 00000100:00100000:0.0:1746066800.125819:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984919552 00000100:00100000:0.0:1746066800.125821:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984919552 00000100:00100000:0.0:1746066800.125835:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19101 00000100:00100000:0.0:1746066800.125840:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3774:x1830882984918528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.125931:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:3774:x1830882984918528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (710us total) trans 21474842464 rc 0/0 00000100:00100000:0.0:1746066800.125938:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19101 00000100:00100000:0.0:1746066800.125950:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984919168 00000100:00100000:0.0:1746066800.125953:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984919168 00000100:00100000:0.0:1746066800.125963:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19103 00000100:00100000:0.0:1746066800.125966:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3774:x1830882984919552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.126025:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3774:x1830882984919552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (241us total) trans 17179875083 rc 0/0 00000100:00100000:0.0:1746066800.126029:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19103 00000100:00100000:0.0:1746066800.126038:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19105 00000100:00100000:0.0:1746066800.126041:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3775:x1830882984918656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.126072:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19106 00000100:00100000:0.0:1746066800.126075:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984919168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066800.126102:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066800.126103:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.126105:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066800.126107:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066801 -> 1746066801 00002000:00010000:0.0:1746066800.126108:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066800.126124:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984919168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (179us total) trans 17179875085 rc 0/0 00000100:00100000:0.0:1746066800.126130:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19106 00000100:00100000:0.0:1746066800.126282:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3775:x1830882984918656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (367us total) trans 21474842466 rc 0/0 00000100:00100000:0.0:1746066800.126288:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19105 00000100:00100000:0.0:1746066800.126301:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19109 00000100:00100000:0.0:1746066800.126306:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3776:x1830882984918784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.126363:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882984918784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (161us total) trans 21474842468 rc 0/0 00000100:00100000:0.0:1746066800.127083:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19109 00000004:00080000:0.0:1746066800.127117:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765c00/2, rc 0, transno 17179875084 00000100:00100000:0.0:1746066800.127121:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984919040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.127129:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094305180/2, rc 0, transno 17179875083 00000100:00100000:0.0:1746066800.127131:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984919552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.127138:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c776300/2, rc 0, transno 21474842464 00000100:00100000:0.0:1746066800.127140:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984918528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.129652:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.135262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.139497:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984981376 00000100:00100000:0.0:1746066800.139507:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984981376 00010000:00010000:0.0:1746066800.139543:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfae9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c1d expref: 13 pid: 1893 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.139570:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984981248 00000100:00100000:0.0:1746066800.139572:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984981248 00010000:00010000:0.0:1746066800.139582:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfae9de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c32 expref: 14 pid: 1893 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.139596:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8710 00000100:00100000:0.0:1746066800.139604:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882984981376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.139617:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.139636:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfae9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c1d expref: 14 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.139646:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfae9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c1d expref: 14 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.139667:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfae9c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c1d expref: 14 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.139726:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.139728:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.139734:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfaeab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ca2 expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.139741:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfaeab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1671167) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ca2 expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.139765:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfaeab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1671167) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5ca2 expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.139775:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984920704:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066800.139832:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.143549:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.146748:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.154124:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.154176:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.154967:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.155289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.159473:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066800.165830:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842471 is committed 00000001:00080000:0.0:1746066800.165840:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842470 is committed 00000001:00080000:0.0:1746066800.165867:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842454 is committed 00000001:00080000:0.0:1746066800.166071:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842442 is committed 00000100:00100000:0.0:1746066800.167793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.172648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.172704:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.199076:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.214552:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.214640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.214697:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984984064 00000100:00100000:0.0:1746066800.214700:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984984064 00010000:00010000:0.0:1746066800.214718:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfae9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c24 expref: 9 pid: 1893 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.214750:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8713 00000100:00100000:0.0:1746066800.214755:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882984984064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.214762:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.214776:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfae9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c24 expref: 9 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.214783:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfae9d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c24 expref: 9 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.214799:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfae9d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c24 expref: 9 pid: 1893 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.214812:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.214814:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.214819:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfaeac5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cb7 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.214825:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfaeac5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cb7 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.214831:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.214832:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.214835:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfaeacc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cbe expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.214841:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfaeacc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cbe expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.214865:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfaeacc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cbe expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.214879:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984921344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066800.214951:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfaeac5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5cb7 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.214959:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984921472:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066800.214977:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.221050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.221100:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.237410:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.237450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.240826:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.241562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.243341:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.249938:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.258186:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.259501:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.260809:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2050 00000100:00100000:0.0:1746066800.260818:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882984986368:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066800.277790:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.280158:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.282221:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.288762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.292141:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.293022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.293061:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.293094:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.298450:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.301865:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882984987520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12812us (13108us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066800.301874:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7104 00002000:00100000:0.0:1746066800.301899:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800958a6680 x1830882984987520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.301907:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882984987520 ext(2097152->4194303) 00002000:00010000:0.0:1746066800.301911:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:0.0:1746066800.315336:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.315405:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.317877:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882984988288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24590us (24810us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066800.317901:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7105 00002000:00100000:0.0:1746066800.317911:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880095802a00 x1830882984988288/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.317921:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802a00 with x1830882984988288 ext(2097152->4194303) 00002000:00010000:0.0:1746066800.317926:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802a00 00000100:00100000:0.0:1746066800.320039:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.320073:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.320095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.320106:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.320122:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984989056 00000100:00100000:0.0:1746066800.320128:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984989056 00000100:00100000:0.0:1746066800.320158:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984989312 00000100:00100000:0.0:1746066800.320161:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984989312 00000100:00100000:0.0:1746066800.320170:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984989184 00000100:00100000:0.0:1746066800.320171:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984989184 00000100:00100000:0.0:1746066800.320185:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984989568 00000100:00100000:0.0:1746066800.320187:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984989568 00000100:00100000:0.0:1746066800.320197:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19130 00000100:00100000:0.0:1746066800.320204:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882984989056:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066800.320218:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.320232:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfaeb43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5d04 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.320251:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.320253:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.320314:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfaeb43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d04 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.320328:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfaeb43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d04 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.320379:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6000, rc 0) 00000100:00100000:0.0:1746066800.320449:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882984989056:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 204us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.320456:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19130 00000100:00100000:0.0:1746066800.320469:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19133 00000100:00100000:0.0:1746066800.320473:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882984989568:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066800.320478:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.320485:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5d20 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.320499:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.320500:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.320504:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d20 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.320511:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d20 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.320517:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6a00, rc 0) 00000100:00100000:0.0:1746066800.320531:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882984989568:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.320536:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19133 00000100:00100000:0.0:1746066800.326019:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.331445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.331494:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.332276:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.337440:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.339080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.340053:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.340864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.346092:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.348810:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.348866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.356562:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984992384 00000100:00100000:0.0:1746066800.356571:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984992384 00000100:00100000:0.0:1746066800.356625:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19139 00000100:00100000:0.0:1746066800.356634:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2014:x1830882984992384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066800.356656:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.356682:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfaeba5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5d51 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.356739:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984923776:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066800.357297:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.398279:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.422144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.433105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.433165:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.452548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.457251:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.469041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.474376:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.476272:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.487029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.487415:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.512762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.515328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.520836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.526627:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.575446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.579245:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.580318:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984996224 00000100:00100000:0.0:1746066800.580323:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984996224 00010000:00010000:0.0:1746066800.580339:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfaebc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d58 expref: 14 pid: 13370 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066800.580361:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8726 00000100:00100000:0.0:1746066800.580366:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882984996224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.580374:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.580538:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfaebc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d58 expref: 14 pid: 13370 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.580550:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfaebc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d58 expref: 14 pid: 13370 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.580565:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfaebc1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d58 expref: 14 pid: 13370 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066800.580578:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066800.580581:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfaec0e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066800.580589:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfaec0e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066800.580595:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfaec0e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066800.580624:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.580647:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882984996224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 281us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.580653:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8726 00000100:00100000:0.0:1746066800.591159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.595490:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.597460:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.606255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.607963:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.608026:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.614839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.629115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.634634:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.646627:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.652998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.670877:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.678316:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.680833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.682190:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.682261:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.682965:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.686497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.686525:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.693287:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.693385:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.695936:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.695968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.703691:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.705519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.710490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.711574:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066800.711971:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfaecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066800.711979:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfaecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066800.712037:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066800.712041:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066800.712055:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfaecd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066800.712082:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfaeccb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dd6 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.713785:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfaecd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dd6 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.713794:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066800.713796:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066800.713799:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984baa00, rc 0) 00000100:00100000:0.0:1746066800.713839:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2861:x1830882985001088:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9932us (10156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.713846:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17012 00000100:00100000:0.0:1746066800.718688:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.728211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.736585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.744738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.763259:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.773671:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.773707:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.773755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.774027:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8734 00000100:00100000:0.0:1746066800.774040:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985002752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.774058:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.774080:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d20 expref: 10 pid: 13726 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066800.774092:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d20 expref: 10 pid: 13726 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066800.774109:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6a00/0xf1867c21abfaeb58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d20 expref: 10 pid: 13726 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066800.774126:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.774160:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985002752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.774724:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8734 00000100:00100000:0.0:1746066800.779041:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.785015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.787189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.787382:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.798031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.801655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.821636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.824981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.895261:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.897621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.900582:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.902924:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.906143:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.916970:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.962622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.962687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.975430:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.975528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.978852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.981986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.986445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.991316:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.995451:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066800.996086:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.000351:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985006720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8243us (9034us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066801.000363:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7125 00002000:00100000:0.0:1746066801.000375:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5d7df80 x1830882985006720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.000386:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830882985006720 ext(2097152->3145727) 00002000:00010000:0.0:1746066801.000392:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7df80 00000100:00100000:0.0:1746066801.007702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.011815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066801.012013:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066801.014771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066801.015205:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066801.019988:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066801.023304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.031253:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.037727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.037769:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.043985:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.052321:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.055304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.057331:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985008768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18000us (19610us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066801.057341:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7131 00002000:00100000:0.0:1746066801.057351:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5764000 x1830882985008768/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.057362:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764000 with x1830882985008768 ext(2097152->4194303) 00002000:00010000:0.0:1746066801.057368:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5764000 00000100:00100000:0.0:1746066801.061956:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985009920 00000100:00100000:0.0:1746066801.061960:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985009920 00002000:00100000:0.0:1746066801.061984:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3891200->3895295) req@ffff8800966e1180 x1830882985009920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.061994:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882985009920 ext(3891200->3895295) 00010000:00010000:0.0:1746066801.061999:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 11 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.062014:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 11 pid: 12233 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746066801.062020:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e1180 00000100:00100000:0.0:1746066801.062040:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2058 00000100:00100000:0.0:1746066801.062044:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985009920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066801.062145:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985009920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 100us (660us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066801.062150:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2058 00002000:00100000:0.0:1746066801.062154:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3891200->3895295) req@ffff8800966e1180 x1830882985009920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.062160:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882985009920 ext(3891200->3895295) 00010000:00010000:0.0:1746066801.062164:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 11 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.062172:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 11 pid: 12233 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746066801.062485:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e1180 00000100:00100000:0.0:1746066801.066948:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.067974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.071762:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984930304:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066801.072428:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfaed88 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e69 expref: 13 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.072448:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:0.0:1746066801.072502:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2880:x1830882985010176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4707us (5564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.072511:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19168 00000100:00100000:0.0:1746066801.073318:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985010304:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4920us (5344us total) trans 17179875094 rc 0/0 00000100:00100000:0.0:1746066801.073330:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2059 00002000:00100000:0.0:1746066801.073338:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3891200->4194303) req@ffff88012c491f80 x1830882985010304/t17179875094(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.073347:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491f80 with x1830882985010304 ext(3891200->4194303) 00010000:00010000:0.0:1746066801.073354:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 13 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.073364:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfaed73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e54 expref: 13 pid: 12233 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746066801.073369:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c491f80 00000100:00100000:0.0:1746066801.075880:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.076555:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.082988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.107038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.107102:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.110941:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.121622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.122826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.126260:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.126412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.142949:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.178523:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.182619:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.186286:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.188307:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.194238:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.197337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.200670:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.206460:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.210294:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.211828:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.211873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.212013:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066801.212038:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746066801.212479:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066801.247415:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.247521:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.248001:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19175 00000100:00100000:0.0:1746066801.248007:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985015168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066801.248014:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.248023:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbea200/0xf1867c21abfaedb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5e9a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.248064:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984931968:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066801.248161:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.260037:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.260533:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.265167:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.268211:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.275624:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985015808 00000100:00100000:0.0:1746066801.275635:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985015808 00010000:00010000:0.0:1746066801.275697:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfaeda4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e85 expref: 31 pid: 12233 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066801.275770:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8755 00000100:00100000:0.0:1746066801.275778:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985015808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066801.275792:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066801.275812:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfaeda4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e85 expref: 31 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.275824:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfaeda4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e85 expref: 31 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.275849:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfaeda4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3891200->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e85 expref: 31 pid: 12233 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.275869:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.275871:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.275879:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfaedce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5eaf expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.275908:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfaedce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5eaf expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.275941:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfaedce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5eaf expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.275954:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984932608:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066801.276040:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.280131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.293015:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.296790:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.304990:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.318239:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.320121:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.320163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.337720:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.341715:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984933120:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066801.341739:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066801.342275:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985017216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4402us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.342287:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8757 00000100:00100000:0.0:1746066801.346986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.359441:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.364309:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.370379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.370416:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.370811:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8758 00000100:00100000:0.0:1746066801.370818:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985018240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066801.373446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.381392:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.381464:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.391972:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.392022:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.397669:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.399736:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.407432:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.412094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.424666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.427822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.431093:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.435275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.440128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.440169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.440393:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7148 00000100:00100000:0.0:1746066801.440400:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882985020544:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066801.461234:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985021056 00000100:00100000:0.0:1746066801.461238:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985021056 00000100:00100000:0.0:1746066801.464352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.465041:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985021440 00000100:00100000:0.0:1746066801.465045:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985021440 00000100:00100000:0.0:1746066801.465069:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17016 00000100:00100000:0.0:1746066801.465074:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2899:x1830882985021440:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066801.465087:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.465102:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaee29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5f0a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.465156:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfaee30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465170:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfaee30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465180:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfaee30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465196:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfaee37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465201:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfaee37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465206:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfaee37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465787:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaee3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465799:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 37 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.465806:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaed65 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e4d expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.465812:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaee3e lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.465840:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaed65 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e4d expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.465851:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaed65 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e4d expref: 19 pid: 7244 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066801.465861:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984934912:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066801.466439:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 37 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.466452:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 37 pid: 7244 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066801.466460:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984935040:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066801.466552:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.468324:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985021824 00000100:00100000:0.0:1746066801.468328:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985021824 00010000:00010000:0.0:1746066801.468355:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 38 pid: 7244 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066801.468431:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8762 00000100:00100000:0.0:1746066801.468437:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985021824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066801.468447:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066801.468453:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 38 pid: 7244 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.468462:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 38 pid: 7244 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.468482:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfaed0a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5e00 expref: 38 pid: 7244 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.468496:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066801.468500:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaee3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.468508:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaee3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.468513:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaee3e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066801.468517:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066801.468534:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985021824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.468539:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8762 00000100:00080000:0.0:1746066801.468557:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066801.468585:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.470567:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.470716:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.474662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.477554:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.477630:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.477688:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.479619:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.480974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.489257:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.489323:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985023616 00000100:00100000:0.0:1746066801.489330:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985023616 00002000:00100000:0.0:1746066801.489367:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e3480 x1830882985023616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.489377:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985023616 ext(3145728->4194303) 00002000:00010000:0.0:1746066801.489382:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066801.489398:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7150 00000100:00100000:0.0:1746066801.489404:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985023616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066801.496231:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.501493:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985024128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12082us (12194us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746066801.501502:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7151 00002000:00100000:0.0:1746066801.501513:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3149824->4194303) req@ffff8800966e0e00 x1830882985024128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.501521:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0e00 with x1830882985024128 ext(3149824->4194303) 00002000:00010000:0.0:1746066801.501526:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0e00 00000100:00100000:0.0:1746066801.503693:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.513502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.513550:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.526335:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.597664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.597759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.610590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.635915:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.635952:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985026432 00000100:00100000:0.0:1746066801.635957:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985026432 00010000:00010000:0.0:1746066801.635981:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfaeb5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d19 expref: 9 pid: 13726 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746066801.636011:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8768 00000100:00100000:0.0:1746066801.636017:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985026432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066801.636027:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066801.636044:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfaeb5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d19 expref: 9 pid: 13726 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746066801.636053:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfaeb5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d19 expref: 9 pid: 13726 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746066801.636071:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfaeb5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d19 expref: 9 pid: 13726 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746066801.636084:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066801.636100:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985026432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.636105:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8768 00000100:00100000:0.0:1746066801.638257:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.639828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.644294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.647437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.656199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.656691:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.663180:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.663863:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.675997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.676042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.680127:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.680171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.680196:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028480 00000100:00100000:0.0:1746066801.680205:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028480 00000100:00100000:0.0:1746066801.680245:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028608 00000100:00100000:0.0:1746066801.680247:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028608 00000100:00100000:0.0:1746066801.680263:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19198 00000100:00100000:0.0:1746066801.680270:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985028480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066801.680290:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.680308:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfaeec3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5f5e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.680362:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984936960:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066801.680435:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.697021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.702792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.725565:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985028864:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 22191us (22770us total) trans 17179875098 rc 0/0 00000100:00100000:0.0:1746066801.725578:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2070 00002000:00100000:0.0:1746066801.725592:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1167360->2052095) req@ffff8800986ce680 x1830882985028864/t17179875098(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.725602:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986ce680 with x1830882985028864 ext(1167360->2052095) 00010000:00010000:0.0:1746066801.725613:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011dd1ce00/0xf1867c21abfaeeb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f50 expref: 16 pid: 1893 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066801.725631:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011dd1ce00/0xf1867c21abfaeeb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f50 expref: 16 pid: 1893 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746066801.725638:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800986ce680 00000100:00100000:0.0:1746066801.729127:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.730782:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.739435:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.739637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.759532:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.787560:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.791189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.792944:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.794814:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.799686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.808728:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.852443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.858598:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.858660:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.861005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.868677:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.875963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.876566:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.880086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.885731:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984939264:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.885755:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.885770:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984939776:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.886269:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.886281:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984940288:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.886295:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.886309:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984939264:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.887229:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984939776:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.887236:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984940288:0@lo:400:kworker.0 00000100:00100000:0.0:1746066801.900295:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984940416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066801.900348:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.901256:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984940416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066801.932163:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066801.932180:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984940800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066801.932227:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.932501:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984940800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066801.973133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066801.991417:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.011872:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.012802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.012831:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.016740:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.016769:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.016820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066802.028272:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066802 -> 1746066803 00000100:00100000:0.0:1746066802.028294:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984941696:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066802.028332:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0de00/0xf1867c21abfaef3a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fc7 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.028343:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0de00/0xf1867c21abfaef3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fc7 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.028355:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0de00, rc 0) 00000100:00100000:0.0:1746066802.028386:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985033984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 11466us (11565us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066802.028393:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19212 00000100:00100000:0.0:1746066802.034669:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985034368 00000100:00100000:0.0:1746066802.034676:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985034368 00000100:00100000:0.0:1746066802.037230:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985034624 00000100:00100000:0.0:1746066802.037236:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985034624 00000100:00100000:0.0:1746066802.037264:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19215 00000100:00100000:0.0:1746066802.037269:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985034624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066802.037765:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.037776:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfaef4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5fdc expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.037819:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984941952:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066802.037869:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.041765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.045651:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985035136 00000100:00100000:0.0:1746066802.045661:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985035136 00000100:00100000:0.0:1746066802.045716:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19216 00000100:00100000:0.0:1746066802.045726:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2925:x1830882985035136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066802.045738:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.045760:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d5fe3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.045794:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfaef25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fb2 expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.045804:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066802.045806:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066802.045817:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fe3 expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.045842:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfaef25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fb2 expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.045861:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfaef25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fb2 expref: 34 pid: 13363 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.045871:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984942208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066802.045968:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.049383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.058561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.076434:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036032 00000100:00100000:0.0:1746066802.076442:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036032 00010000:00010000:0.0:1746066802.076474:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfaef10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f9d expref: 18 pid: 1893 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.076505:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036160 00000100:00100000:0.0:1746066802.076508:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036160 00010000:00010000:0.0:1746066802.076518:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfaef25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fb2 expref: 37 pid: 13363 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.076532:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8780 00000100:00100000:0.0:1746066802.076537:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985036032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.076549:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.076567:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfaef10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f9d expref: 18 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.076578:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfaef10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f9d expref: 18 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.076599:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfaef10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5f9d expref: 18 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.076617:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.076619:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.076625:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfaef5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fea expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.076633:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfaef5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fea expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.076674:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfaef5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fea expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.076687:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984942464:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066802.076742:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.080534:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.104711:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.117878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.141790:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.142327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.142360:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.142374:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.148819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.154215:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.154251:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985038464 00000100:00100000:0.0:1746066802.154256:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985038464 00010000:00010000:0.0:1746066802.154286:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfaea9b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c8d expref: 20 pid: 13363 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.154308:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8782 00000100:00100000:0.0:1746066802.154314:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985038464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.154325:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.154345:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfaea9b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c8d expref: 20 pid: 13363 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.154355:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfaea9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c8d expref: 20 pid: 13363 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.154380:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.154422:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985038464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.154428:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8782 00000100:00100000:0.0:1746066802.171367:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.173821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.186109:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985039360 00000100:00100000:0.0:1746066802.186118:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985039360 00002000:00100000:0.0:1746066802.186167:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1482752->1486847) req@ffff88009c774a80 x1830882985039360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.186177:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774a80 with x1830882985039360 ext(1482752->1486847) 00002000:00010000:0.0:1746066802.186184:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774a80 00000100:00100000:0.0:1746066802.186224:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7174 00000100:00100000:0.0:1746066802.186284:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985039360:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.190583:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7175 00000100:00100000:0.0:1746066802.190594:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985039616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066802.192071:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.230556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.237383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.243738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.252041:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.256114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.315036:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.319437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.321690:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985041280 00000100:00100000:0.0:1746066802.321697:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985041280 00010000:00010000:0.0:1746066802.321721:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfaeca8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dc1 expref: 6 pid: 1893 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066802.321754:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8787 00000100:00100000:0.0:1746066802.321761:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985041280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.321772:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.321786:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfaeca8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dc1 expref: 6 pid: 1893 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.321795:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfaeca8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dc1 expref: 6 pid: 1893 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.321813:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfaeca8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5dc1 expref: 6 pid: 1893 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.321836:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.321864:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985041280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 104us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.321870:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8787 00000100:00100000:0.0:1746066802.326237:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.332329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.336018:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.343504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.346776:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.351668:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.351717:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.354416:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066802.357496:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfaefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357504:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfaefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066802.357921:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066802.357926:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066802.357943:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfaefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357953:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfaefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357969:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357975:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357980:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357985:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.357991:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356a400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066802.357994:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358001:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358008:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066802.358011:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066802.358015:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358020:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfaefaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358043:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358048:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358052:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358057:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066802.358059:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358063:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358069:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5e80200) 00010000:00010000:0.0:1746066802.358071:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066802.358072:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358076:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfaefb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066802.358107:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b000/0xf1867c21abfaefa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6030 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.358118:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfaefb8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6030 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.358123:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.358125:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066802.358127:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ac00, rc 0) 00000100:00100000:0.0:1746066802.358164:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2939:x1830882985042432:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 11207us (11397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.358170:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17022 00000100:00100000:0.0:1746066802.362659:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.362695:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.362711:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.362729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.362741:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.362771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.368648:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.374194:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.374250:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.377478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.380008:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.385848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.389205:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.389256:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.394183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.399986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.401350:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19236 00000100:00100000:0.0:1746066802.401356:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985046144:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066802.401369:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097b32200/0xf1867c21abfaf036 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.401378:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfaef1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fab expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.401384:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.401390:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfaef41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fce expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.401399:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.401400:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.401402:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32200/0xf1867c21abfaf036 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.401415:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfaef41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fce expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.401421:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfaef41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fce expref: 36 pid: 11630 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066802.401427:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095874380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984946048:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066802.401972:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.401980:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 11 pid: 12233 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066802.401987:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984946432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066802.402007:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfaef1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fab expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.402013:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfaef1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fab expref: 17 pid: 13363 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.402025:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984946560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066802.402040:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.416685:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.416707:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985046784 00000100:00100000:0.0:1746066802.416712:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985046784 00010000:00010000:0.0:1746066802.416738:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 13 pid: 12233 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066802.416943:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985047168 00000100:00100000:0.0:1746066802.416945:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985047168 00010000:00010000:0.0:1746066802.416955:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfaef41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fce expref: 37 pid: 11630 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066802.417100:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8794 00000100:00100000:0.0:1746066802.417106:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985046784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.417118:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.417132:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 13 pid: 12233 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.417141:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 13 pid: 12233 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.417157:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac000/0xf1867c21abfaefcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6045 expref: 13 pid: 12233 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066802.417359:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.417373:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985046784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 267us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.417378:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8794 00000100:00100000:0.0:1746066802.417546:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985047296 00000100:00100000:0.0:1746066802.417549:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985047296 00000100:00100000:0.0:1746066802.419384:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.420619:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.420660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.420673:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.420973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.422496:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985046528 00000100:00100000:0.0:1746066802.422507:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985046528 00010000:00010000:0.0:1746066802.422536:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 17 pid: 1893 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.422568:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:0.0:1746066802.422574:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985046528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.422584:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.422599:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 17 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422609:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 17 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422627:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540000/0xf1867c21abfaea71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5c71 expref: 17 pid: 1893 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422656:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.422686:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985046528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.422693:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8802 00000100:00100000:0.0:1746066802.422706:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985048064 00000100:00100000:0.0:1746066802.422708:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985048064 00010000:00010000:0.0:1746066802.422718:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fe3 expref: 16 pid: 13363 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.422741:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8804 00000100:00100000:0.0:1746066802.422747:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985048064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.422753:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.422762:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fe3 expref: 16 pid: 13363 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422770:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fe3 expref: 16 pid: 13363 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422780:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009718c600/0xf1867c21abfaef56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5fe3 expref: 16 pid: 13363 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.422789:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.422790:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.422793:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422804:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422818:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.422835:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985048064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.422842:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8804 00010000:00010000:0.0:1746066802.422920:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422927:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422938:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422944:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422949:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422954:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356ba00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066802.422957:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422966:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422974:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.422979:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfaf04b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.423011:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985046272:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 20317us (20605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.423017:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19239 00000100:00100000:0.0:1746066802.425919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.429923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.433822:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.433852:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.434662:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985048832 00000100:00100000:0.0:1746066802.434666:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985048832 00010000:00010000:0.0:1746066802.434677:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfaec38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d89 expref: 24 pid: 13370 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.434696:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8810 00000100:00100000:0.0:1746066802.434700:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985048832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.434706:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.434709:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfaec38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d89 expref: 24 pid: 13370 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.434720:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfaec38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d89 expref: 24 pid: 13370 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.434730:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfaec38 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d5d89 expref: 24 pid: 13370 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746066802.434738:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.434741:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ebc00/0xf1867c21abfaf052 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066802.434745:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.434761:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985048832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.434766:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8810 00000100:00100000:0.0:1746066802.435476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.435614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.442049:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984948224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.443726:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.443743:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984948736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.443759:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.443768:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984949248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.443779:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.443786:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984949760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.443796:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066802.443857:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801880/2, rc 0, transno 17179875108 00000100:00100000:0.0:1746066802.443861:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984948224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.443901:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.443916:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985049472 00000100:00100000:0.0:1746066802.443919:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985049472 00000100:00100000:0.0:1746066802.443940:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17027 00000100:00100000:0.0:1746066802.443944:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2939:x1830882985049472:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066802.443955:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.443965:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33a00/0xf1867c21abfaf059 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d607d expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.444002:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33a00/0xf1867c21abfaf059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d607d expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.444012:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33a00/0xf1867c21abfaf059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d607d expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.444024:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.444026:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066802.444028:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33a00, rc 0) 00000100:00100000:0.0:1746066802.444978:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2939:x1830882985049472:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1030us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.444985:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17027 00000004:00080000:0.0:1746066802.445015:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493800/2, rc 0, transno 21474842493 00000100:00100000:0.0:1746066802.445019:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984948736:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.445026:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420700/2, rc 0, transno 21474842494 00000100:00100000:0.0:1746066802.445028:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984949248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.445034:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d800700/2, rc 0, transno 17179875110 00000100:00100000:0.0:1746066802.445037:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984949760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.450945:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.455426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.455579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.455721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.455832:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463222:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463261:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463290:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463313:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.463334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.464361:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19267 00000100:00100000:0.0:1746066802.464369:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985050752:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066802.464405:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985050752:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 38us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.464410:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19267 00000100:00100000:0.0:1746066802.472802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.472841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.472867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.472919:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.472934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.473002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.473645:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19272 00000100:00100000:0.0:1746066802.473652:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985051520:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066802.476929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.480328:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.480372:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.484085:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.484822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.488773:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.495255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.495725:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.495757:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.496262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.498338:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.498964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.505988:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.511007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.521349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.523349:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.523384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.523397:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.538402:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985057280 00000100:00100000:0.0:1746066802.538405:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985057280 00000100:00100000:0.0:1746066802.538526:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17034 00000100:00100000:0.0:1746066802.538532:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2949:x1830882985057280:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066802.538545:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.538557:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfaf178 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6102 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.538599:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfaf178 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6102 expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.538611:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfaf178 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6102 expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.538622:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.538625:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066802.538639:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:0.0:1746066802.538654:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2949:x1830882985057280:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.538659:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17034 00000100:00100000:0.0:1746066802.540651:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985058304 00000100:00100000:0.0:1746066802.540655:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985058304 00000100:00100000:0.0:1746066802.540676:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17035 00000100:00100000:0.0:1746066802.540680:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2939:x1830882985058304:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:0.0:1746066802.540707:0:13370:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.540723:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfaf067 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6084 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.540736:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.540739:0:13370:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066802.540769:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfaf1a9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066802.540778:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfaf0ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60c3 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.540783:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfaf14e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60f4 expref: 31 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.540792:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfaf1a9 lrc: 5/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066802.540815:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfaf14e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60f4 expref: 31 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.540825:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfaf14e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60f4 expref: 31 pid: 17253 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.540835:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ced180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984950528:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066802.540918:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfaf0ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60c3 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.540926:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfaf0ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d60c3 expref: 10 pid: 17253 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746066802.540933:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984950656:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066802.540957:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.550506:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.550550:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.551554:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985058944 00000100:00100000:0.0:1746066802.551558:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985058944 00000100:00100000:0.0:1746066802.551582:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17036 00000100:00100000:0.0:1746066802.551587:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2947:x1830882985058944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066802.551608:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.551620:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497200/0xf1867c21abfaf1b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d613a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.551681:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098497200/0xf1867c21abfaf1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d613a expref: 34 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.551931:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497200/0xf1867c21abfaf1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d613a expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.551951:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066802.551954:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066802.551956:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497200, rc 0) 00000100:00100000:0.0:1746066802.551989:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2947:x1830882985058944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 401us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.551995:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17036 00000100:00100000:0.0:1746066802.553920:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.554546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.554579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.557850:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984951424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.557872:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.557906:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984951936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.557928:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.557936:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.557948:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.557953:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.557967:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.557976:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066802.557980:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.558004:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984951936 00000100:00100000:0.0:1746066802.558007:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984951936 00000100:00100000:0.0:1746066802.558020:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984952448 00000100:00100000:0.0:1746066802.558022:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984952448 00000100:00100000:0.0:1746066802.558029:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984952960 00000100:00100000:0.0:1746066802.558031:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984952960 00000100:00100000:0.0:1746066802.558038:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984951680 00000100:00100000:0.0:1746066802.558040:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984951680 00000100:00100000:0.0:1746066802.558048:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984952192 00000100:00100000:0.0:1746066802.558050:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984952192 00000100:00100000:0.0:1746066802.558060:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19289 00000100:00100000:0.0:1746066802.558065:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3777:x1830882984951296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066802.558111:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066802.558114:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066803 -> 1746066803 00002000:00010000:0.0:1746066802.558116:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066801 -> 1746066801 00002000:00010000:0.0:1746066802.558118:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066803 -> 1746066803 00002000:00010000:0.0:1746066802.558120:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066802.558147:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984951296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (361us total) trans 21474842496 rc 0/0 00000100:00100000:0.0:1746066802.558153:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19289 00000100:00100000:0.0:1746066802.558166:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19292 00000100:00100000:0.0:1746066802.558170:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3775:x1830882984951424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066802.558203:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066802.558206:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066803 -> 1746066803 00002000:00010000:0.0:1746066802.558207:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066803 -> 1746066803 00002000:00010000:0.0:1746066802.558209:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066803 -> 1746066803 00002000:00010000:0.0:1746066802.558211:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066802.558231:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984951424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (358us total) trans 21474842497 rc 0/0 00000100:00100000:0.0:1746066802.558236:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19292 00000100:00100000:0.0:1746066802.558247:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19295 00000100:00100000:0.0:1746066802.558252:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984952960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.558305:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984952960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (336us total) trans 21474842499 rc 0/0 00000100:00100000:0.0:1746066802.558311:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19295 00000100:00100000:0.0:1746066802.558322:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19298 00000100:00100000:0.0:1746066802.558328:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3777:x1830882984952704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.558366:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066802.558390:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cf100/2, rc 0, transno 21474842497 00000100:00100000:0.0:1746066802.558393:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984951424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558401:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710e00/2, rc 0, transno 17179875114 00000100:00100000:0.0:1746066802.558404:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984951936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066802.558410:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cdf80/2, rc 0, transno 21474842498 00000100:00100000:0.0:1746066802.558413:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558418:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4e300/2, rc 0, transno 21474842499 00000100:00100000:0.0:1746066802.558420:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558436:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e1500/2, rc 0, transno 21474842500 00000100:00100000:0.0:1746066802.558439:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984952576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558446:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cea00/2, rc 0, transno 21474842496 00000100:00100000:0.0:1746066802.558449:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984951296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558456:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710380/2, rc 0, transno 17179875115 00000100:00100000:0.0:1746066802.558459:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984951680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066802.558465:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713100/2, rc 0, transno 17179875116 00000100:00100000:0.0:1746066802.558468:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984952192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066802.558481:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e0a80/2, rc 0, transno 21474842502 00000100:00100000:0.0:1746066802.558484:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984952832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066802.558518:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984952704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (457us total) trans 21474842501 rc 0/0 00000100:00100000:0.0:1746066802.558524:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19298 00000004:00080000:0.0:1746066802.558544:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2d80/2, rc 0, transno 21474842501 00000100:00100000:0.0:1746066802.558547:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984952704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066802.558737:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713b80/2, rc 0, transno 17179875118 00000100:00100000:0.0:1746066802.558741:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984951808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066802.558751:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710000/2, rc 0, transno 17179875119 00000100:00100000:0.0:1746066802.558754:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984952320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066802.562022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.562069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.562096:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985059712 00000100:00100000:0.0:1746066802.562105:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985059712 00000100:00100000:0.0:1746066802.562144:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985059840 00000100:00100000:0.0:1746066802.562146:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985059840 00000100:00100000:0.0:1746066802.562172:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6375 00000100:00100000:0.0:1746066802.562180:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2946:x1830882985059712:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066802.562284:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2946:x1830882985059712:12345-192.168.204.16@tcp:49:cat.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.562290:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6375 00000100:00100000:0.0:1746066802.562329:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6376 00000100:00100000:0.0:1746066802.562332:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2947:x1830882985059840:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066802.562354:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2947:x1830882985059840:12345-192.168.204.16@tcp:49:cat.0 Request processed in 21us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.562358:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6376 00000100:00100000:0.0:1746066802.562392:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.562405:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985059968 00000100:00100000:0.0:1746066802.562407:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985059968 00000100:00100000:0.0:1746066802.562420:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6377 00000100:00100000:0.0:1746066802.562424:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2939:x1830882985059968:12345-192.168.204.16@tcp:49:lfs.0 00000100:00100000:0.0:1746066802.562450:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2939:x1830882985059968:12345-192.168.204.16@tcp:49:lfs.0 Request processed in 26us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.562455:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6377 00000100:00100000:0.0:1746066802.563321:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.564496:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565138:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565151:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.565237:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.568198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.569940:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.569966:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.569992:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.570179:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.570199:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.573946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.573977:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.607031:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.612127:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.613658:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985063040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36449us (39675us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066802.613666:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7198 00002000:00100000:0.0:1746066802.613673:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958a4a80 x1830882985063040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.613681:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882985063040 ext(1048576->2097151) 00002000:00010000:0.0:1746066802.613686:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:0.0:1746066802.619015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.621188:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.623419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.626775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.653344:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985065728 00000100:00100000:0.0:1746066802.653350:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985065728 00002000:00100000:0.0:1746066802.653371:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88011f711880 x1830882985065728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.653376:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711880 with x1830882985065728 ext(1048576->2097151) 00002000:00010000:0.0:1746066802.653379:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f711880 00000100:00100000:0.0:1746066802.653393:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7201 00000100:00100000:0.0:1746066802.653397:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985065728:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.671751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.671802:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.680176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.706453:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.719259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.723278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.724267:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.724287:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.727524:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.731192:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.735003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.741917:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.741964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.756552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.764368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.821327:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.831429:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.840338:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.843266:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.846713:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.846759:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.852825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.852917:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.865597:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.875576:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.875605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.875642:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.875672:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.875708:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19318 00000100:00100000:0.0:1746066802.875717:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985071104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066802.876192:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.876204:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096196a00/0xf1867c21abfaf290 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d61aa expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.876229:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984956160:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066802.876255:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.883117:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.883862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.885233:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.887905:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.904065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.910528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.911740:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.918182:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.922055:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.938250:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.953745:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.953792:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.980039:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.980676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.996813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066802.998733:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.031290:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.031346:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066803.033181:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066803.033184:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066803.037390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.037416:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.039865:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d25500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984957184:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066803.039880:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.039928:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985075200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2126us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.039936:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8833 00000100:00100000:0.0:1746066803.040566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.047650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.056293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.064670:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.069687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.073557:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984957696:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066803.073583:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009575aa00/0xf1867c21abfaf2eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3911680->4194303] (req 3911680->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61e9 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.073597:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575aa00, rc 0) 00000100:00100000:0.0:1746066803.073661:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2966:x1830882985075968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3172us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.073669:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19326 00000100:00100000:0.0:1746066803.085421:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.091719:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.102962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.105391:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.109549:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.113644:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.123384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.132206:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.132645:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984958208 00000100:00100000:0.0:1746066803.132649:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984958208 00000100:00100000:0.0:1746066803.132907:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1746066803.132914:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984958208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746066803.132925:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1196374464 pending 4669440 free 3909910528 avail 3678388224 00000100:00100000:0.0:1746066803.133007:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984958208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.133012:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1746066803.142816:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066803.143268:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066803.150229:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077888 00000100:00100000:0.0:1746066803.150237:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077888 00000100:00100000:0.0:1746066803.150274:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17046 00000100:00100000:0.0:1746066803.150282:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2973:x1830882985077888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066803.150319:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.150336:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfaf2f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d61f7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.150389:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfaf300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150399:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfaf300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150408:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfaf300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150418:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3200/0xf1867c21abfaf307 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150424:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3200/0xf1867c21abfaf307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150429:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3200/0xf1867c21abfaf307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150487:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfaf30e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150496:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfaf282 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61a3 expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.150501:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfaf30e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.150526:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfaf282 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61a3 expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.150537:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfaf282 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61a3 expref: 33 pid: 7243 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.150547:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984958336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066803.152515:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.153777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066803.154837:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066803.157268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.161332:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.162826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.162868:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.166689:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.169174:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066803.169827:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfaf331 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.169833:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfaf331 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066803.169855:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066803.170013:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfaf32a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6213 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.170039:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfaf331 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6213 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.170045:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066803.170048:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066803.170050:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751400, rc 0) 00000100:00100000:0.0:1746066803.170069:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2973:x1830882985078912:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3111us (3386us total) trans 8589937508 rc 0/0 00000100:00100000:0.0:1746066803.170074:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17047 00000100:00100000:0.0:1746066803.171576:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.173743:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.177214:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.177262:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.181931:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.185166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.185235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.185258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.185477:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.186190:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.186264:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.186278:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985080576 00000100:00100000:0.0:1746066803.186281:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985080576 00000100:00100000:0.0:1746066803.186302:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19337 00000100:00100000:0.0:1746066803.186307:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985080576:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066803.186322:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3200/0xf1867c21abfaf38c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.186347:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfaf2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61f0 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.186352:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066803.186354:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066803.186356:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3200/0xf1867c21abfaf38c lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.186373:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfaf2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61f0 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.186381:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfaf2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61f0 expref: 23 pid: 9590 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.186390:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984960512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066803.186409:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.188574:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984959232:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066803.201181:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201266:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201280:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201309:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201338:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201415:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984959360:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066803.201443:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfaf370 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.201471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201492:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201501:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.201533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.220611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.225841:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.230748:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985083136 00000100:00100000:0.0:1746066803.230754:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985083136 00010000:00010000:0.0:1746066803.230779:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfaf1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d614f expref: 34 pid: 10125 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.230798:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985083264 00000100:00100000:0.0:1746066803.230800:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985083264 00010000:00010000:0.0:1746066803.230807:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfaf1cc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6148 expref: 16 pid: 13370 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.230821:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985083008 00000100:00100000:0.0:1746066803.230823:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985083008 00010000:00010000:0.0:1746066803.230829:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf2ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61bf expref: 17 pid: 7243 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.230839:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8855 00000100:00100000:0.0:1746066803.230845:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985083136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.230854:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.230858:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfaf1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d614f expref: 34 pid: 10125 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.230866:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfaf1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d614f expref: 34 pid: 10125 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.230902:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfaf1d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d614f expref: 34 pid: 10125 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.230916:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066803.230919:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfaf39a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.230926:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.231012:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985083136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.231020:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8855 00000100:00100000:0.0:1746066803.231034:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8856 00000100:00100000:0.0:1746066803.231039:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985083264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.231046:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.231050:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfaf1cc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6148 expref: 17 pid: 13370 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231057:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfaf1cc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6148 expref: 17 pid: 13370 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231067:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfaf1cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6148 expref: 17 pid: 13370 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231075:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066803.231078:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfaf39a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.231083:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.231096:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985083264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.231101:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8856 00000100:00100000:0.0:1746066803.231110:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8857 00000100:00100000:0.0:1746066803.231115:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985083008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.231121:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.231124:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf2ba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61bf expref: 15 pid: 7243 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231131:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf2ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61bf expref: 15 pid: 7243 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231140:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf2ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d61bf expref: 15 pid: 7243 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.231148:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066803.231150:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfaf39a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066803.231155:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.231167:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985083008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.231172:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8857 00000100:00100000:0.0:1746066803.231203:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066803.236626:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066803.236711:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984962944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.236741:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.237229:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984963456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.237247:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.237261:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984962560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.237273:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.237280:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984963072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.237290:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.237296:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066803.237300:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984962688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.237309:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.237314:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984963200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.237324:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746066803.237332:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066803.237394:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984961664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (1426us total) trans 21474842510 rc 0/0 00000100:00100000:0.0:1746066803.237401:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19339 00000100:00100000:0.0:1746066803.237525:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19343 00000100:00100000:0.0:1746066803.237530:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3777:x1830882984961920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.237588:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984961920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1495us total) trans 21474842514 rc 0/0 00000100:00100000:0.0:1746066803.237592:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19343 00000100:00100000:0.0:1746066803.237731:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19345 00000100:00100000:0.0:1746066803.237736:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3777:x1830882984961792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.237781:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3777:x1830882984961792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1627us total) trans 21474842516 rc 0/0 00000100:00100000:0.0:1746066803.238269:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19345 00000004:00080000:0.0:1746066803.238294:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e423800/2, rc 0, transno 17179875126 00000100:00100000:0.0:1746066803.238300:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984962944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.238306:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764a80/2, rc 0, transno 17179875127 00000100:00100000:0.0:1746066803.238320:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984963456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.238327:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d24700/2, rc 0, transno 21474842516 00000100:00100000:0.0:1746066803.238330:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984961792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.238335:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d25f80/2, rc 0, transno 21474842517 00000100:00100000:0.0:1746066803.238342:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984962304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.238348:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d26a00/2, rc 0, transno 21474842514 00000100:00100000:0.0:1746066803.238351:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984961920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.238356:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d25500/2, rc 0, transno 21474842515 00000100:00100000:0.0:1746066803.238358:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984962432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.238391:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984963584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.238408:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066803.238442:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094378a80/2, rc 0, transno 17179875130 00000100:00100000:0.0:1746066803.238445:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984962688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.238451:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765500/2, rc 0, transno 17179875131 00000100:00100000:0.0:1746066803.238453:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984963200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.238458:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095875880/2, rc 0, transno 17179875128 00000100:00100000:0.0:1746066803.238460:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984962560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.238465:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e422300/2, rc 0, transno 17179875129 00000100:00100000:0.0:1746066803.238467:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984963072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.241593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.247573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.249967:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.250317:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.250425:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.251578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.251817:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.251831:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985084032 00000100:00100000:0.0:1746066803.251834:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985084032 00000100:00100000:0.0:1746066803.251860:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19360 00000100:00100000:0.0:1746066803.251864:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985084032:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066803.251871:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.251879:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfaf3d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6252 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066803.251911:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd73, atime: 0x6812dd73, ctime: 0x6812dd73, blocks: 0x800 00010000:00010000:0.0:1746066803.251919:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.251920:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.251924:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfaf3d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6252 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.251932:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfaf3d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6252 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.251939:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9000, rc 0) 00000100:00100000:0.0:1746066803.251952:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985084032:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 88us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.252384:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19360 00000100:00100000:0.0:1746066803.255611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.255652:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.255679:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.255691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.256168:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.256703:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260220:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260256:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260271:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.260595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.264512:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.264804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.266601:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086848 00000100:00100000:0.0:1746066803.266608:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086848 00000100:00100000:0.0:1746066803.266660:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7223 00000100:00100000:0.0:1746066803.266666:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985086848:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066803.266687:0:20360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf3ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.266698:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.266700:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.266703:0:20360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf3ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.266713:0:20360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0c00/0xf1867c21abfaf3ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.269418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.270036:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985087488 00000100:00100000:0.0:1746066803.270040:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985087488 00000100:00100000:0.0:1746066803.270079:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7226 00000100:00100000:0.0:1746066803.270084:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985087488:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066803.270104:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.270114:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.270115:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.270118:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.270132:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275374:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275388:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275393:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275398:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80ea00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066803.275401:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275405:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275418:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.275422:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfaf3e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.275795:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985086208:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11053us (11285us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066803.275810:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7221 00010000:00010000:0.0:1746066803.286808:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286827:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286835:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286841:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066803.286845:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286853:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286869:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.286875:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfaf403 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.287048:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985087488:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16954us (17028us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066803.287059:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7226 00000100:00100000:0.0:1746066803.298047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.299881:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.299940:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.299962:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.299995:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.300411:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.300422:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985088640 00000100:00100000:0.0:1746066803.300424:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985088640 00000100:00100000:0.0:1746066803.300547:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19378 00000100:00100000:0.0:1746066803.300552:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985088640:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066803.300589:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066803.300591:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066803 -> 1746066804 00002000:00010000:0.0:1746066803.300593:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066803 -> 1746066804 00002000:00010000:0.0:1746066803.300595:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066803 -> 1746066804 00002000:00010000:0.0:1746066803.300597:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066803.300625:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985088640:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 60us (201us total) trans 21474842520 rc 0/0 00000100:00100000:0.0:1746066803.300630:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19378 00000100:00100000:0.0:1746066803.302163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.305539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.314682:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.314838:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.315219:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.315235:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.315312:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.315328:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.315336:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.315347:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.315356:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066803.315359:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.315371:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.315377:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.315388:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066803.315913:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dee680/2, rc 0, transno 21474842522 00000100:00100000:0.0:1746066803.315917:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.315924:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095deea00/2, rc 0, transno 21474842521 00000100:00100000:0.0:1746066803.315926:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.315934:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d180/2, rc 0, transno 17179875143 00000100:00100000:0.0:1746066803.315940:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.315946:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dec700/2, rc 0, transno 17179875144 00000100:00100000:0.0:1746066803.315948:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.315989:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d500/2, rc 0, transno 17179875142 00000100:00100000:0.0:1746066803.315992:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984963968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.315997:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dec380/2, rc 0, transno 17179875141 00000100:00100000:0.0:1746066803.315999:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984964480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.316104:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095ded880/2, rc 0, transno 21474842523 00000100:00100000:0.0:1746066803.316107:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984964992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.316180:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dedc00/2, rc 0, transno 21474842524 00000100:00100000:0.0:1746066803.316183:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984965120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.316232:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984964736 00000100:00100000:0.0:1746066803.316236:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984964736 00000100:00100000:0.0:1746066803.316289:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984965248 00000100:00100000:0.0:1746066803.316799:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984965248 00000100:00100000:0.0:1746066803.316817:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19395 00000100:00100000:0.0:1746066803.316821:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3774:x1830882984965248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.316878:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984965248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (642us total) trans 21474842527 rc 0/0 00000100:00100000:0.0:1746066803.316901:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19395 00000100:00100000:0.0:1746066803.316960:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.319026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.333047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.336322:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.338248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.345504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.345549:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.345597:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.348329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.349331:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.362244:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.364703:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.366708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.370061:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.371573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.379969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.385166:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.389355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.401794:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.427333:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.434621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.439090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.445820:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.455107:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.470218:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.470336:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.471157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.471177:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985095424 00000100:00100000:0.0:1746066803.471181:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985095424 00002000:00100000:0.0:1746066803.471209:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880094375c00 x1830882985095424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.471219:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094375c00 with x1830882985095424 ext(1048576->2097151) 00002000:00010000:0.0:1746066803.471223:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094375c00 00000100:00100000:0.0:1746066803.471241:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7236 00000100:00100000:0.0:1746066803.471248:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985095424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066803.488009:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.488050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.488317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.490179:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.497826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.497865:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.503250:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984966528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.503320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.503342:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984967040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.503361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.503381:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984967680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.503403:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984966656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.503911:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.503931:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984967168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.503949:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.503968:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984967808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.503991:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984966656 00000100:00100000:0.0:1746066803.503996:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984966656 00000100:00100000:0.0:1746066803.504022:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984967296 00000100:00100000:0.0:1746066803.504024:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984967296 00000100:00100000:0.0:1746066803.504036:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984966912 00000100:00100000:0.0:1746066803.504038:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984966912 00000100:00100000:0.0:1746066803.504045:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984967552 00000100:00100000:0.0:1746066803.504047:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984967552 00000100:00100000:0.0:1746066803.504057:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19411 00000100:00100000:0.0:1746066803.504064:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3777:x1830882984966656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066803.504160:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066803.504163:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.504165:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.504167:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.504168:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066803.504196:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3777:x1830882984966656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (315us total) trans 17179875148 rc 0/0 00000100:00100000:0.0:1746066803.505339:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19411 00000100:00100000:0.0:1746066803.505358:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984967680 00000100:00100000:0.0:1746066803.505362:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984967680 00000100:00100000:0.0:1746066803.505386:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19420 00000100:00100000:0.0:1746066803.505391:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882984967680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066803.505456:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066803.505459:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.505461:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.505462:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066803.505464:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066803.506337:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984967680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 943us (1082us total) trans 21474842533 rc 0/0 00000100:00100000:0.0:1746066803.506346:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19420 00000100:00100000:0.0:1746066803.506387:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066803.506413:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984968320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.506436:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066803.506488:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094377480/2, rc 0, transno 17179875148 00000100:00100000:0.0:1746066803.506493:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984966656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066803.506503:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094374a80/2, rc 0, transno 17179875152 00000100:00100000:0.0:1746066803.506505:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984967168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066803.506520:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19425 00000100:00100000:0.0:1746066803.506527:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882984968320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.506606:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882984968320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (169us total) trans 21474842536 rc 0/0 00000100:00100000:0.0:1746066803.506621:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19425 00000004:00080000:0.0:1746066803.506644:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803800/2, rc 0, transno 21474842535 00000100:00100000:0.0:1746066803.506647:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984967808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066803.506653:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7c000/2, rc 0, transno 21474842536 00000100:00100000:0.0:1746066803.506656:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984968320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066803.508651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.517810:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.526281:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.526329:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.526377:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.528944:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.532664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.532718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.540117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.554379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.556037:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.556329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.556953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.557542:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.561418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.561543:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.561561:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099776 00000100:00100000:0.0:1746066803.561566:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099776 00000100:00100000:0.0:1746066803.561596:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19431 00000100:00100000:0.0:1746066803.561601:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2979:x1830882985099776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066803.561623:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.561639:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d632b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.561657:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.561659:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.561663:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->3915775] (req 3145728->3915775) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.561676:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->3915775] (req 3145728->3915775) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.561683:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70200, rc 0) 00000100:00100000:0.0:1746066803.561697:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2979:x1830882985099776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 97us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.561702:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19431 00000100:00100000:0.0:1746066803.561732:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.561794:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.564228:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.567076:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985099648:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5320us (5655us total) trans 17179875156 rc 0/0 00000100:00100000:0.0:1746066803.567088:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2096 00002000:00100000:0.0:1746066803.567100:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3911680->4194303) req@ffff8800930e1880 x1830882985099648/t17179875156(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.567109:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e1880 with x1830882985099648 ext(3911680->4194303) 00010000:00010000:0.0:1746066803.567118:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.567131:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746066803.567137:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930e1880 00000100:00100000:0.0:1746066803.570356:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100288 00000100:00100000:0.0:1746066803.570364:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100288 00010000:00010000:0.0:1746066803.570390:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.570416:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8871 00000100:00100000:0.0:1746066803.570422:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985100288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.570434:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.570454:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.570464:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.570485:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfaf537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3911680->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d630f expref: 42 pid: 12237 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.570507:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.570509:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.570516:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 41 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.570524:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 41 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.570531:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.570532:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.570535:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.570547:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.570576:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.570588:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984970240:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066803.570682:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 41 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.570691:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984970368:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066803.570782:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.574678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.575739:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.577573:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985101056 00000100:00100000:0.0:1746066803.577578:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985101056 00002000:00100000:0.0:1746066803.577618:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880095dd6300 x1830882985101056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.577627:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882985101056 ext(3145728->4194303) 00002000:00010000:0.0:1746066803.577632:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6300 00000100:00100000:0.0:1746066803.577658:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7244 00000100:00100000:0.0:1746066803.577664:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985101056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066803.597573:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.600106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.601570:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985102080:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 3636us (4001us total) trans 0 rc 278528/278528 00000100:00100000:0.0:1746066803.601654:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7246 00002000:00100000:0.0:1746066803.601664:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3915776->4194303) req@ffff8800a5824700 x1830882985102080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 278528/278528 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.601672:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5824700 with x1830882985102080 ext(3915776->4194303) 00010000:00010000:0.0:1746066803.601679:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 39 pid: 9592 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.601689:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 39 pid: 9592 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746066803.601695:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5824700 00000100:00100000:0.0:1746066803.602050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.602063:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102336 00000100:00100000:0.0:1746066803.602067:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102336 00002000:00100000:0.0:1746066803.602089:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3915775) req@ffff8800a5824e00 x1830882985102336/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.602096:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5824e00 with x1830882985102336 ext(3145728->3915775) 00010000:00010000:0.0:1746066803.602445:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 39 pid: 9592 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.602454:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 39 pid: 9592 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746066803.602467:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5824e00 00000100:00100000:0.0:1746066803.605818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.605858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.605909:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102464 00000100:00100000:0.0:1746066803.605917:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102464 00000100:00100000:0.0:1746066803.612660:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985102336:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9972us (10595us total) trans 21474842537 rc 0/0 00000100:00100000:0.0:1746066803.612674:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2097 00002000:00100000:0.0:1746066803.612688:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3915775) req@ffff8800a5824e00 x1830882985102336/t21474842537(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.612698:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5824e00 with x1830882985102336 ext(3145728->3915775) 00010000:00010000:0.0:1746066803.612709:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 41 pid: 9592 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746066803.612723:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70200/0xf1867c21abfaf553 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d632b expref: 41 pid: 9592 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746066803.612731:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5824e00 00000100:00100000:0.0:1746066803.612775:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102848 00000100:00100000:0.0:1746066803.612784:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102848 00002000:00100000:0.0:1746066803.612817:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5b01c00 x1830882985102848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.612824:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01c00 with x1830882985102848 ext(4194304->4861951) 00002000:00010000:0.0:1746066803.612827:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b01c00 00000100:00100000:0.0:1746066803.612842:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7247 00000100:00100000:0.0:1746066803.612850:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985102848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066803.616403:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.626709:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.628778:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103744 00000100:00100000:0.0:1746066803.628782:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103744 00000100:00100000:0.0:1746066803.628804:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19438 00000100:00100000:0.0:1746066803.628809:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985103744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066803.628818:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.628828:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c4000/0xf1867c21abfaf584 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d635c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.628845:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c4000/0xf1867c21abfaf584 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d635c expref: 41 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.628853:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4000/0xf1867c21abfaf584 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d635c expref: 41 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.628978:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c4000, rc 0) 00000100:00100000:0.0:1746066803.629002:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985103744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 192us (511us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066803.629007:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19438 00000100:00100000:0.0:1746066803.633116:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.633267:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.644981:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.645035:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.650432:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.650575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.714138:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.744031:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.747367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.749414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.749430:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105536 00000100:00100000:0.0:1746066803.749435:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105536 00010000:00010000:0.0:1746066803.749456:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfaf3b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d624b expref: 13 pid: 12237 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746066803.749474:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8874 00000100:00100000:0.0:1746066803.749479:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985105536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.749489:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.749502:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfaf3b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d624b expref: 13 pid: 12237 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746066803.749510:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfaf3b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d624b expref: 13 pid: 12237 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746066803.749525:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfaf3b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d624b expref: 13 pid: 12237 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746066803.749540:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.749553:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985105536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.749558:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8874 00000100:00100000:0.0:1746066803.749597:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105408 00000100:00100000:0.0:1746066803.749600:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105408 00010000:00010000:0.0:1746066803.749621:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3c00/0xf1867c21abfaf4d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d62b4 expref: 28 pid: 9591 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746066803.751966:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.818811:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.858852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.858921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.860002:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.866085:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985107200 00000100:00100000:0.0:1746066803.866097:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985107200 00002000:00100000:0.0:1746066803.866149:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880097c03100 x1830882985107200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.866164:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03100 with x1830882985107200 ext(0->1048575) 00002000:00010000:0.0:1746066803.866170:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03100 00000100:00100000:0.0:1746066803.866259:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7252 00000100:00100000:0.0:1746066803.866267:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985107200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066803.876241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.876325:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.879616:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985107200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13328us (13565us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066803.879629:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7252 00002000:00100000:0.0:1746066803.879642:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880097c03100 x1830882985107200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.879652:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03100 with x1830882985107200 ext(0->1048575) 00002000:00010000:0.0:1746066803.879658:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03100 00000100:00100000:0.0:1746066803.892651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.892691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.892716:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.892745:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.892798:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985107968 00000100:00100000:0.0:1746066803.892806:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985107968 00002000:00100000:0.0:1746066803.892858:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c4e00 x1830882985107968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 504/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.892868:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4e00 with x1830882985107968 ext(1048576->2097151) 00002000:00010000:0.0:1746066803.892874:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c4e00 00000100:00100000:0.0:1746066803.892917:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985108224 00000100:00100000:0.0:1746066803.892920:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985108224 00002000:00100000:0.0:1746066803.892931:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c5180 x1830882985108224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.892938:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5180 with x1830882985108224 ext(1048576->2097151) 00002000:00010000:0.0:1746066803.892941:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5180 00000100:00100000:0.0:1746066803.892951:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985108480 00000100:00100000:0.0:1746066803.892953:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985108480 00002000:00100000:0.0:1746066803.892966:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a59c5500 x1830882985108480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.892972:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5500 with x1830882985108480 ext(1048576->2097151) 00002000:00010000:0.0:1746066803.892975:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5500 00000100:00100000:0.0:1746066803.893071:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7254 00000100:00100000:0.0:1746066803.893079:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985108224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066803.894383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.909636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.923337:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.930100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.935712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.935750:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.935782:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.937239:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7260 00000100:00100000:0.0:1746066803.937246:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985109760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066803.952207:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.952414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.961951:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.965359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.966293:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985110784:12345-192.168.204.16@tcp:4:cat.0 Request processed in 702us (937us total) trans 17179875157 rc 0/0 00000100:00100000:0.0:1746066803.966301:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2099 00002000:00100000:0.0:1746066803.966311:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3133440->3145727) req@ffff8800a59c7800 x1830882985110784/t17179875157(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 12776/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.966319:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7800 with x1830882985110784 ext(3133440->3145727) 00010000:00010000:0.0:1746066803.966324:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b000/0xf1867c21abfaf530 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6308 expref: 25 pid: 12237 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066803.966333:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b000/0xf1867c21abfaf530 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6308 expref: 25 pid: 12237 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746066803.966338:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a59c7800 00000100:00100000:0.0:1746066803.967324:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.970512:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.972448:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.972488:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.973766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.976706:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.977770:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.977806:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.977872:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.981850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.981916:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.981946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.981971:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.983252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.989032:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.991913:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066803.991947:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066803.993734:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066803.993742:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066803.993761:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066803.993913:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576bc00/0xf1867c21abfaf672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6412 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.993989:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6412 expref: 15 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.993996:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066803.993998:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066803.994001:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:0.0:1746066803.994022:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3002:x1830882985112960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9678us (10771us total) trans 8589937526 rc 0/0 00000100:00100000:0.0:1746066803.994029:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17066 00000100:00100000:0.0:1746066803.995648:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985112320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12872us (13691us total) trans 21474842539 rc 0/0 00000100:00100000:0.0:1746066803.995659:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2102 00002000:00100000:0.0:1746066803.995671:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2981887) req@ffff8800a59c4380 x1830882985112320/t21474842539(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.995682:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4380 with x1830882985112320 ext(2097152->2981887) 00010000:00010000:0.0:1746066803.995692:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfaf54c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6324 expref: 31 pid: 12237 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066803.995706:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfaf54c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6324 expref: 31 pid: 12237 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746066803.995713:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a59c4380 00000100:00100000:0.0:1746066804.000337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.021375:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.021465:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.027334:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.030765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.037143:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.037420:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066804.037771:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066804.038221:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115008 00000100:00100000:0.0:1746066804.038228:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115008 00000100:00100000:0.0:1746066804.038349:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17067 00000100:00100000:0.0:1746066804.038356:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+6:3005:x1830882985115008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.038376:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.038392:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfaf695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6427 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.038448:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038459:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038467:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038478:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038483:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038488:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038562:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038572:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6412 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.038578:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.038619:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6412 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.038629:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfaf679 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6412 expref: 14 pid: 17253 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.038641:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984973056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.038698:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.040949:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984973056:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.040970:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066804.041042:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.042473:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066804.042615:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042622:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066804.042681:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066804.042685:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066804.042699:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042710:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042721:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042726:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042735:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042741:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042745:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066804.042748:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042754:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042767:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066804.042770:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.042773:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042778:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf69c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042795:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042800:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042804:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042807:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066804.042809:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042816:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042822:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476400) 00010000:00010000:0.0:1746066804.042824:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.042826:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042830:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.042864:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfaf695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6427 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.042875:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf6aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6427 expref: 7 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.042881:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.043210:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066804.043213:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:0.0:1746066804.048331:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.050022:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115648 00000100:00100000:0.0:1746066804.050030:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115648 00000100:00100000:0.0:1746066804.050071:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19466 00000100:00100000:0.0:1746066804.050078:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985115648:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.050093:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.050107:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d643c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.050138:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6bf lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d643c expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.050148:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfaf6bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d643c expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.050159:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8200, rc 0) 00000100:00100000:0.0:1746066804.050277:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985115648:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 199us (274us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066804.050282:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19466 00000100:00100000:0.0:1746066804.050465:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115776 00000100:00100000:0.0:1746066804.050469:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115776 00000100:00100000:0.0:1746066804.051068:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19467 00000100:00100000:0.0:1746066804.051075:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985115776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.051083:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.051090:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf6c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6443 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.051122:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984973312:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066804.051180:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.052846:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.055009:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.056795:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.060113:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.060771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.062631:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.063331:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.064979:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.065015:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.074791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078105:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078142:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078291:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.078429:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.081286:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.082508:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984975744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.082544:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984975872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.082565:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984976000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.082595:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfaf736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.084625:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.088400:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.088454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.091275:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.091304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.091317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.091440:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.091621:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8894 00000100:00100000:0.0:1746066804.091629:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985120000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.091636:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.091648:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfaf6b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6435 expref: 19 pid: 11630 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.091657:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfaf6b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6435 expref: 19 pid: 11630 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.091669:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfaf6b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6435 expref: 19 pid: 11630 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.091684:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.091768:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+18:2016:x1830882985120000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.091774:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8894 00000100:00100000:0.0:1746066804.092041:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092058:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.092123:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985120384 00000100:00100000:0.0:1746066804.092126:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985120384 00010000:00010000:0.0:1746066804.092141:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.092150:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985120896 00000100:00100000:0.0:1746066804.092152:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985120896 00010000:00010000:0.0:1746066804.092160:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfaf63a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63da expref: 44 pid: 9592 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.092168:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985118976 00000100:00100000:0.0:1746066804.092169:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985118976 00010000:00010000:0.0:1746066804.092178:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaf62c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63cc expref: 29 pid: 9590 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.092185:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985119232 00000100:00100000:0.0:1746066804.092187:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985119232 00010000:00010000:0.0:1746066804.092193:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfaf481 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d628a expref: 45 pid: 3528 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.092200:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985119616 00000100:00100000:0.0:1746066804.092201:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985119616 00010000:00010000:0.0:1746066804.092210:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfaf3d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6252 expref: 15 pid: 9590 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.092217:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985119872 00000100:00100000:0.0:1746066804.092219:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985119872 00010000:00010000:0.0:1746066804.092225:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 46 pid: 12237 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.092233:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8895 00000100:00100000:0.0:1746066804.092238:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985120384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.092244:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.092250:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092263:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092273:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfaf545 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d631d expref: 22 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092281:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.092298:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985120384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092303:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8895 00000100:00100000:0.0:1746066804.092331:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8896 00000100:00100000:0.0:1746066804.092336:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985120896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.092341:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.092347:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfaf63a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63da expref: 46 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092355:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfaf63a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63da expref: 46 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092366:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfaf63a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63da expref: 46 pid: 9592 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092374:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.092387:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985120896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092396:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8896 00000100:00100000:0.0:1746066804.092405:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8897 00000100:00100000:0.0:1746066804.092409:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985118976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.092415:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.092424:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaf62c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63cc expref: 29 pid: 9590 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092432:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaf62c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63cc expref: 29 pid: 9590 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092442:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfaf62c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d63cc expref: 29 pid: 9590 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092451:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092453:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092458:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7800/0xf1867c21abfaf71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092465:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7800/0xf1867c21abfaf71a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092485:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.092499:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985118976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092504:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8897 00000100:00100000:0.0:1746066804.092512:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8898 00000100:00100000:0.0:1746066804.092516:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985119232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.092522:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.092528:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfaf481 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d628a expref: 44 pid: 3528 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092535:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfaf481 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d628a expref: 44 pid: 3528 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092544:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfaf481 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d628a expref: 44 pid: 3528 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092552:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092553:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092556:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfaf721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092561:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfaf721 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092573:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.092587:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985119232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092592:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8898 00000100:00100000:0.0:1746066804.092610:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8900 00000100:00100000:0.0:1746066804.092614:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985119872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.092620:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.092627:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 42 pid: 12237 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092635:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 42 pid: 12237 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092644:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfaf53e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6316 expref: 42 pid: 12237 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.092652:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092653:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.092656:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092662:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092675:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.092689:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985119872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092695:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8900 00010000:00010000:0.0:1746066804.092711:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092718:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092732:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092743:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092749:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092755:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066804.092759:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092766:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092774:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.092779:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfaf72f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.092820:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985118592:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13609us (14634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.092826:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19474 00000100:00100000:0.0:1746066804.092858:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.107652:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985121280 00000100:00100000:0.0:1746066804.107662:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985121280 00000100:00100000:0.0:1746066804.107707:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17071 00000100:00100000:0.0:1746066804.107716:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3010:x1830882985121280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.107740:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.107757:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfaf744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6474 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.107838:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.107852:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.107863:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.107875:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.107898:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.107904:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108006:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108015:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108020:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066804.108028:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066804.108099:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108106:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108112:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108118:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066804.108121:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108128:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108140:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.108143:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066804.108147:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108152:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfaf759 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108169:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108174:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108178:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108182:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108185:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066804.108187:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108192:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108196:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066804.108197:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.108199:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108203:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfaf74b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108208:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108212:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108216:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108219:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066804.108221:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108224:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108228:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476b00) 00010000:00010000:0.0:1746066804.108229:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.108230:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108238:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfaf752 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.108271:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfaf744 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6474 expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.108278:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfaf744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6474 expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.108284:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9e00, rc 0) 00000100:00100000:0.0:1746066804.108326:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3010:x1830882985121280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 610us (735us total) trans 8589937531 rc 301/301 00000100:00100000:0.0:1746066804.108332:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17071 00000100:00100000:0.0:1746066804.109490:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.111401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.113877:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.114369:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985121920 00000100:00100000:0.0:1746066804.114373:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985121920 00000100:00100000:0.0:1746066804.114549:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17072 00000100:00100000:0.0:1746066804.114558:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3010:x1830882985121920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.114578:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.114593:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7800/0xf1867c21abfaf767 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d647b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.114679:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfaf76e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066804.114691:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfaf76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066804.114700:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfaf76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066804.114724:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066804.114728:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066804.114743:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfaf76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066804.114763:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7800/0xf1867c21abfaf767 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d647b expref: 19 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.114775:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfaf76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d647b expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.114782:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.114785:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066804.114788:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6e00, rc 0) 00000100:00100000:0.0:1746066804.114822:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3010:x1830882985121920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 267us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.114827:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17072 00000100:00100000:0.0:1746066804.118477:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.118773:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.118797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.118815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.118832:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985122176 00000100:00100000:0.0:1746066804.118836:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985122176 00000100:00100000:0.0:1746066804.118955:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985122432 00000100:00100000:0.0:1746066804.118958:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985122432 00000100:00100000:0.0:1746066804.120499:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19481 00000100:00100000:0.0:1746066804.120508:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985122432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.120518:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.120528:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6497 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066804.120541:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd74, atime: 0x6812dd74, ctime: 0x6812dd74, blocks: 0x800 00010000:00010000:0.0:1746066804.120550:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.120552:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.120556:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6497 expref: 24 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.120566:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6497 expref: 24 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.120574:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6600, rc 0) 00000100:00100000:0.0:1746066804.120596:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985122432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.120611:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19481 00000100:00100000:0.0:1746066804.120622:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19482 00000100:00100000:0.0:1746066804.120626:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985122304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.120632:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.120639:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfaf798 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6490 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066804.120651:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd74, atime: 0x6812dd74, ctime: 0x6812dd74, blocks: 0x800 00010000:00010000:0.0:1746066804.120658:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.120659:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.120663:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfaf798 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6490 expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.120671:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfaf798 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6490 expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.120677:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6200, rc 0) 00000100:00100000:0.0:1746066804.120690:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985122304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.120694:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19482 00000100:00100000:0.0:1746066804.122236:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.127071:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.127403:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.127438:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.127460:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.127933:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8908 00000100:00100000:0.0:1746066804.127940:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985123456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.127948:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.127952:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfaf51b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d62f3 expref: 20 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.128074:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfaf51b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d62f3 expref: 20 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.128086:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.128089:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfaf79f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.128096:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.128111:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985123456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 172us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.128187:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8908 00000100:00100000:0.0:1746066804.135341:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984976896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.135409:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.135441:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.135457:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.135476:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066804.135481:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.135497:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.135510:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.135524:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.135549:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984976896 00000100:00100000:0.0:1746066804.135556:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984976896 00000100:00100000:0.0:1746066804.135588:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984977408 00000100:00100000:0.0:1746066804.135590:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984977408 00000100:00100000:0.0:1746066804.135614:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984977280 00000100:00100000:0.0:1746066804.135616:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984977280 00000100:00100000:0.0:1746066804.135626:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984977792 00000100:00100000:0.0:1746066804.135628:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984977792 00000100:00100000:0.0:1746066804.135641:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19483 00000100:00100000:0.0:1746066804.135648:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984976896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066804.135780:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066804.135784:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.135786:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.135788:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.135790:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066804.135822:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984976896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (413us total) trans 21474842542 rc 0/0 00000100:00100000:0.0:1746066804.135829:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19483 00000100:00100000:0.0:1746066804.135844:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19484 00000100:00100000:0.0:1746066804.135848:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984977408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.135933:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984977408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (474us total) trans 21474842543 rc 0/0 00000100:00100000:0.0:1746066804.135938:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19484 00000100:00100000:0.0:1746066804.135947:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19485 00000100:00100000:0.0:1746066804.135951:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984977280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.136006:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984977280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (507us total) trans 21474842544 rc 0/0 00000100:00100000:0.0:1746066804.136011:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19485 00000100:00100000:0.0:1746066804.136025:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19486 00000100:00100000:0.0:1746066804.136029:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984977792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.136086:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984977792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (560us total) trans 21474842545 rc 0/0 00000100:00100000:0.0:1746066804.136090:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19486 00000004:00080000:0.0:1746066804.136587:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4dc00/2, rc 0, transno 21474842544 00000100:00100000:0.0:1746066804.136593:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.136617:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4c700/2, rc 0, transno 21474842545 00000100:00100000:0.0:1746066804.136620:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.136627:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372680/2, rc 0, transno 21474842542 00000100:00100000:0.0:1746066804.136631:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984976896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.136637:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4f800/2, rc 0, transno 21474842543 00000100:00100000:0.0:1746066804.137134:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984977408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.137202:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.137310:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.137326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.137356:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.143211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.161995:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.162196:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985123840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24717us (24994us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.162206:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7269 00002000:00100000:0.0:1746066804.162219:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c4ce00 x1830882985123840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.162229:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ce00 with x1830882985123840 ext(0->1048575) 00002000:00010000:0.0:1746066804.162235:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4ce00 00000100:00100000:0.0:1746066804.168976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.172933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.196485:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985126400 00000100:00100000:0.0:1746066804.196490:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985126400 00002000:00100000:0.0:1746066804.196516:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880097c00e00 x1830882985126400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.196525:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00e00 with x1830882985126400 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.196530:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c00e00 00000100:00100000:0.0:1746066804.196542:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7275 00000100:00100000:0.0:1746066804.196548:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985126400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066804.216281:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.218086:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985126400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21532us (21643us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.218095:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7275 00002000:00100000:0.0:1746066804.218106:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880097c00e00 x1830882985126400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.218115:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00e00 with x1830882985126400 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.218120:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c00e00 00000100:00100000:0.0:1746066804.218339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.224639:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.226216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.226623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.231866:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984979840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233194:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233215:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984980352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233231:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233262:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984980352 00000100:00100000:0.0:1746066804.233265:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984980352 00000100:00100000:0.0:1746066804.233276:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19502 00000100:00100000:0.0:1746066804.233280:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:3776:x1830882984980736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066804.233337:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066804.233340:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.233342:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.233343:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066804 -> 1746066804 00002000:00010000:0.0:1746066804.233346:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066804.233360:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3776:x1830882984980736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1097us total) trans 17179875168 rc 0/0 00000100:00100000:0.0:1746066804.233365:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19502 00000100:00100000:0.0:1746066804.233372:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19504 00000100:00100000:0.0:1746066804.233375:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:3776:x1830882984980864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.233409:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19505 00000100:00100000:0.0:1746066804.233414:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882984979840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233468:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882984979840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (275us total) trans 21474842552 rc 0/0 00000100:00100000:0.0:1746066804.233472:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19505 00000100:00100000:0.0:1746066804.233483:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19507 00000100:00100000:0.0:1746066804.233487:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882984980352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233525:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3777:x1830882984980352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (293us total) trans 21474842554 rc 0/0 00000100:00100000:0.0:1746066804.233529:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19507 00000100:00100000:0.0:1746066804.233542:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984979584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233558:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233577:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984980096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.233593:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233614:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984980608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.233631:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233641:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984981120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.233655:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.233670:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984980608 00000100:00100000:0.0:1746066804.233673:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984980608 00000100:00100000:0.0:1746066804.233681:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984981120 00000100:00100000:0.0:1746066804.233683:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984981120 00000100:00100000:0.0:1746066804.233689:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19509 00000100:00100000:0.0:1746066804.233693:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3775:x1830882984980096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.234637:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984980096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 943us (1042us total) trans 21474842556 rc 0/0 00000100:00100000:0.0:1746066804.234642:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19509 00000100:00100000:0.0:1746066804.234691:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+84:3776:x1830882984980864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1314us (2379us total) trans 17179875169 rc 0/0 00000100:00100000:0.0:1746066804.234698:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19504 00000004:00080000:0.0:1746066804.234717:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b02a00/2, rc 0, transno 21474842555 00000100:00100000:0.0:1746066804.234720:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984979584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.234725:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00000/2, rc 0, transno 21474842556 00000100:00100000:0.0:1746066804.234728:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984980096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.234733:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372300/2, rc 0, transno 17179875171 00000100:00100000:0.0:1746066804.234736:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984980608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.234741:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094371180/2, rc 0, transno 17179875172 00000100:00100000:0.0:1746066804.234743:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984981120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.234749:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066804.234754:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094370000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984981632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.234769:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.234794:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01180/2, rc 0, transno 21474842552 00000100:00100000:0.0:1746066804.234797:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984979840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.234804:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00380/2, rc 0, transno 21474842554 00000100:00100000:0.0:1746066804.234807:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984980352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.235291:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01c00/2, rc 0, transno 21474842557 00000100:00100000:0.0:1746066804.235295:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984979968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.235300:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984980480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.235318:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.235330:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984980992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.235343:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.235373:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c01f80/2, rc 0, transno 21474842553 00000100:00100000:0.0:1746066804.235376:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984979456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.235658:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea35180/2, rc 0, transno 17179875176 00000100:00100000:0.0:1746066804.235661:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984980480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.236151:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372d80/2, rc 0, transno 17179875175 00000100:00100000:0.0:1746066804.236155:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984980992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.239294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.240249:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.245096:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.250031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.257255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.257298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.257334:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.263551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.293045:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.296487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.299626:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.303262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.306304:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.307053:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.307070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.307099:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.307126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.317964:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.317998:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.318024:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.318065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.318083:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985131648 00000100:00100000:0.0:1746066804.318086:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985131648 00002000:00100000:0.0:1746066804.318105:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5825880 x1830882985131648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.318113:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825880 with x1830882985131648 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.318118:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5825880 00000100:00100000:0.0:1746066804.318143:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985131264 00000100:00100000:0.0:1746066804.318145:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985131264 00002000:00100000:0.0:1746066804.318155:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5825180 x1830882985131264/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:210/0 lens 504/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.318162:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825180 with x1830882985131264 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.318165:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5825180 00000100:00100000:0.0:1746066804.318179:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7282 00000100:00100000:0.0:1746066804.318184:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882985131648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066804.325263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.325302:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.335349:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.335388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.339587:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.339718:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.346952:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.349440:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.354853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.364702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.368787:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.377440:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.377491:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.377969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.405239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.423458:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428391:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428425:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428460:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428491:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.428531:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135616 00000100:00100000:0.0:1746066804.428534:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135616 00000100:00100000:0.0:1746066804.428563:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19530 00000100:00100000:0.0:1746066804.428569:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985135104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.428577:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.428585:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfaf8b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6546 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.428649:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984983168:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066804.428700:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.428715:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19533 00000100:00100000:0.0:1746066804.428720:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985135488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.428726:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.428732:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfaf8c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d655b expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.428741:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.428743:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.428747:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfaf8c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d655b expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.428756:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfaf8c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d655b expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.428763:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:0.0:1746066804.428778:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+17:2015:x1830882985135488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 58us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.428783:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19533 00000100:00100000:0.0:1746066804.432424:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.435385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.435431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.436097:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.436113:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136000 00000100:00100000:0.0:1746066804.436117:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136000 00010000:00010000:0.0:1746066804.436134:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfaf8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6538 expref: 9 pid: 17253 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.436154:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8918 00000100:00100000:0.0:1746066804.436159:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985136000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.436165:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.436168:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfaf8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6538 expref: 9 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.436175:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfaf8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6538 expref: 9 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.436185:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfaf8a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6538 expref: 9 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.436552:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.436555:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.436571:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985136000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 412us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.436577:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8918 00000100:00100000:0.0:1746066804.439965:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.442621:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136512 00000100:00100000:0.0:1746066804.442628:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136512 00010000:00010000:0.0:1746066804.442651:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf8da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6569 expref: 10 pid: 17253 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.442687:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8919 00000100:00100000:0.0:1746066804.442694:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985136512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.442704:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.442710:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf8da lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6569 expref: 10 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.444682:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf8da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6569 expref: 10 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.444719:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfaf8da lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6569 expref: 10 pid: 17253 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.444747:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.444753:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfaf8ef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.444762:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfaf8ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.444768:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfaf8ef lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066804.447976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.451731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454357:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454609:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454879:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454921:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.454949:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137408 00000100:00100000:0.0:1746066804.454952:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137408 00000100:00100000:0.0:1746066804.454975:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19539 00000100:00100000:0.0:1746066804.454981:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985137152:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066804.455002:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d80fa00/0xf1867c21abfaf927 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.455014:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfaf7f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64d6 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.455021:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066804.455023:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066804.455025:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80fa00/0xf1867c21abfaf927 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.455046:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfaf7f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2060287) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64d6 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.455055:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfaf7f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2060287) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64d6 expref: 42 pid: 20361 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.455066:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5886680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984984192:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.455113:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19540 00000100:00100000:0.0:1746066804.455117:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+18:2016:x1830882985137408:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066804.455275:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfaf92e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.455286:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6497 expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.455293:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfaf8be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6554 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.455299:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfaf855 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6500 expref: 42 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456296:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.456298:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.456302:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfaf92e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.456321:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfaf855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6500 expref: 42 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456330:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfaf855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6500 expref: 42 pid: 13363 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.456339:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5886d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984984832:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.456398:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfaf8be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6554 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456405:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfaf8be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6554 expref: 18 pid: 12255 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.456413:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984984960:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.456437:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6497 expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456448:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfaf791 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6497 expref: 25 pid: 9591 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.456455:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984985088:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.456467:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.456481:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.456702:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137664 00000100:00100000:0.0:1746066804.456706:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137664 00000100:00100000:0.0:1746066804.456729:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19541 00000100:00100000:0.0:1746066804.456733:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985137664:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066804.456754:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.456764:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfaf78a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64a5 expref: 30 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456771:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfaf8cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6562 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456777:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfaf863 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d650e expref: 42 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456783:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.456784:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.456786:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.456805:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfaf863 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d650e expref: 42 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.456812:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfaf863 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d650e expref: 42 pid: 13363 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.456820:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985600:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.458040:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfaf8cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6562 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.458051:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfaf8cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6562 expref: 15 pid: 20361 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.458061:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985728:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.458085:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfaf78a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64a5 expref: 30 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.458092:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfaf78a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64a5 expref: 30 pid: 9590 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.458100:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.458113:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.458265:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137792 00000100:00100000:0.0:1746066804.458268:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137792 00010000:00010000:0.0:1746066804.458288:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfaf847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64f2 expref: 43 pid: 20361 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.458312:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8920 00000100:00100000:0.0:1746066804.458318:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985137792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.458325:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.458340:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfaf847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64f2 expref: 43 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.458462:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfaf847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64f2 expref: 43 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.458477:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfaf847 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d64f2 expref: 43 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.458500:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.458589:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985137792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 271us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.458605:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8920 00000100:00100000:0.0:1746066804.460308:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.460457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.460470:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138176 00000100:00100000:0.0:1746066804.460473:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138176 00010000:00010000:0.0:1746066804.460492:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaf8b7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d654d expref: 16 pid: 20361 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746066804.460733:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8921 00000100:00100000:0.0:1746066804.460738:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2014:x1830882985138176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.460746:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.460758:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaf8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d654d expref: 16 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.460766:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaf8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d654d expref: 16 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.460782:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfaf8b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d654d expref: 16 pid: 20361 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746066804.460792:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.460815:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2014:x1830882985138176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.460821:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8921 00000100:00100000:0.0:1746066804.460844:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.461933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.463616:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.463658:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5886d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984984832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.463683:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984984960:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.469273:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.469286:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.469296:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.469306:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.470690:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985600:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.470703:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5886a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985728:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.470742:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984985856:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.470766:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472349:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472358:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472369:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472375:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472381:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472386:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589be00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066804.472389:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472394:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472402:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.472409:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf935 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.472434:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985137664:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15700us (15873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.472440:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19541 00000100:00100000:0.0:1746066804.477113:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.479464:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.481019:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.482271:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.484894:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066804.484906:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984986240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.484935:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.485374:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984986496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.485394:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.485408:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066804.485411:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984986368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.485424:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.485441:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984986240 00000100:00100000:0.0:1746066804.485446:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984986240 00000100:00100000:0.0:1746066804.485467:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984986496 00000100:00100000:0.0:1746066804.485469:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984986496 00000100:00100000:0.0:1746066804.485479:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984986368 00000100:00100000:0.0:1746066804.485481:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984986368 00000100:00100000:0.0:1746066804.485490:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19542 00000100:00100000:0.0:1746066804.485494:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+87:3774:x1830882984986240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.485600:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+88:3774:x1830882984986240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (654us total) trans 17179875178 rc 0/0 00000100:00100000:0.0:1746066804.485606:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19542 00000100:00100000:0.0:1746066804.485616:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19543 00000100:00100000:0.0:1746066804.485620:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984986496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.485682:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3777:x1830882984986496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (287us total) trans 21474842559 rc 0/0 00000100:00100000:0.0:1746066804.485687:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19543 00000100:00100000:0.0:1746066804.485695:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19544 00000100:00100000:0.0:1746066804.485699:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+87:3777:x1830882984986368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.485746:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+88:3777:x1830882984986368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (320us total) trans 17179875179 rc 0/0 00000100:00100000:0.0:1746066804.485750:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19544 00000004:00080000:0.0:1746066804.485777:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094373480/2, rc 0, transno 17179875178 00000100:00100000:0.0:1746066804.485781:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984986240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.485797:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094371c00/2, rc 0, transno 17179875179 00000100:00100000:0.0:1746066804.485800:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984986368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.485806:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54ca80/2, rc 0, transno 21474842559 00000100:00100000:0.0:1746066804.485809:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984986496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.487531:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984987008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.487548:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.487569:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984987520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.487582:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.487600:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.487612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.487630:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984987520 00000100:00100000:0.0:1746066804.487632:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984987520 00000100:00100000:0.0:1746066804.487643:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984988032 00000100:00100000:0.0:1746066804.487645:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984988032 00000100:00100000:0.0:1746066804.487654:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19554 00000100:00100000:0.0:1746066804.487658:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3777:x1830882984987520:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.487695:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54d880/2, rc 0, transno 21474842564 00000100:00100000:0.0:1746066804.487698:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984987008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.487720:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3777:x1830882984987520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (137us total) trans 17179875185 rc 0/0 00000100:00100000:0.0:1746066804.487724:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19554 00000004:00080000:0.0:1746066804.487739:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cfb80/2, rc 0, transno 17179875185 00000100:00100000:0.0:1746066804.487741:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984987520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.487746:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cd880/2, rc 0, transno 17179875184 00000100:00100000:0.0:1746066804.487748:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.487787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.491824:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.496158:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19562 00000100:00100000:0.0:1746066804.496166:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985141376:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.496173:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.496181:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf96d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d65b6 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066804.496192:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x1000 00010000:00010000:0.0:1746066804.496200:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.496202:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.496206:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf96d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65b6 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.496215:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfaf96d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65b6 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.496221:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589be00, rc 0) 00000100:00100000:0.0:1746066804.496546:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985141376:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 381us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.496552:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19562 00000100:00100000:0.0:1746066804.508618:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.508671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.508699:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.508727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.509099:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19568 00000100:00100000:0.0:1746066804.509105:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+17:2015:x1830882985141504:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066804.509132:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985141504:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.509137:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19568 00000100:00100000:0.0:1746066804.509161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.509205:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.511394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.512473:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.512502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.512525:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.512620:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.512686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.519344:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.520327:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.522680:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.527306:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.527346:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.527379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.532646:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.532678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.563939:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566204:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566233:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566256:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566270:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.566339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.568326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.571754:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066804.573771:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937547 is committed 00000004:00080000:0.0:1746066804.573777:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1073 committed 00000004:00080000:0.0:1746066804.573792:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1052 committed 00000004:00080000:0.0:1746066804.573795:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1051 committed 00000004:00080000:0.0:1746066804.573797:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1050 committed 00000004:00080000:0.0:1746066804.573799:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1049 committed 00000004:00080000:0.0:1746066804.573800:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1072 committed 00000004:00080000:0.0:1746066804.573802:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1048 committed 00000004:00080000:0.0:1746066804.573803:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1071 committed 00000004:00080000:0.0:1746066804.573804:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1047 committed 00000004:00080000:0.0:1746066804.573806:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1070 committed 00000004:00080000:0.0:1746066804.573807:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1069 committed 00000004:00080000:0.0:1746066804.573808:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1068 committed 00000004:00080000:0.0:1746066804.573810:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1046 committed 00000004:00080000:0.0:1746066804.573811:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1045 committed 00000004:00080000:0.0:1746066804.573812:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1067 committed 00000004:00080000:0.0:1746066804.573813:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1066 committed 00000004:00080000:0.0:1746066804.573815:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1044 committed 00000100:00100000:0.0:1746066804.573951:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.573998:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.574021:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.574035:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.574050:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066804.574054:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.574066:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.574075:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.574087:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.574102:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984988800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.574115:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.574124:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984989312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.574136:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.574831:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4700/2, rc 0, transno 17179875194 00000100:00100000:0.0:1746066804.574856:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984989312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.574935:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4e00/2, rc 0, transno 17179875193 00000100:00100000:0.0:1746066804.574939:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984988800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.574993:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4000/2, rc 0, transno 17179875192 00000100:00100000:0.0:1746066804.574997:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.575005:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d7480/2, rc 0, transno 17179875190 00000100:00100000:0.0:1746066804.575008:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.575015:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5c00/2, rc 0, transno 17179875195 00000100:00100000:0.0:1746066804.575017:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984988672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.575024:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4a80/2, rc 0, transno 17179875191 00000100:00100000:0.0:1746066804.575026:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.575039:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.575131:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.575161:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984990208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.575185:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.575210:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984990208 00000100:00100000:0.0:1746066804.575215:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984990208 00000100:00100000:0.0:1746066804.575238:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984990592 00000100:00100000:0.0:1746066804.575240:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984990592 00000100:00100000:0.0:1746066804.575252:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19595 00000100:00100000:0.0:1746066804.575258:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3775:x1830882984990464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.575398:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+78:3775:x1830882984990464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (241us total) trans 21474842575 rc 0/0 00000100:00100000:0.0:1746066804.575404:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19595 00000004:00080000:0.0:1746066804.575433:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d880/2, rc 0, transno 21474842573 00000100:00100000:0.0:1746066804.575437:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984989696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.575446:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0e300/2, rc 0, transno 21474842574 00000100:00100000:0.0:1746066804.575449:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984990208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.578438:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.580423:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.597848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.600008:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.600957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.603030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.603091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.603115:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.604616:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.605472:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.605955:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.606671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.631823:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.631874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.636115:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.639575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.652177:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.652263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.674539:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.687414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.689820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.691976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.692236:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985150592 00000100:00100000:0.0:1746066804.692241:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985150592 00000100:00100000:0.0:1746066804.692302:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17096 00000100:00100000:0.0:1746066804.692312:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:3031:x1830882985150592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066804.692335:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.692340:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066804.692373:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfafa4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65fc expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.692400:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.692405:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066804.692436:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfafa5b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6611 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.692491:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfafa69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.692505:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb800/0xf1867c21abfaf9c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65bd expref: 7 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.692512:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfafa46 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65f5 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.692518:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfafa69 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.692548:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfafa46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65f5 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.692560:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfafa46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65f5 expref: 9 pid: 17253 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.692572:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984990976:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.693543:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb800/0xf1867c21abfaf9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65bd expref: 7 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.693566:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb800/0xf1867c21abfaf9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d65bd expref: 7 pid: 17253 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.693576:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984991104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.693608:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.701879:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.702176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.702210:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.702362:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985150208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14480us (14956us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.702373:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7302 00002000:00100000:0.0:1746066804.702386:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880096ec8a80 x1830882985150208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.702395:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8a80 with x1830882985150208 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.702400:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec8a80 00000100:00100000:0.0:1746066804.702496:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985150976 00000100:00100000:0.0:1746066804.702502:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985150976 00000100:00100000:0.0:1746066804.702538:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17097 00000100:00100000:0.0:1746066804.702544:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:3036:x1830882985150976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066804.702561:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.702577:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfafa70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6618 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.702640:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfafa69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.702652:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfafa70 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6618 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.702667:0:13370:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfafa69 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.702677:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfafa70 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6618 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.702689:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.702693:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066804.702695:0:13370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfafa69 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066804.702701:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:0.0:1746066804.702737:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:3036:x1830882985150976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 193us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.702742:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17097 00000100:00100000:0.0:1746066804.707508:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985151104 00000100:00100000:0.0:1746066804.707516:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985151104 00000100:00100000:0.0:1746066804.707564:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17098 00000100:00100000:0.0:1746066804.707574:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3032:x1830882985151104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066804.707604:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.707622:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfafa77 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d661f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.707676:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfafa77 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d661f expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.707693:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfafa77 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d661f expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.707705:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066804.707708:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066804.707711:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfafa70 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6618 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.707718:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:0.0:1746066804.707776:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3032:x1830882985151104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 204us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.707782:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17098 00000001:00080000:0.0:1746066804.710199:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937553 is committed 00000004:00080000:0.0:1746066804.710206:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1081 committed 00000004:00080000:0.0:1746066804.710225:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1061 committed 00000004:00080000:0.0:1746066804.710235:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1060 committed 00000004:00080000:0.0:1746066804.710236:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1059 committed 00000004:00080000:0.0:1746066804.710238:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1058 committed 00000004:00080000:0.0:1746066804.710240:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1080 committed 00000004:00080000:0.0:1746066804.710241:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1057 committed 00000004:00080000:0.0:1746066804.710243:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1079 committed 00000004:00080000:0.0:1746066804.710245:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1056 committed 00000004:00080000:0.0:1746066804.710247:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1078 committed 00000004:00080000:0.0:1746066804.710248:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1077 committed 00000004:00080000:0.0:1746066804.710250:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1076 committed 00000004:00080000:0.0:1746066804.710252:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1055 committed 00000004:00080000:0.0:1746066804.710253:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1054 committed 00000004:00080000:0.0:1746066804.710255:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1075 committed 00000004:00080000:0.0:1746066804.710258:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1074 committed 00000004:00080000:0.0:1746066804.710260:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1053 committed 00000001:00080000:0.0:1746066804.710268:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937550 is committed 00000001:00080000:0.0:1746066804.710275:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937548 is committed 00000100:00100000:0.0:1746066804.711669:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984991232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.711700:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.713252:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0ea00/2, rc 0, transno 21474842584 00000100:00100000:0.0:1746066804.713257:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984991232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.713275:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54dc00/2, rc 0, transno 17179875202 00000100:00100000:0.0:1746066804.713281:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984991488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.713288:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5884a80/2, rc 0, transno 21474842583 00000100:00100000:0.0:1746066804.713290:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984992000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.713295:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54df80/2, rc 0, transno 17179875204 00000100:00100000:0.0:1746066804.713297:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984992512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.713302:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54f480/2, rc 0, transno 17179875206 00000100:00100000:0.0:1746066804.713304:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984993024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.713308:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5887480/2, rc 0, transno 21474842579 00000100:00100000:0.0:1746066804.713311:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984991360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.713316:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5887b80/2, rc 0, transno 21474842580 00000100:00100000:0.0:1746066804.713318:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984991872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.713323:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5886300/2, rc 0, transno 21474842581 00000100:00100000:0.0:1746066804.713324:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984992384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.713328:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54ce00/2, rc 0, transno 17179875201 00000100:00100000:0.0:1746066804.713330:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984992896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.713387:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3776:x1830882984992128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2116us (2560us total) trans 21474842585 rc 0/0 00000100:00100000:0.0:1746066804.713392:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19609 00000100:00100000:0.0:1746066804.713529:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984993408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.713553:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.713859:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096eca300/2, rc 0, transno 17179875207 00000100:00100000:0.0:1746066804.713863:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984993408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.715788:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.715813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.715848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.721815:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.729380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.729426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.729452:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.729497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.736145:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882984993664:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066804.736167:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfafa8c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3629056->4161535] (req 3629056->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6634 expref: 47 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.736176:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0200, rc 0) 00000100:00100000:0.0:1746066804.736204:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+47:3031:x1830882985152256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5031us (6778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.736210:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19624 00000100:00100000:0.0:1746066804.738293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.742714:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.742739:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.744229:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.746740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.747396:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.750645:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.750675:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.750699:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.751805:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985155200 00000100:00100000:0.0:1746066804.751815:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985155200 00010000:00010000:0.0:1746066804.751848:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfafa62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d660a expref: 44 pid: 12233 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746066804.751875:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8949 00000100:00100000:0.0:1746066804.751906:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985155200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.751917:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.751934:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfafa62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d660a expref: 44 pid: 12233 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.751945:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfafa62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d660a expref: 44 pid: 12233 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.751964:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfafa62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d660a expref: 44 pid: 12233 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746066804.751984:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.751986:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.751992:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.752009:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.752035:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.752045:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984995072:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066804.752665:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.761100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.764273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.764328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.773857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.775508:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.776090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.784102:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.797723:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.798637:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.807748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.808425:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.808459:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.809323:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7312 00000100:00100000:0.0:1746066804.809331:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985157504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066804.840031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.846121:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.846159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.850129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.864016:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.864098:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.870569:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.870686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.887284:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.895828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.916160:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985160320 00000100:00100000:0.0:1746066804.916169:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985160320 00000100:00100000:0.0:1746066804.916226:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17101 00000100:00100000:0.0:1746066804.916235:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3043:x1830882985160320:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066804.916256:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.916275:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfafb2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d66c0 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.916387:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7c00/0xf1867c21abfafb34 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066804.916402:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfafb11 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66a4 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.916409:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7c00/0xf1867c21abfafb34 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066804.916440:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfafb11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66a4 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.916598:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfafb11 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66a4 expref: 8 pid: 7245 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746066804.916617:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984996736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066804.916787:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.919085:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.928488:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.934310:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.936978:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.937010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.937038:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.937065:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.937078:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.938308:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.938352:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.938380:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.945498:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952157:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952238:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952251:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952279:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985162112 00000100:00100000:0.0:1746066804.952283:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985162112 00002000:00100000:0.0:1746066804.952309:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1609727) req@ffff88011f761c00 x1830882985162112/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.952322:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761c00 with x1830882985162112 ext(1048576->1609727) 00010000:00010000:0.0:1746066804.952329:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 34 pid: 13726 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066804.952339:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 34 pid: 13726 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746066804.952345:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f761c00 00000100:00100000:0.0:1746066804.952360:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2111 00000100:00100000:0.0:1746066804.952364:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2015:x1830882985162112:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066804.952485:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.952536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.956677:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.956718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.956996:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8964 00000100:00100000:0.0:1746066804.957004:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2014:x1830882985163392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.957014:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.957027:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c600/0xf1867c21abfafac4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d666c expref: 36 pid: 13726 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066804.957037:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0c600/0xf1867c21abfafac4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d666c expref: 36 pid: 13726 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066804.957051:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c600/0xf1867c21abfafac4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d666c expref: 36 pid: 13726 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066804.957630:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.957632:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.957635:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6600/0xf1867c21abfafb73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.957643:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6600/0xf1867c21abfafb73 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.957657:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.958294:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2014:x1830882985163392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1290us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.958301:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8964 00000100:00100000:0.0:1746066804.963018:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882985162112:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10641us (10738us total) trans 21474842588 rc 0/0 00000100:00100000:0.0:1746066804.963031:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2111 00002000:00100000:0.0:1746066804.963041:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1609727) req@ffff88011f761c00 x1830882985162112/t21474842588(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.963051:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761c00 with x1830882985162112 ext(1048576->1609727) 00010000:00010000:0.0:1746066804.963061:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 35 pid: 13726 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066804.963073:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ebbd000/0xf1867c21abfafaa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6649 expref: 35 pid: 13726 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746066804.963080:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f761c00 00000100:00100000:0.0:1746066804.965727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.969028:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066804.970066:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970080:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970096:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970102:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970108:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970114:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fafe00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066804.970117:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970123:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970134:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.970139:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfafb7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.970212:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985161216:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 32527us (33145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.970221:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19647 00000100:00100000:0.0:1746066804.980038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.980056:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.980122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066804.987193:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987257:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987284:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987294:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987313:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066804.987317:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987328:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987334:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987344:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987359:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984999296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987371:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987379:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984999808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987388:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987396:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066804.987399:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984999168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987409:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987417:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984999680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.987427:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.987445:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984999424 00000100:00100000:0.0:1746066804.987452:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984999424 00000100:00100000:0.0:1746066804.987478:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984999040 00000100:00100000:0.0:1746066804.987480:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984999040 00000100:00100000:0.0:1746066804.987489:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984999552 00000100:00100000:0.0:1746066804.987491:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984999552 00000100:00100000:0.0:1746066804.989549:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19665 00000100:00100000:0.0:1746066804.989556:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:3774:x1830882984999552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066804.989613:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066804.989616:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066804.989618:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066804.989620:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066804.989621:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066804.989642:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+124:3774:x1830882984999552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (2297us total) trans 17179875212 rc 0/0 00000100:00100000:0.0:1746066804.989646:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19665 00000004:00080000:0.0:1746066804.989669:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f762680/2, rc 0, transno 17179875212 00000100:00100000:0.0:1746066804.989671:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.989677:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f760e00/2, rc 0, transno 17179875208 00000100:00100000:0.0:1746066804.989679:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.991678:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3776:x1830882985000192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2521us (3456us total) trans 21474842596 rc 0/0 00000100:00100000:0.0:1746066804.991685:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19661 00000004:00080000:0.0:1746066804.991718:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f763100/2, rc 0, transno 17179875213 00000100:00100000:0.0:1746066804.991722:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984999040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.994844:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+124:3777:x1830882984999296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6646us (7472us total) trans 17179875215 rc 0/0 00000100:00100000:0.0:1746066804.994853:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19652 00000100:00100000:0.0:1746066804.998412:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.001722:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.006836:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.025365:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.040350:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.056334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.058991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.059030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.065462:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19678 00000100:00100000:0.0:1746066805.065470:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+129:3775:x1830882985002880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.065551:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+130:3775:x1830882985002880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (942us total) trans 17179875223 rc 0/0 00000100:00100000:0.0:1746066805.065557:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19678 00000100:00080000:0.0:1746066805.065796:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066805.065800:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746066805.068064:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d26680/2, rc 0, transno 17179875225 00000100:00100000:0.0:1746066805.068067:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985003520:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746066805.069662:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066805.072111:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.077004:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.085326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.086713:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.089936:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.090916:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.090939:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.090951:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.090963:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985167872 00000100:00100000:0.0:1746066805.090966:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985167872 00000100:00100000:0.0:1746066805.090982:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985168128 00000100:00100000:0.0:1746066805.090984:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985168128 00000100:00100000:0.0:1746066805.091858:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19686 00000100:00100000:0.0:1746066805.091863:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+6:2016:x1830882985168128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066805.091869:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.091876:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4000/0xf1867c21abfafc22 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d671b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066805.091933:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985003648:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066805.091985:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.092021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.092037:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985168256 00000100:00100000:0.0:1746066805.092040:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985168256 00000100:00100000:0.0:1746066805.093325:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19688 00000100:00100000:0.0:1746066805.093332:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882985168256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066805.093342:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.093352:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfafc30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6722 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066805.093366:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x1000 00010000:00010000:0.0:1746066805.093376:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.093377:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.093381:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfafc30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6722 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.093391:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfafc30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6722 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.093403:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5c00, rc 0) 00000100:00100000:0.0:1746066805.093427:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2015:x1830882985168256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.093432:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19688 00000100:00100000:0.0:1746066805.098867:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.104010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.107089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.107121:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.107818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.108095:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.109402:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7322 00000100:00100000:0.0:1746066805.109409:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985169792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066805.112318:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19693 00000100:00100000:0.0:1746066805.112325:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985169920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066805.112332:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.112339:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfafc76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6730 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.112351:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.112352:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.112357:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfafc76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6730 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.112367:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfafc76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6730 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.112378:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5800, rc 0) 00000100:00100000:0.0:1746066805.112394:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985169920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.112398:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19693 00000100:00080000:0.0:1746066805.112413:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066805.124367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.132152:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.132186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.132215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.132230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.138494:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.161687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.165931:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.168549:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.175106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.177605:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.182614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.188006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.188050:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.188132:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.196024:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.198788:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174016 00000100:00100000:0.0:1746066805.198796:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174016 00000100:00100000:0.0:1746066805.198833:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19699 00000100:00100000:0.0:1746066805.198839:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+46:3055:x1830882985174016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066805.198857:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.198874:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfafca0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d676f expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.198928:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46ec00/0xf1867c21abfafc61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6753 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.198937:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066805.198938:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066805.198942:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfafca0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d676f expref: 47 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.198972:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46ec00/0xf1867c21abfafc61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6753 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.198985:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b46ec00/0xf1867c21abfafc61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6753 expref: 35 pid: 13726 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746066805.198998:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985004544:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066805.203065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.204145:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.208781:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.212077:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.218835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.222910:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.222942:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985175424 00000100:00100000:0.0:1746066805.222951:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985175424 00002000:00100000:0.0:1746066805.222995:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7f100 x1830882985175424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.223006:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882985175424 ext(2097152->4194303) 00002000:00010000:0.0:1746066805.223012:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:0.0:1746066805.223043:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7334 00000100:00100000:0.0:1746066805.223051:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985175424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066805.227146:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985175680 00000100:00100000:0.0:1746066805.227152:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985175680 00010000:00010000:0.0:1746066805.227171:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfafc06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66f8 expref: 12 pid: 17253 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746066805.227209:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:0.0:1746066805.227215:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985175680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.227224:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.227228:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfafc06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66f8 expref: 12 pid: 17253 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066805.227237:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfafc06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66f8 expref: 12 pid: 17253 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066805.227250:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfafc06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66f8 expref: 12 pid: 17253 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066805.227276:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066805.227279:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfafcb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066805.227287:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfafcb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066805.227294:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfafcb5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066805.227309:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.227338:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985175680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.227344:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8976 00000100:00100000:0.0:1746066805.241381:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985175424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18325us (18498us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066805.241458:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7334 00002000:00100000:0.0:1746066805.241473:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7f100 x1830882985175424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.241483:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882985175424 ext(2097152->4194303) 00002000:00010000:0.0:1746066805.241490:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:0.0:1746066805.246288:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.246328:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.255862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.263870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.263943:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.265331:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.278615:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.293038:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.293923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.329778:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.333255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.335404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.337764:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.341728:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.345701:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.345909:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.351723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.430848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.453281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.461489:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.462049:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.465449:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.470978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.473651:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.539292:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.542363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.546547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.546651:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.546698:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.546731:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985181440 00000100:00100000:0.0:1746066805.546733:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985181440 00000100:00100000:0.0:1746066805.546949:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 931 00000100:00100000:0.0:1746066805.546954:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985181440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.546965:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.546986:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfafd25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67b5 expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.547002:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066805.547005:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.547155:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882985181440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 201us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.547161:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 931 00000100:00100000:0.0:1746066805.549384:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.549470:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.552929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066805.553486:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066805 -> 1746066806 00002000:00010000:0.0:1746066805.553489:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066805 -> 1746066806 00002000:00010000:0.0:1746066805.553491:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066805 -> 1746066806 00000100:00100000:0.0:1746066805.553504:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985006848:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066805.553524:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfafd56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67c3 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.553535:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfafd56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67c3 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.553544:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a400, rc 0) 00000100:00100000:0.0:1746066805.553562:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985181568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3742us (4183us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066805.553567:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19706 00000100:00100000:0.0:1746066805.566604:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.567095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.570003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.575997:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.578828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.581586:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.590537:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.594564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.605976:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.606029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.622707:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.634419:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.643721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.643780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.643821:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985184256 00000100:00100000:0.0:1746066805.643828:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985184256 00002000:00100000:0.0:1746066805.643870:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1609727) req@ffff88009c777480 x1830882985184256/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.643878:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c777480 with x1830882985184256 ext(1048576->1609727) 00010000:00010000:0.0:1746066805.643919:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f66600/0xf1867c21abfafcdf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67a0 expref: 20 pid: 20361 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066805.643932:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f66600/0xf1867c21abfafcdf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67a0 expref: 20 pid: 20361 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746066805.643939:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c777480 00000100:00100000:0.0:1746066805.643959:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985184512 00000100:00100000:0.0:1746066805.643962:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985184512 00002000:00100000:0.0:1746066805.643975:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009c775500 x1830882985184512/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.643982:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775500 with x1830882985184512 ext(1048576->2097151) 00002000:00010000:0.0:1746066805.643984:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775500 00000100:00100000:0.0:1746066805.643995:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2117 00000100:00100000:0.0:1746066805.644001:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985184256:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066805.644610:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985007616:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066805.644633:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfafd9c lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67ed expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.644646:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6200, rc 0) 00000100:00100000:0.0:1746066805.665694:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.667005:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985184896 00000100:00100000:0.0:1746066805.667013:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985184896 00000100:00100000:0.0:1746066805.667054:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19713 00000100:00100000:0.0:1746066805.667061:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985184896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066805.667075:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.667088:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894400/0xf1867c21abfafdaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d67fb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.667107:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.667109:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.667115:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894400/0xf1867c21abfafdaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67fb expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.667127:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894400/0xf1867c21abfafdaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67fb expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.667137:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894400, rc 0) 00000100:00100000:0.0:1746066805.667180:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985184896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 119us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.667186:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19713 00000100:00100000:0.0:1746066805.669948:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.683733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.684369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.687954:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.690195:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.691526:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.697705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.703653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.705084:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.706365:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985008256:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066805.706373:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985008384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066805.706397:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfafdbf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->3559423] (req 3145728->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6810 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.706410:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:0.0:1746066805.706449:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:3075:x1830882985186304:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2318us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.706456:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19716 00000100:00100000:0.0:1746066805.709597:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.709636:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.709677:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.712468:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985187200 00000100:00100000:0.0:1746066805.712474:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985187200 00000100:00100000:0.0:1746066805.712521:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 933 00000100:00100000:0.0:1746066805.712528:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985187200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.712824:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.712850:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d200/0xf1867c21abfafde2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d681e expref: 19 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.712867:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066805.712871:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.712925:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985187200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 396us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.712931:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 933 00000100:00100000:0.0:1746066805.714155:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985186944:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4367us (4561us total) trans 21474842608 rc 0/0 00000100:00100000:0.0:1746066805.714165:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2118 00002000:00100000:0.0:1746066805.714175:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2867200->3145727) req@ffff8800958a6a00 x1830882985186944/t21474842608(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.714183:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6a00 with x1830882985186944 ext(2867200->3145727) 00010000:00010000:0.0:1746066805.714192:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfafdb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6809 expref: 25 pid: 20361 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746066805.714204:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfafdb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6809 expref: 25 pid: 20361 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746066805.714214:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a6a00 00000100:00100000:0.0:1746066805.715115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.716612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.723450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.739086:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.743281:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.754001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.767216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.767951:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.790973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.796466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.803148:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.803188:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.803214:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985189248 00000100:00100000:0.0:1746066805.803222:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985189248 00010000:00010000:0.0:1746066805.803263:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfafdb1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6802 expref: 15 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066805.803299:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985189376 00000100:00100000:0.0:1746066805.803301:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985189376 00010000:00010000:0.0:1746066805.803309:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfafd95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67e6 expref: 31 pid: 3528 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066805.803321:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8993 00000100:00100000:0.0:1746066805.803327:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985189248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.803341:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.803362:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfafdb1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6802 expref: 15 pid: 20361 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.803373:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfafdb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6802 expref: 15 pid: 20361 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.803401:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.803441:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985189248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.803450:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8993 00000100:00100000:0.0:1746066805.803463:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8994 00000100:00100000:0.0:1746066805.803467:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985189376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.803472:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.803478:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfafd95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67e6 expref: 31 pid: 3528 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.803486:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfafd95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67e6 expref: 31 pid: 3528 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.803496:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.803497:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.803504:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfafdf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d682c expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.803511:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfafdf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d682c expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.803540:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfafdf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d682c expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066805.803551:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985009408:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066805.803619:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.805243:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.806787:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985009408:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066805.806812:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.806840:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985189376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3371us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.806851:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8994 00000100:00100000:0.0:1746066805.807316:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985189760 00000100:00100000:0.0:1746066805.807321:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985189760 00002000:00100000:0.0:1746066805.807355:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (2007040->2011135) req@ffff880097c03800 x1830882985189760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.807365:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03800 with x1830882985189760 ext(2007040->2011135) 00002000:00010000:0.0:1746066805.807369:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03800 00000100:00100000:0.0:1746066805.807395:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7356 00000100:00100000:0.0:1746066805.807401:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985189760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066805.807574:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985189760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 165us (432us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066805.807581:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7356 00002000:00100000:0.0:1746066805.807586:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (2007040->2011135) req@ffff880097c03800 x1830882985189760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.807593:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03800 with x1830882985189760 ext(2007040->2011135) 00002000:00010000:0.0:1746066805.807596:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03800 00000100:00100000:0.0:1746066805.818413:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.828976:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.835710:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.849142:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.851677:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.854265:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.858313:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.858350:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.859143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.859481:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.860564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.860791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.863410:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985010432:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066805.863441:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d400/0xf1867c21abfafe44 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6864 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.863454:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d400/0xf1867c21abfafe44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6864 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.863467:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d400, rc 0) 00000100:00100000:0.0:1746066805.863514:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985191936:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2812us (2955us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066805.863521:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19726 00000100:00100000:0.0:1746066805.868341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.870228:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.874171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.876450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.880972:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.881024:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.889941:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.894684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.894727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.894807:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.895007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.895113:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.895262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066805.896665:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfafe2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d684f expref: 10 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.896672:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfafe2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d684f expref: 10 pid: 12233 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746066805.896680:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985012352:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066805.896698:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67a00/0xf1867c21abfafd6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67d8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.896704:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f67a00/0xf1867c21abfafd6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67d8 expref: 7 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066805.896710:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985012480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066805.896718:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.902273:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902294:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902340:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902360:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194624 00000100:00100000:0.0:1746066805.902364:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194624 00010000:00010000:0.0:1746066805.902391:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfafe28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6848 expref: 11 pid: 12233 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746066805.902413:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9001 00000100:00100000:0.0:1746066805.902420:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985194624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.902431:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.902447:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfafe28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6848 expref: 11 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.902455:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfafe28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6848 expref: 11 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.902482:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.902511:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985194624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.902517:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9001 00000100:00100000:0.0:1746066805.902662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902708:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902744:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902781:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.902850:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9005 00000100:00100000:0.0:1746066805.902855:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985194240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.902862:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.902992:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfafda3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67f4 expref: 23 pid: 3528 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903005:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfafda3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67f4 expref: 23 pid: 3528 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903017:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfafda3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d67f4 expref: 23 pid: 3528 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903029:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.903047:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985194240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 192us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.903052:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9005 00000100:00100000:0.0:1746066805.903061:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985195008 00000100:00100000:0.0:1746066805.903063:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985195008 00010000:00010000:0.0:1746066805.903071:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfafe36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6856 expref: 10 pid: 12233 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746066805.903079:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9008 00000100:00100000:0.0:1746066805.903083:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985195008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.903087:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.903091:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfafe36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6856 expref: 10 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903104:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfafe36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6856 expref: 10 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903119:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfafe36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6856 expref: 10 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903125:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.903127:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.903129:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfafe9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.903139:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfafe9f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.903151:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.903163:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985195008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.903168:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9008 00000100:00100000:0.0:1746066805.903198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.903225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.903235:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9009 00000100:00100000:0.0:1746066805.903239:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985195264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.903244:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.903251:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfafe2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d684f expref: 9 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903258:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfafe2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d684f expref: 9 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903267:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfafe2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d684f expref: 9 pid: 12233 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066805.903281:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.903293:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985195264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.903297:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9009 00000100:00100000:0.0:1746066805.903356:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.911594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.911777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.915964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.923459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.923507:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.923584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.924544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.925002:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9017 00000100:00100000:0.0:1746066805.925008:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985196672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.925015:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.925019:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfafbe3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66ea expref: 38 pid: 17253 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.925033:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfafbe3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d66ea expref: 38 pid: 17253 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066805.925166:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066805.925173:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362400/0xf1867c21abfafec2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066805.925177:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.925735:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985196672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 725us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.925741:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9017 00000100:00100000:0.0:1746066805.930701:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985013760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066805.931202:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066805.931224:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.931242:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066805.931254:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.931267:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066805.931275:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066805.931279:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.931291:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066805.931296:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985015168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.931306:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066805.931320:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985014656 00000100:00100000:0.0:1746066805.931323:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985014656 00000100:00100000:0.0:1746066805.931335:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985015168 00000100:00100000:0.0:1746066805.931337:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985015168 00000100:00100000:0.0:1746066805.931346:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985014016 00000100:00100000:0.0:1746066805.931348:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985014016 00000100:00100000:0.0:1746066805.931355:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19740 00000100:00100000:0.0:1746066805.931360:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882985014144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066805.931417:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3776:x1830882985014144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (200us total) trans 21474842613 rc 0/0 00000100:00100000:0.0:1746066805.931421:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19740 00000100:00100000:0.0:1746066805.931430:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985014912 00000100:00100000:0.0:1746066805.931432:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985014912 00000100:00100000:0.0:1746066805.931442:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19743 00000100:00100000:0.0:1746066805.931445:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985014784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066805.931493:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066805.931496:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066805.931498:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066805.931500:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066805.931502:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066805.931517:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985014784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (249us total) trans 17179875232 rc 0/0 00000100:00100000:0.0:1746066805.931523:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19743 00000100:00100000:0.0:1746066805.931531:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19748 00000100:00100000:0.0:1746066805.931535:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985015040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066805.931597:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985015040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (213us total) trans 17179875235 rc 0/0 00000100:00100000:0.0:1746066805.931601:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19748 00000100:00100000:0.0:1746066805.931626:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875224 gen 2 00000004:00080000:0.0:1746066805.931629:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbea00, transno 17179875074 00000004:00080000:0.0:1746066805.931634:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbed80, transno 17179875075 00000004:00080000:0.0:1746066805.931636:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd880, transno 17179875076 00000004:00080000:0.0:1746066805.931638:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd180, transno 17179875077 00000004:00080000:0.0:1746066805.931640:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbce00, transno 17179875078 00000004:00080000:0.0:1746066805.931642:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd500, transno 17179875079 00000004:00080000:0.0:1746066805.931643:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbca80, transno 17179875080 00000004:00080000:0.0:1746066805.931646:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855f80, transno 17179875081 00000004:00080000:0.0:1746066805.931648:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbf100, transno 17179875082 00000004:00080000:0.0:1746066805.931650:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305180, transno 17179875083 00000004:00080000:0.0:1746066805.932734:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765c00, transno 17179875084 00000004:00080000:0.0:1746066805.932737:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211f80, transno 17179875085 00000004:00080000:0.0:1746066805.932739:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305f80, transno 17179875086 00000004:00080000:0.0:1746066805.932741:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213480, transno 17179875087 00000004:00080000:0.0:1746066805.932743:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307800, transno 17179875088 00000004:00080000:0.0:1746066805.932745:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958adf80, transno 17179875089 00000004:00080000:0.0:1746066805.932747:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765180, transno 17179875090 00000004:00080000:0.0:1746066805.932750:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213100, transno 17179875091 00000004:00080000:0.0:1746066805.932753:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803b80, transno 17179875102 00000004:00080000:0.0:1746066805.932755:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803800, transno 17179875103 00000004:00080000:0.0:1746066805.932757:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801500, transno 17179875104 00000004:00080000:0.0:1746066805.932759:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d802300, transno 17179875105 00000004:00080000:0.0:1746066805.932761:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800e00, transno 17179875106 00000004:00080000:0.0:1746066805.932763:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800a80, transno 17179875107 00000004:00080000:0.0:1746066805.932765:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801880, transno 17179875108 00000004:00080000:0.0:1746066805.932767:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e3b80, transno 17179875109 00000004:00080000:0.0:1746066805.932769:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800700, transno 17179875110 00000004:00080000:0.0:1746066805.932771:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f712d80, transno 17179875111 00000004:00080000:0.0:1746066805.932774:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711c00, transno 17179875112 00000004:00080000:0.0:1746066805.932776:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711180, transno 17179875113 00000004:00080000:0.0:1746066805.932778:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710e00, transno 17179875114 00000004:00080000:0.0:1746066805.932780:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710380, transno 17179875115 00000004:00080000:0.0:1746066805.932783:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713100, transno 17179875116 00000004:00080000:0.0:1746066805.932785:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b165c00, transno 17179875117 00000004:00080000:0.0:1746066805.932787:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713b80, transno 17179875118 00000004:00080000:0.0:1746066805.932793:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710000, transno 17179875119 00000004:00080000:0.0:1746066805.932795:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e423800, transno 17179875126 00000004:00080000:0.0:1746066805.932796:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764a80, transno 17179875127 00000004:00080000:0.0:1746066805.932798:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095875880, transno 17179875128 00000004:00080000:0.0:1746066805.932800:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422300, transno 17179875129 00000004:00080000:0.0:1746066805.932802:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094378a80, transno 17179875130 00000004:00080000:0.0:1746066805.932804:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765500, transno 17179875131 00000004:00080000:0.0:1746066805.932805:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420e00, transno 17179875132 00000004:00080000:0.0:1746066805.932807:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767800, transno 17179875133 00000004:00080000:0.0:1746066805.932809:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095868380, transno 17179875134 00000004:00080000:0.0:1746066805.932811:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0dc00, transno 17179875138 00000004:00080000:0.0:1746066805.932813:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dec000, transno 17179875139 00000004:00080000:0.0:1746066805.932815:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0df80, transno 17179875140 00000004:00080000:0.0:1746066805.932817:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dec380, transno 17179875141 00000004:00080000:0.0:1746066805.932819:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0d500, transno 17179875142 00000004:00080000:0.0:1746066805.932820:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0d180, transno 17179875143 00000004:00080000:0.0:1746066805.932822:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dec700, transno 17179875144 00000004:00080000:0.0:1746066805.932823:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095deca80, transno 17179875145 00000004:00080000:0.0:1746066805.932825:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c00000, transno 17179875146 00000004:00080000:0.0:1746066805.932827:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094377800, transno 17179875147 00000004:00080000:0.0:1746066805.932829:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094377480, transno 17179875148 00000004:00080000:0.0:1746066805.932830:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094377100, transno 17179875149 00000004:00080000:0.0:1746066805.932832:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094375180, transno 17179875150 00000004:00080000:0.0:1746066805.932834:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094377b80, transno 17179875151 00000004:00080000:0.0:1746066805.932835:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094374a80, transno 17179875152 00000004:00080000:0.0:1746066805.932837:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094375500, transno 17179875153 00000004:00080000:0.0:1746066805.932838:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094374380, transno 17179875154 00000004:00080000:0.0:1746066805.932840:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd4a80, transno 17179875155 00000004:00080000:0.0:1746066805.932842:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34700, transno 17179875159 00000004:00080000:0.0:1746066805.932844:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36680, transno 17179875160 00000004:00080000:0.0:1746066805.932845:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37b80, transno 17179875161 00000004:00080000:0.0:1746066805.932849:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37480, transno 17179875162 00000004:00080000:0.0:1746066805.932850:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35f80, transno 17179875163 00000004:00080000:0.0:1746066805.932852:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36a00, transno 17179875164 00000004:00080000:0.0:1746066805.932854:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35880, transno 17179875165 00000004:00080000:0.0:1746066805.932856:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34a80, transno 17179875166 00000004:00080000:0.0:1746066805.932857:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37800, transno 17179875167 00000004:00080000:0.0:1746066805.932859:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094370700, transno 17179875168 00000004:00080000:0.0:1746066805.932860:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094373800, transno 17179875169 00000004:00080000:0.0:1746066805.932862:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094370e00, transno 17179875170 00000004:00080000:0.0:1746066805.932864:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372300, transno 17179875171 00000004:00080000:0.0:1746066805.932865:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371180, transno 17179875172 00000004:00080000:0.0:1746066805.932868:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372a00, transno 17179875173 00000004:00080000:0.0:1746066805.932869:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094370000, transno 17179875174 00000004:00080000:0.0:1746066805.932871:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372d80, transno 17179875175 00000004:00080000:0.0:1746066805.932872:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35180, transno 17179875176 00000004:00080000:0.0:1746066805.932874:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094373480, transno 17179875178 00000004:00080000:0.0:1746066805.932876:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371c00, transno 17179875179 00000004:00080000:0.0:1746066805.932877:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371880, transno 17179875180 00000004:00080000:0.0:1746066805.932879:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094370380, transno 17179875181 00000004:00080000:0.0:1746066805.932897:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986ced80, transno 17179875182 00000004:00080000:0.0:1746066805.932899:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cdc00, transno 17179875183 00000004:00080000:0.0:1746066805.932901:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cd880, transno 17179875184 00000004:00080000:0.0:1746066805.932903:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cfb80, transno 17179875185 00000004:00080000:0.0:1746066805.932905:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371500, transno 17179875186 00000004:00080000:0.0:1746066805.932906:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d7480, transno 17179875190 00000004:00080000:0.0:1746066805.932908:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4a80, transno 17179875191 00000004:00080000:0.0:1746066805.932910:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4000, transno 17179875192 00000004:00080000:0.0:1746066805.932911:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4e00, transno 17179875193 00000004:00080000:0.0:1746066805.932913:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4700, transno 17179875194 00000004:00080000:0.0:1746066805.932915:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d5c00, transno 17179875195 00000004:00080000:0.0:1746066805.932917:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d6680, transno 17179875196 00000004:00080000:0.0:1746066805.932919:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d5180, transno 17179875197 00000004:00080000:0.0:1746066805.932920:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d6d80, transno 17179875198 00000004:00080000:0.0:1746066805.932922:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54fb80, transno 17179875199 00000004:00080000:0.0:1746066805.932924:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cd500, transno 17179875200 00000004:00080000:0.0:1746066805.932925:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54ce00, transno 17179875201 00000004:00080000:0.0:1746066805.932927:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54dc00, transno 17179875202 00000004:00080000:0.0:1746066805.932929:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54ed80, transno 17179875203 00000004:00080000:0.0:1746066805.932931:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54df80, transno 17179875204 00000004:00080000:0.0:1746066805.932932:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54e300, transno 17179875205 00000004:00080000:0.0:1746066805.932934:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54f480, transno 17179875206 00000004:00080000:0.0:1746066805.932936:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096eca300, transno 17179875207 00000004:00080000:0.0:1746066805.932938:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760e00, transno 17179875208 00000004:00080000:0.0:1746066805.932940:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f761880, transno 17179875209 00000004:00080000:0.0:1746066805.932943:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762d80, transno 17179875210 00000004:00080000:0.0:1746066805.932945:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c491500, transno 17179875211 00000004:00080000:0.0:1746066805.932946:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762680, transno 17179875212 00000004:00080000:0.0:1746066805.932948:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f763100, transno 17179875213 00000004:00080000:0.0:1746066805.932950:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b2a00, transno 17179875214 00000004:00080000:0.0:1746066805.932952:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760000, transno 17179875215 00000004:00080000:0.0:1746066805.932954:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b1180, transno 17179875216 00000004:00080000:0.0:1746066805.932956:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666d500, transno 17179875217 00000004:00080000:0.0:1746066805.932957:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666f800, transno 17179875218 00000004:00080000:0.0:1746066805.932959:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666df80, transno 17179875219 00000004:00080000:0.0:1746066805.932961:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666f480, transno 17179875220 00000004:00080000:0.0:1746066805.932963:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666d180, transno 17179875221 00000004:00080000:0.0:1746066805.932965:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666c700, transno 17179875222 00000004:00080000:0.0:1746066805.932967:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ed80, transno 17179875223 00000004:00080000:0.0:1746066805.932968:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666c380, transno 17179875224 00000100:00100000:0.0:1746066805.932973:0:3777:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a4d26680 x1830882985003520/t17179875225(17179875225) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066821 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066805.933244:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c03480/2, rc 0, transno 17179875232 00000100:00100000:0.0:1746066805.933248:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066805.933258:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c00a80/2, rc 0, transno 17179875233 00000100:00100000:0.0:1746066805.933260:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066805.933267:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d82a00/2, rc 0, transno 21474842614 00000100:00100000:0.0:1746066805.933269:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985013760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066805.933276:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c02680/2, rc 0, transno 17179875238 00000100:00100000:0.0:1746066805.933279:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985014656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066805.933285:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c03b80/2, rc 0, transno 17179875239 00000100:00100000:0.0:1746066805.933287:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985015168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066805.933743:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 9 in progress, 0 in flight, 125 done 00000004:00080000:0.0:1746066805.934106:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 96 done 00000100:00100000:0.0:1746066805.936654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.939581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.942799:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.942836:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.942864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.942878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.942977:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.944942:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.950481:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.950525:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.952025:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.957099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.958832:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19767 00000100:00100000:0.0:1746066805.958839:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985198976:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066805.958874:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985198976:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.958880:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19767 00000100:00100000:0.0:1746066805.958907:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19769 00000100:00100000:0.0:1746066805.958911:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985198848:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066805.958941:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985198848:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.958946:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19769 00000100:00100000:0.0:1746066805.959187:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.965519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.965554:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.965599:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066805.965959:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7360 00000100:00100000:0.0:1746066805.965966:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985200000:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066805.965982:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfaff0f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.965988:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.965990:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.965992:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfaff0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.965999:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfaff0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066805.967649:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.026637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066806.027756:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066806.030231:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066806.030846:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066806.033146:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.033432:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9018 00000100:00100000:0.0:1746066806.033441:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985201792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.033457:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.033479:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfafede lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68a3 expref: 12 pid: 20361 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066806.033491:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfafede lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68a3 expref: 12 pid: 20361 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066806.033559:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfafede lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68a3 expref: 12 pid: 20361 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746066806.034319:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.034354:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985201792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 913us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.034361:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9018 00000100:00100000:0.0:1746066806.038623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066806.041503:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066806.047009:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.052267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.054802:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.057467:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.060922:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.064718:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.068947:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.071283:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.075079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.078447:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.079749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.079765:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.079780:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.079808:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.080215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.087741:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.098339:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.103900:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985017088 00000100:00100000:0.0:1746066806.103907:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985017088 00000100:00100000:0.0:1746066806.103993:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985017216 00000100:00100000:0.0:1746066806.103996:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985017216 00000100:00100000:0.0:1746066806.104009:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985017600 00000100:00100000:0.0:1746066806.104010:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985017600 00000100:00100000:0.0:1746066806.104151:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19784 00000100:00100000:0.0:1746066806.104157:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3775:x1830882985017216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066806.104239:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066806.104242:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.104244:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.104246:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066806.104248:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066806.104271:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3775:x1830882985017216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (389us total) trans 21474842621 rc 0/0 00000100:00100000:0.0:1746066806.105124:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19784 00000100:00100000:0.0:1746066806.105674:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19791 00000100:00100000:0.0:1746066806.105680:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3776:x1830882985018368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.105752:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066806.105754:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.105757:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.105758:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066806.105760:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066806.105777:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985018368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (195us total) trans 17179875244 rc 0/0 00000100:00100000:0.0:1746066806.105782:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19791 00000100:00100000:0.0:1746066806.106290:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985018624 00000100:00100000:0.0:1746066806.106293:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985018624 00000100:00100000:0.0:1746066806.106307:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19796 00000100:00100000:0.0:1746066806.106311:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985018624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.106344:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985019136 00000100:00100000:0.0:1746066806.106346:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985019136 00000100:00100000:0.0:1746066806.106358:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985018240 00000100:00100000:0.0:1746066806.106359:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985018240 00000100:00100000:0.0:1746066806.106367:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985018752 00000100:00100000:0.0:1746066806.106369:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985018752 00000100:00100000:0.0:1746066806.106379:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19798 00000100:00100000:0.0:1746066806.106382:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882985018240:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.106880:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f763100/2, rc 0, transno 17179875245 00000100:00100000:0.0:1746066806.106898:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985018880:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.107242:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066806.107244:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.107246:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066806.107247:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.107249:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066806.107267:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985018624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 955us (1076us total) trans 17179875249 rc 0/0 00000100:00100000:0.0:1746066806.107273:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19796 00002000:00010000:0.0:1746066806.107801:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066806.107804:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.107807:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.107809:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066806.107811:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066806.107833:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985018240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1449us (1499us total) trans 17179875251 rc 0/0 00000100:00100000:0.0:1746066806.107839:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19798 00000004:00080000:0.0:1746066806.108094:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f762680/2, rc 0, transno 17179875252 00000100:00100000:0.0:1746066806.108098:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985018752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.112675:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.139210:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.142549:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.146716:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.149537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066806.150734:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066806.151854:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.153291:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.154074:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.157064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.157328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.158419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.158458:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.165631:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985020032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.165660:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.165679:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985020160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.165694:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.165784:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985020672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.165804:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.165824:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985021184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.165846:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020032 00000100:00100000:0.0:1746066806.165849:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020032 00000100:00100000:0.0:1746066806.165875:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020160 00000100:00100000:0.0:1746066806.165877:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020160 00000100:00100000:0.0:1746066806.165912:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020416 00000100:00100000:0.0:1746066806.165914:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020416 00000100:00100000:0.0:1746066806.165923:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020672 00000100:00100000:0.0:1746066806.165925:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020672 00000100:00100000:0.0:1746066806.165934:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020288 00000100:00100000:0.0:1746066806.165936:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020288 00000100:00100000:0.0:1746066806.165941:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985020800 00000100:00100000:0.0:1746066806.165943:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985020800 00000100:00100000:0.0:1746066806.165948:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985021312 00000100:00100000:0.0:1746066806.165949:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985021312 00000100:00100000:0.0:1746066806.165960:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19802 00000100:00100000:0.0:1746066806.165967:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985020032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.166075:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19804 00000100:00100000:0.0:1746066806.166080:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985020416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.166122:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066806.166124:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.166126:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066806.166128:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.166129:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066806.166154:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985020416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (402us total) trans 17179875255 rc 0/0 00000100:00100000:0.0:1746066806.166159:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19804 00000100:00100000:0.0:1746066806.166171:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19806 00000100:00100000:0.0:1746066806.166175:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3774:x1830882985020288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.166233:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3774:x1830882985020288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (398us total) trans 17179875257 rc 0/0 00000100:00100000:0.0:1746066806.166241:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19806 00000100:00100000:0.0:1746066806.166251:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19809 00000100:00100000:0.0:1746066806.166255:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985021824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166312:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3774:x1830882985021824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (384us total) trans 21474842628 rc 0/0 00000100:00100000:0.0:1746066806.166317:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19809 00000100:00100000:0.0:1746066806.166327:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19810 00000100:00100000:0.0:1746066806.166331:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3775:x1830882985021440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166380:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3775:x1830882985021440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (265us total) trans 21474842630 rc 0/0 00000100:00100000:0.0:1746066806.166386:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19810 00000100:00100000:0.0:1746066806.166405:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985020544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.166421:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.166440:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985021056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166453:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.166462:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985021568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166569:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066806.166588:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e213100/2, rc 0, transno 17179875253 00000100:00100000:0.0:1746066806.166592:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985020032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.166600:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211880/2, rc 0, transno 17179875259 00000100:00100000:0.0:1746066806.166604:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985020544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.166616:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492d80/2, rc 0, transno 21474842632 00000100:00100000:0.0:1746066806.166619:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985021056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166634:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.166651:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985021696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.166669:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066806.166921:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212d80/2, rc 0, transno 17179875254 00000100:00100000:0.0:1746066806.166925:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985020160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.166932:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211c00/2, rc 0, transno 17179875256 00000100:00100000:0.0:1746066806.166935:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985020672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.166942:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491880/2, rc 0, transno 21474842634 00000100:00100000:0.0:1746066806.166945:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985021184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.166959:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83b80/2, rc 0, transno 21474842633 00000100:00100000:0.0:1746066806.166962:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985021568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.167010:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81880/2, rc 0, transno 21474842635 00000100:00100000:0.0:1746066806.167014:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985021696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.167048:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985021952 00000100:00100000:0.0:1746066806.167051:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985021952 00000100:00100000:0.0:1746066806.167068:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19818 00000100:00100000:0.0:1746066806.167072:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882985021952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.167137:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3774:x1830882985021952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (105us total) trans 17179875261 rc 0/0 00000100:00100000:0.0:1746066806.167143:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19818 00000100:00100000:0.0:1746066806.171320:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6426 00000100:00100000:0.0:1746066806.171331:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3094:x1830882985206912:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066806.171426:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3094:x1830882985206912:12345-192.168.204.16@tcp:49:cat.0 Request processed in 98us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.171432:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6426 00000100:00100000:0.0:1746066806.181921:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.181958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.182007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.182495:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.182968:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985207680 00000100:00100000:0.0:1746066806.182972:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985207680 00000100:00100000:0.0:1746066806.183003:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985207808 00000100:00100000:0.0:1746066806.183006:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985207808 00000100:00100000:0.0:1746066806.183019:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19819 00000100:00100000:0.0:1746066806.183024:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:3092:x1830882985207680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.183034:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.183050:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfb0004 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6936 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183075:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfaff6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68f0 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183082:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.183084:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.183087:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfb0004 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3989504->4141055] (req 3989504->4141055) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6936 expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183116:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfaff6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68f0 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183132:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfaff6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68f0 expref: 10 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.183144:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985022336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.183244:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066806.183261:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066806.183273:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19820 00000100:00100000:0.0:1746066806.183278:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+31:3090:x1830882985207808:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.183284:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.183293:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfb000b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d693d expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183306:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfaff5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e2 expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183312:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.183313:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.183316:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfb000b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1523712->1839103] (req 1523712->1839103) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d693d expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183329:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfaff5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e2 expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.183337:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfaff5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e2 expref: 11 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.183349:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985022464:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.183368:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.189064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.192718:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985022464:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066806.192739:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfb000b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1523712->1839103] (req 1523712->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d693d expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.192751:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00000100:00100000:0.0:1746066806.192776:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+32:3090:x1830882985207808:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9497us (10281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.192783:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19820 00000100:00100000:0.0:1746066806.197683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.202972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.210583:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.210665:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.215968:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.216210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.216239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.217654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.222174:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985210240 00000100:00100000:0.0:1746066806.222184:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985210240 00002000:00100000:0.0:1746066806.222228:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5827480 x1830882985210240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.222238:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827480 with x1830882985210240 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.222245:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5827480 00000100:00100000:0.0:1746066806.222279:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7373 00000100:00100000:0.0:1746066806.222287:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985210240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066806.227687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.227733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.227762:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.227789:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066806.228317:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066806.240819:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985210880 00000100:00100000:0.0:1746066806.240829:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985210880 00000100:00100000:0.0:1746066806.240907:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19823 00000100:00100000:0.0:1746066806.240914:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:3094:x1830882985210880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.240929:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.240942:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb0020 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6952 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.240967:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfaff55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68db expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.240973:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.240975:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.240978:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb0020 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6952 expref: 8 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.241004:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfaff55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68db expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.241018:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfaff55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68db expref: 8 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.241029:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985023104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.241109:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.246265:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.250477:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.252730:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.255136:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.256098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.256155:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.262545:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.272354:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.272388:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.272417:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.273218:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.278454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.281413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.285604:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.287899:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.287926:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.287953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.288086:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213824 00000100:00100000:0.0:1746066806.288092:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213824 00010000:00010000:0.0:1746066806.288118:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0da00/0xf1867c21abfb0043 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6960 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.288150:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9033 00000100:00100000:0.0:1746066806.288155:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985213824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.288165:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.288171:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0da00/0xf1867c21abfb0043 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6960 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.288182:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0da00/0xf1867c21abfb0043 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6960 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.288203:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0da00/0xf1867c21abfb0043 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6960 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.288219:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066806.288223:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb007b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.288232:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb007b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.288239:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb007b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.288255:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.288274:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985213824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.288280:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9033 00000100:00100000:0.0:1746066806.291602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.293873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.300142:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985024640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066806.300171:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c800/0xf1867c21abfb00b3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69b4 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.300189:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c800, rc 0) 00000100:00100000:0.0:1746066806.300237:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3093:x1830882985214592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4707us (5272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.300246:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19834 00000100:00100000:0.0:1746066806.302059:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215104 00000100:00100000:0.0:1746066806.302064:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215104 00010000:00010000:0.0:1746066806.302085:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfaff63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e9 expref: 14 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.302113:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9035 00000100:00100000:0.0:1746066806.302118:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985215104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.302126:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.302144:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfaff63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e9 expref: 14 pid: 20361 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.302154:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfaff63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e9 expref: 14 pid: 20361 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.302171:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfaff63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d68e9 expref: 14 pid: 20361 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746066806.302185:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.302187:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.302192:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c800/0xf1867c21abfb00b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69b4 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.302199:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c800/0xf1867c21abfb00b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69b4 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.302219:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c800/0xf1867c21abfb00b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69b4 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.302228:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985025152:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066806.302291:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066806.312137:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e363400/0xf1867c21abfaffe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6913 expref: 31 pid: 1893 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.312151:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985025024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.312160:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985025280:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.312167:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094373800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985025408:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066806.312183:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315230:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315239:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315262:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315269:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315276:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315283:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066806.315286:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315293:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315304:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.315310:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfb00cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.315344:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985215232:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13885us (14181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.315350:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19837 00000100:00100000:0.0:1746066806.319426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.319457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.319473:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066806.319837:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.319842:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfb00dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.319849:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfb00dd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.319862:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.319871:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985217408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.319875:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9044 00000100:00100000:0.0:1746066806.325369:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.328186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066806.329334:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329342:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329358:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329365:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329375:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329382:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066806.329385:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329392:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329403:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.329412:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfb00c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.329469:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985215616:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 28244us (28887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.329476:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19835 00000100:00100000:0.0:1746066806.331336:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.332661:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066806.332837:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.332846:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.332858:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985217920 00000100:00100000:0.0:1746066806.332862:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985217920 00010000:00010000:1.0:1746066806.332863:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.332869:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.332875:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.332881:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066806.332899:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.332906:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19842 00010000:00010000:1.0:1746066806.332908:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.332911:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+22:3093:x1830882985217920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066806.332918:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.332923:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfb00c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.332925:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.332938:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfb00f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d69c9 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066806.332949:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd77, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x1000 00010000:00010000:0.0:1746066806.332962:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.332963:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066806.332966:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985215872:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 31703us (31949us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.332968:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfb00f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c9 expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.332972:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19836 00010000:00010000:0.0:1746066806.332979:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfb00f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c9 expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.332986:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6000, rc 0) 00000100:00100000:0.0:1746066806.333001:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:3093:x1830882985217920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.333005:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19842 00000100:00100000:0.0:1746066806.333585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.337924:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.344163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.344220:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.352298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.352520:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.352815:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9049 00000100:00100000:1.0:1746066806.352824:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985219072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.352831:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.352835:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfaffef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6928 expref: 11 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.352843:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfaffef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6928 expref: 11 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.352946:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfaffef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6928 expref: 11 pid: 7243 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.353383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066806.353426:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066806.353430:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b000/0xf1867c21abfb00f9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066806.353437:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.353458:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985219072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 636us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.353463:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9049 00000100:00100000:0.0:1746066806.356216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:1.0:1746066806.357250:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937597 is committed 00000004:00080000:1.0:1746066806.357257:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1129 committed 00000004:00080000:1.0:1746066806.357275:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1115 committed 00000004:00080000:1.0:1746066806.357478:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1114 committed 00000004:00080000:1.0:1746066806.357481:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1113 committed 00000004:00080000:1.0:1746066806.357482:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1112 committed 00000004:00080000:1.0:1746066806.357483:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1128 committed 00000004:00080000:1.0:1746066806.357484:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1111 committed 00000004:00080000:1.0:1746066806.357486:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1127 committed 00000004:00080000:1.0:1746066806.357487:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1110 committed 00000004:00080000:1.0:1746066806.357488:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1126 committed 00000004:00080000:1.0:1746066806.357490:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1125 committed 00000004:00080000:1.0:1746066806.357491:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1124 committed 00000004:00080000:1.0:1746066806.357492:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1109 committed 00000004:00080000:1.0:1746066806.357494:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1108 committed 00000004:00080000:1.0:1746066806.357495:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1123 committed 00000004:00080000:1.0:1746066806.357496:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1122 committed 00000004:00080000:1.0:1746066806.357498:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1107 committed 00000001:00080000:1.0:1746066806.357506:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937594 is committed 00000001:00080000:1.0:1746066806.357509:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937593 is committed 00000100:00100000:0.0:1746066806.357790:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985026944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.357831:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.357853:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.357903:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.357919:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066806.357923:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.357937:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.357946:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.357958:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.357981:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985026944 00000100:00100000:0.0:1746066806.357984:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985026944 00000100:00100000:1.0:1746066806.360038:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.360128:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.360143:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985028224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.360166:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.360180:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985028736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.360193:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.360201:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066806.360206:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985028352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.360218:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.360226:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985028864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.360239:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.360251:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028096 00000100:00100000:1.0:1746066806.360254:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028096 00000100:00100000:1.0:1746066806.360267:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028224 00000100:00100000:1.0:1746066806.360268:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028224 00000100:00100000:1.0:1746066806.360274:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028736 00000100:00100000:1.0:1746066806.360275:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028736 00000100:00100000:1.0:1746066806.360282:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028352 00000100:00100000:1.0:1746066806.360283:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028352 00000100:00100000:1.0:1746066806.360289:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028864 00000100:00100000:1.0:1746066806.360291:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028864 00000100:00100000:0.0:1746066806.360540:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19855 00000100:00100000:0.0:1746066806.360547:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882985028736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.360617:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882985028736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (422us total) trans 21474842640 rc 0/0 00000100:00100000:0.0:1746066806.360625:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19855 00000100:00100000:0.0:1746066806.360635:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19857 00000100:00100000:0.0:1746066806.360638:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882985028352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.360688:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882985028352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (469us total) trans 21474842642 rc 0/0 00000100:00100000:0.0:1746066806.360692:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19857 00000100:00100000:0.0:1746066806.360701:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19859 00000100:00100000:0.0:1746066806.360705:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882985026944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.360757:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985026944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (2926us total) trans 17179875270 rc 0/0 00000100:00100000:0.0:1746066806.360761:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19859 00000100:00100000:0.0:1746066806.360782:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985219584 00000100:00100000:0.0:1746066806.360785:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985219584 00000100:00100000:0.0:1746066806.360806:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17138 00000100:00100000:0.0:1746066806.360810:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:3093:x1830882985219584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.360822:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.360834:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d69de expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.360900:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b000/0xf1867c21abfb00f9 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.360908:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.360922:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b000/0xf1867c21abfb00f9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746066806.361320:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19860 00000100:00100000:1.0:1746066806.361325:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882985028864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.361406:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882985028864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1165us total) trans 21474842644 rc 0/0 00000100:00100000:1.0:1746066806.361411:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19860 00010000:00010000:0.0:1746066806.361685:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.361703:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066806.361705:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066806.361707:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf7800, rc 0) 00000100:00100000:0.0:1746066806.361726:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3093:x1830882985219584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 915us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.361731:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17138 00000004:00080000:0.0:1746066806.361760:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f54000/2, rc 0, transno 17179875264 00000100:00100000:0.0:1746066806.361763:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.361771:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f55180/2, rc 0, transno 17179875265 00000100:00100000:0.0:1746066806.361773:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.361779:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f57100/2, rc 0, transno 17179875270 00000100:00100000:0.0:1746066806.361781:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985026944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066806.361787:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f54e00/2, rc 0, transno 17179875263 00000100:00100000:0.0:1746066806.361789:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985027456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.361804:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985028992 00000100:00100000:0.0:1746066806.361806:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985028992 00000100:00100000:0.0:1746066806.361821:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19861 00000100:00100000:0.0:1746066806.361824:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882985028992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.361907:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3777:x1830882985028992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (368us total) trans 17179875271 rc 0/0 00000100:00100000:0.0:1746066806.361912:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19861 00000100:00100000:0.0:1746066806.364528:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.364581:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.364783:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.366003:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985220096 00000100:00100000:0.0:1746066806.366008:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985220096 00000100:00100000:0.0:1746066806.366037:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6430 00000100:00100000:0.0:1746066806.366042:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ba1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3093:x1830882985220096:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066806.366100:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ba1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3093:x1830882985220096:12345-192.168.204.16@tcp:49:cat.0 Request processed in 57us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.366106:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6430 00000100:00100000:0.0:1746066806.369826:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.371313:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066806.372954:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.372962:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066806.372979:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066806.373084:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373090:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373096:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373101:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066806.373105:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373113:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373123:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066806.373126:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066806.373129:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373133:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb0131 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373165:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373170:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373175:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373179:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373183:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066806.373185:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373189:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373196:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066806.373198:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066806.373200:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373205:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb011c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373214:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373219:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373222:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373226:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066806.373228:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373233:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373238:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34ea00) 00010000:00010000:0.0:1746066806.373240:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066806.373243:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373248:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb012a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.373290:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb0115 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69ec expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.373297:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb0115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69ec expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.373305:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8000, rc 0) 00000100:00100000:0.0:1746066806.374633:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3099:x1830882985219968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9936us (10107us total) trans 8589937598 rc 301/301 00000100:00100000:0.0:1746066806.374642:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17139 00000100:00100000:0.0:1746066806.376544:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.378955:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.379004:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.384142:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.385235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.386104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.386134:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985221632 00000100:00100000:0.0:1746066806.386143:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985221632 00002000:00100000:0.0:1746066806.386186:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880097a8a300 x1830882985221632/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.386196:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882985221632 ext(2097152->4194303) 00002000:00010000:0.0:1746066806.386202:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a300 00000100:00100000:0.0:1746066806.386236:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985221888 00000100:00100000:0.0:1746066806.386239:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985221888 00002000:00100000:0.0:1746066806.386251:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880097a8b800 x1830882985221888/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.386258:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882985221888 ext(3145728->4194303) 00002000:00010000:0.0:1746066806.386261:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:0.0:1746066806.391349:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7382 00000100:00100000:0.0:1746066806.391369:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985221632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066806.403964:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.407600:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985222144 00000100:00100000:0.0:1746066806.407611:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985222144 00000100:00100000:0.0:1746066806.407671:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17142 00000100:00100000:0.0:1746066806.407678:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3099:x1830882985222144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.407701:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.407704:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066806.407732:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd000/0xf1867c21abfb0123 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69e5 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.407753:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066806.407757:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066806.407768:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb0146 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d69fa expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.407818:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.407830:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 27 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.407838:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.407845:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066806.407875:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.407909:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 8 pid: 7243 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.407920:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985029376:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066806.407997:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 27 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.408005:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 27 pid: 10125 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746066806.408012:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985029504:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.408029:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.418409:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.418796:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.419443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.419620:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985221632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 28259us (34386us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066806.419627:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7382 00002000:00100000:0.0:1746066806.419637:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880097a8a300 x1830882985221632/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.419645:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882985221632 ext(2097152->4194303) 00002000:00010000:0.0:1746066806.419649:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a300 00000100:00100000:1.0:1746066806.419749:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985222272 00000100:00100000:1.0:1746066806.419753:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985222272 00010000:00010000:1.0:1746066806.419767:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746066806.419793:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9052 00000100:00100000:1.0:1746066806.419798:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985222400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.419806:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.419810:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 29 pid: 10125 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419819:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 29 pid: 10125 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419841:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cf7800/0xf1867c21abfb010e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69de expref: 29 pid: 10125 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419854:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066806.419857:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066806.419863:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066806.419867:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.419896:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985222400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.419902:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9052 00000100:00100000:1.0:1746066806.419912:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9053 00000100:00100000:1.0:1746066806.419917:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985222272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.419923:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.419927:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419934:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419945:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0138 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69f3 expref: 9 pid: 7243 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.419952:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066806.419955:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066806.419961:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066806.419967:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066806.419973:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.419999:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.420013:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985222272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.420018:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9053 00000001:00080000:1.0:1746066806.425928:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937601 is committed 00000004:00080000:1.0:1746066806.425936:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1137 committed 00000004:00080000:1.0:1746066806.425944:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1124 committed 00000004:00080000:1.0:1746066806.425950:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1123 committed 00000004:00080000:1.0:1746066806.425951:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1122 committed 00000004:00080000:1.0:1746066806.425953:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1121 committed 00000004:00080000:1.0:1746066806.425955:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1136 committed 00000004:00080000:1.0:1746066806.425956:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1120 committed 00000004:00080000:1.0:1746066806.425958:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1135 committed 00000004:00080000:1.0:1746066806.425959:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1119 committed 00000004:00080000:1.0:1746066806.425961:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1134 committed 00000004:00080000:1.0:1746066806.425962:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1133 committed 00000004:00080000:1.0:1746066806.425964:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1132 committed 00000004:00080000:1.0:1746066806.425965:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1118 committed 00000004:00080000:1.0:1746066806.425967:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1117 committed 00000004:00080000:1.0:1746066806.425968:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1131 committed 00000004:00080000:1.0:1746066806.425970:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1130 committed 00000004:00080000:1.0:1746066806.425971:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1116 committed 00000001:00080000:1.0:1746066806.425976:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937600 is committed 00010000:00010000:1.0:1746066806.426178:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426187:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066806.426189:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066806.426193:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426206:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426212:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426219:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426229:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426235:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.426256:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.426265:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985030656:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.426308:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.426315:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985030784:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.426332:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.426358:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19862 00000100:00100000:0.0:1746066806.426397:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985030016 00000100:00100000:0.0:1746066806.426401:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985030016 00000100:00100000:0.0:1746066806.426418:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19864 00000100:00100000:0.0:1746066806.426423:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3774:x1830882985029888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.426503:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066806.426506:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.426508:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:0.0:1746066806.426510:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066806.426512:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066806.426538:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882985029888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (316us total) trans 17179875273 rc 0/0 00000100:00100000:0.0:1746066806.426544:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19864 00000100:00100000:0.0:1746066806.426554:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19867 00000100:00100000:0.0:1746066806.426570:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882985030144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.426609:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066806.426611:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.426613:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066806.426615:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.426617:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066806.426635:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882985030144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (300us total) trans 17179875275 rc 0/0 00000100:00100000:0.0:1746066806.426640:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19867 00000100:00100000:0.0:1746066806.426651:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19869 00000100:00100000:0.0:1746066806.426656:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882985030528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066806.426693:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:0.0:1746066806.426695:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.426697:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066806.426698:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066806.426700:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066806.426717:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882985030528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (330us total) trans 17179875277 rc 0/0 00000100:00100000:0.0:1746066806.426721:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19869 00000100:00100000:0.0:1746066806.426802:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.426826:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.426840:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.426857:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.426868:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746066806.426872:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985030912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.426905:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.426913:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.426927:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.426934:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.426946:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.427098:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882985029760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066806.428336:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19874 00000100:00100000:1.0:1746066806.428377:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882985029760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2012us (2253us total) trans 17179875280 rc 0/0 00000100:00100000:1.0:1746066806.428383:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19862 00000100:00100000:1.0:1746066806.428395:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19877 00000100:00100000:1.0:1746066806.428400:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985031424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.428414:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19878 00000100:00100000:1.0:1746066806.428418:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882985031936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.428484:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3776:x1830882985031936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1537us total) trans 21474842650 rc 0/0 00000100:00100000:1.0:1746066806.428489:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19878 00000100:00100000:1.0:1746066806.428551:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985031424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (1623us total) trans 21474842651 rc 0/0 00000100:00100000:1.0:1746066806.428570:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19877 00000100:00100000:0.0:1746066806.428615:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3776:x1830882985031808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066806.428901:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985031808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 538us (2023us total) trans 21474842652 rc 0/0 00000100:00100000:0.0:1746066806.428907:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19874 00000004:00080000:0.0:1746066806.428932:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803100/2, rc 0, transno 21474842649 00000100:00100000:0.0:1746066806.428936:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985030912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.428942:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803b80/2, rc 0, transno 21474842651 00000100:00100000:0.0:1746066806.428945:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.428950:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802680/2, rc 0, transno 21474842650 00000100:00100000:0.0:1746066806.428953:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.428958:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802d80/2, rc 0, transno 21474842646 00000100:00100000:0.0:1746066806.428961:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066806.428966:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800000/2, rc 0, transno 21474842652 00000100:00100000:0.0:1746066806.428969:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985031808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.431119:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985030656:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.431132:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985030784:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.431175:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb0146 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 11 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066806.431194:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.431226:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82800, rc 0) 00000100:00100000:1.0:1746066806.431283:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3099:x1830882985222144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 23603us (27329us total) trans 8589937601 rc 0/0 00000100:00100000:1.0:1746066806.431290:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17142 00000100:00100000:0.0:1746066806.431366:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.431399:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.435039:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.438569:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.443573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.449026:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.449075:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.449106:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985224064 00000100:00100000:0.0:1746066806.449115:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985224064 00002000:00100000:0.0:1746066806.449163:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800958ae680 x1830882985224064/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.449173:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ae680 with x1830882985224064 ext(3145728->4194303) 00002000:00010000:0.0:1746066806.449179:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ae680 00000100:00100000:0.0:1746066806.449215:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7385 00000100:00100000:0.0:1746066806.449226:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985224064:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066806.450361:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.450508:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882985223296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11025us (11960us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.450516:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7384 00002000:00100000:1.0:1746066806.450525:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800958ad500 x1830882985223296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.450533:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad500 with x1830882985223296 ext(3145728->4194303) 00010000:00010000:1.0:1746066806.450541:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfb00f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c9 expref: 23 pid: 12255 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.450564:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6000/0xf1867c21abfb00f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c9 expref: 23 pid: 12255 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746066806.450571:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ad500 00000100:00100000:1.0:1746066806.450589:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985224192 00000100:00100000:1.0:1746066806.450593:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985224192 00002000:00100000:1.0:1746066806.450611:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880094306300 x1830882985224192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.450618:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882985224192 ext(3145728->4194303) 00010000:00010000:1.0:1746066806.450622:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d7 expref: 10 pid: 9590 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.450629:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d7 expref: 10 pid: 9590 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746066806.450635:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306300 00000100:00100000:1.0:1746066806.450649:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2125 00000100:00100000:1.0:1746066806.450654:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985224192:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066806.465689:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985224064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16459us (16610us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.465698:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7385 00002000:00100000:1.0:1746066806.465708:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800958ae680 x1830882985224064/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.465723:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ae680 with x1830882985224064 ext(3145728->4194303) 00002000:00010000:1.0:1746066806.465727:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ae680 00000100:00100000:1.0:1746066806.470949:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985225216 00000100:00100000:1.0:1746066806.470957:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985225216 00002000:00100000:1.0:1746066806.470994:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800986cdc00 x1830882985225216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.471002:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cdc00 with x1830882985225216 ext(4194304->4861951) 00002000:00010000:1.0:1746066806.471007:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cdc00 00000100:00100000:1.0:1746066806.471376:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7386 00000100:00100000:1.0:1746066806.471383:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985225216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066806.476940:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985224192:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 26276us (26572us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.476951:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2125 00002000:00100000:1.0:1746066806.476961:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880094306300 x1830882985224192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.476968:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882985224192 ext(3145728->4194303) 00010000:00010000:1.0:1746066806.476977:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d7 expref: 9 pid: 9590 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746066806.476989:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d7 expref: 9 pid: 9590 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746066806.476995:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306300 00000100:00100000:0.0:1746066806.478941:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.479004:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985225344 00000100:00100000:1.0:1746066806.479011:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985225344 00000100:00100000:1.0:1746066806.479271:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19885 00000100:00100000:1.0:1746066806.479281:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3094:x1830882985225344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066806.479294:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.479306:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a40 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.479326:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.479328:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.479334:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.479347:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.479355:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779800, rc 0) 00000100:00100000:1.0:1746066806.479387:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3094:x1830882985225344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 108us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.479392:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19885 00000100:00100000:0.0:1746066806.483513:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.484103:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.487518:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.487872:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985225728 00000100:00100000:1.0:1746066806.487877:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985225728 00000100:00100000:1.0:1746066806.488062:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19887 00000100:00100000:1.0:1746066806.488068:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985225728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066806.488081:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.488093:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb01bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a4e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.488118:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb01bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a4e expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.488126:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb01bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a4e expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.488146:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778400, rc 0) 00000100:00100000:1.0:1746066806.488177:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985225728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 109us (659us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066806.488182:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19887 00000100:00100000:0.0:1746066806.489784:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.489916:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.490019:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985226240 00000100:00100000:1.0:1746066806.490024:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985226240 00002000:00100000:1.0:1746066806.490043:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2142208->2146303) req@ffff8800958af480 x1830882985226240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.490050:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af480 with x1830882985226240 ext(2142208->2146303) 00002000:00010000:1.0:1746066806.490053:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958af480 00000100:00100000:1.0:1746066806.490066:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7388 00000100:00100000:1.0:1746066806.490071:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985226240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066806.490165:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985226240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 93us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066806.490172:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7388 00002000:00100000:1.0:1746066806.490176:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2142208->2146303) req@ffff8800958af480 x1830882985226240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.490188:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af480 with x1830882985226240 ext(2142208->2146303) 00002000:00010000:1.0:1746066806.490191:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958af480 00000100:00100000:0.0:1746066806.506832:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.513074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519625:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519716:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.519774:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985226880 00000100:00100000:0.0:1746066806.519781:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985226880 00000100:00100000:0.0:1746066806.519823:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985227136 00000100:00100000:0.0:1746066806.519825:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985227136 00000100:00100000:0.0:1746066806.519835:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985227008 00000100:00100000:0.0:1746066806.519837:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985227008 00000100:00100000:0.0:1746066806.519845:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985227264 00000100:00100000:0.0:1746066806.519846:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985227264 00000100:00100000:0.0:1746066806.520798:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19889 00000100:00100000:0.0:1746066806.520807:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.520815:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.520825:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb01cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a63 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.520838:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.520840:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.520845:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb01cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a63 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.520854:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb01cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a63 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.520861:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6e00, rc 0) 00000100:00100000:0.0:1746066806.520879:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985227136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.520898:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19889 00000100:00100000:0.0:1746066806.520912:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19890 00000100:00100000:0.0:1746066806.520916:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.520922:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.520927:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a5c expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.520936:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.520938:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.520941:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a5c expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.520949:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a5c expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.520955:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7200, rc 0) 00000100:00100000:0.0:1746066806.520970:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985227008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.520975:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19890 00000100:00100000:0.0:1746066806.520983:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19891 00000100:00100000:0.0:1746066806.520988:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.520993:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.520998:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb01d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a71 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.521013:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb01d9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a71 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.521025:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb01d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a71 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.521038:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6200, rc 0) 00000100:00100000:0.0:1746066806.521052:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (1362us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066806.521056:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19891 00000100:00100000:0.0:1746066806.521068:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19892 00000100:00100000:0.0:1746066806.521073:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985227264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.521079:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.521084:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a6a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.521094:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.521095:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.521098:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a6a expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.521107:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a6a expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.521114:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6000, rc 0) 00000100:00100000:0.0:1746066806.521126:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985227264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.521130:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19892 00000100:00100000:0.0:1746066806.526866:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.542492:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.542594:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985227776 00000100:00100000:1.0:1746066806.542605:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985227776 00000100:00100000:1.0:1746066806.542671:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19893 00000100:00100000:1.0:1746066806.542679:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066806.542694:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.542708:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb01e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a78 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.542735:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb01e7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a78 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.542744:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb01e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a78 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.542802:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31a00, rc 0) 00000100:00100000:1.0:1746066806.542855:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985227776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 177us (374us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066806.542860:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19893 00000100:00100000:0.0:1746066806.547375:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.547640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.548330:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985228032 00000100:00100000:1.0:1746066806.548334:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985228032 00000100:00100000:1.0:1746066806.550396:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19895 00000100:00100000:1.0:1746066806.550404:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:3102:x1830882985228032:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.550416:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.550431:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a86 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.550455:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.550462:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a6a expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.550468:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.550469:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.550472:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.550501:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a6a expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.550514:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfb01e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a6a expref: 15 pid: 11630 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746066806.550526:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032448:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066806.550606:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.550613:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746066806.550621:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032576:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066806.550640:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.551931:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032448:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066806.551942:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032576:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066806.551966:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [2007040->2097151] (req 2007040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.551977:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:1.0:1746066806.552010:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:3102:x1830882985228032:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1607us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.552016:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19895 00000100:00100000:0.0:1746066806.554213:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.554818:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.554924:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985228288 00000100:00100000:1.0:1746066806.554934:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985228288 00010000:00010000:1.0:1746066806.554971:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746066806.555048:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9057 00000100:00100000:1.0:1746066806.555055:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985228288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.555066:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.555083:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746066806.555093:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746066806.555111:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfb0193 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a32 expref: 34 pid: 9590 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746066806.555196:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.555239:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985228288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 183us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.555245:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9057 00000100:00100000:0.0:1746066806.559539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.562787:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.563012:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985228672 00000100:00100000:1.0:1746066806.563024:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985228672 00000100:00100000:1.0:1746066806.563096:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19896 00000100:00100000:1.0:1746066806.563104:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:3102:x1830882985228672:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.563121:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.563138:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a8d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.563171:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dcc4600/0xf1867c21abfb00eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c2 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.563179:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb0100 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d0 expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.563186:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.563187:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.563191:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->2777087] (req 2097152->2777087) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a8d expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.563221:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb0100 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d0 expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.563236:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb0100 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69d0 expref: 34 pid: 13726 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746066806.563248:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032832:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066806.564200:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dcc4600/0xf1867c21abfb00eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c2 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.564210:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dcc4600/0xf1867c21abfb00eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69c2 expref: 14 pid: 20361 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746066806.564220:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066806.564253:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.566844:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066806.568206:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.568284:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985032960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066806.568320:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->2777087] (req 2097152->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a8d expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.568338:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130800c00, rc 0) 00000100:00100000:1.0:1746066806.568401:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:3102:x1830882985228672:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5298us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.568409:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19896 00000100:00100000:0.0:1746066806.569647:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.575871:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.579094:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066806.636263:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066806.642089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.719181:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.729209:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.729707:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230080 00000100:00100000:1.0:1746066806.729718:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230080 00000100:00100000:1.0:1746066806.729772:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19897 00000100:00100000:1.0:1746066806.729780:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3108:x1830882985230080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.729800:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.729818:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6a9b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.729847:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a8d expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.729853:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.729855:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.729858:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->3334143] (req 3145728->3334143) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a9b expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.729914:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a8d expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.729924:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb01fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2777087) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a8d expref: 32 pid: 9592 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746066806.729935:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985033216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066806.730034:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.730129:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.738640:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.750594:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7396 00000100:00100000:0.0:1746066806.750603:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985231360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066806.773451:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.779623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.779663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.779685:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.779932:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985230848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 30303us (31421us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066806.779942:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7394 00002000:00100000:0.0:1746066806.779955:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88008e434380 x1830882985230848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.779965:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434380 with x1830882985230848 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.779970:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434380 00000100:00100000:0.0:1746066806.780025:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e436d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985033344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066806.780045:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.780064:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985231488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3980us (6623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.780073:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9060 00000100:00100000:0.0:1746066806.780108:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231616 00000100:00100000:0.0:1746066806.780115:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231616 00000100:00100000:0.0:1746066806.780142:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231744 00000100:00100000:0.0:1746066806.780143:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231744 00000100:00100000:0.0:1746066806.780152:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231872 00000100:00100000:0.0:1746066806.780153:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231872 00000100:00100000:0.0:1746066806.780166:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19899 00000100:00100000:0.0:1746066806.780172:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985231616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.780187:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.780203:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea000/0xf1867c21abfb0234 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6aa9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.780251:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985033472:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066806.780305:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.780326:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19900 00000100:00100000:0.0:1746066806.780331:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985231744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.780337:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.780343:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb023b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ab0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.780363:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985033600:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066806.780380:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.780394:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19901 00000100:00100000:0.0:1746066806.780399:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985231872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.780405:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.780413:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0242 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ab7 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.780430:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0242 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ab7 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.780439:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0242 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ab7 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.780451:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbebe00, rc 0) 00000100:00100000:0.0:1746066806.780466:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985231872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (780us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066806.780471:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19901 00000100:00100000:0.0:1746066806.782862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066806.783674:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066806 -> 1746066807 00000100:00100000:0.0:1746066806.783698:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985033472:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066806.783731:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea000/0xf1867c21abfb0234 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6aa9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.783751:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea000/0xf1867c21abfb0234 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6aa9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.783762:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea000, rc 0) 00000100:00100000:0.0:1746066806.783805:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985231616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3632us (4193us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066806.783813:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19899 00002000:00010000:0.0:1746066806.783948:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066806 -> 1746066807 00000100:00100000:0.0:1746066806.783957:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985033600:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066806.783970:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb023b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ab0 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.783977:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb023b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ab0 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.783983:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea200, rc 0) 00000100:00100000:0.0:1746066806.783997:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985231744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3666us (4334us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066806.784002:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19900 00000100:00100000:0.0:1746066806.790541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.790602:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.795563:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.795595:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.795636:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.795667:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232896 00000100:00100000:1.0:1746066806.795670:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232896 00002000:00100000:1.0:1746066806.795693:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880094306d80 x1830882985232896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.795701:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882985232896 ext(1048576->2097151) 00002000:00010000:1.0:1746066806.795705:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:0.0:1746066806.795752:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7398 00000100:00100000:0.0:1746066806.795760:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985232896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066806.810404:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985232896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14644us (14807us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066806.810413:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7398 00002000:00100000:0.0:1746066806.810423:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880094306d80 x1830882985232896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.810432:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882985232896 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.810437:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:0.0:1746066806.821226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.821247:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233536 00000100:00100000:0.0:1746066806.821255:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233536 00010000:00010000:0.0:1746066806.821285:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0218 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a94 expref: 14 pid: 7243 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746066806.821320:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9061 00000100:00100000:1.0:1746066806.821562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.821595:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.821611:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233792 00000100:00100000:1.0:1746066806.821613:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233792 00010000:00010000:1.0:1746066806.821629:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb017e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a16 expref: 33 pid: 7245 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746066806.821668:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985233536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.821682:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.821689:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0218 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a94 expref: 14 pid: 7243 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.821700:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0218 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a94 expref: 14 pid: 7243 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.821723:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfb0218 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a94 expref: 14 pid: 7243 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.821750:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066806.821755:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb025e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.821765:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb025e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066806.821771:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.821801:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985233536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.821979:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9062 00000100:00100000:1.0:1746066806.821986:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985233792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.821993:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.821997:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb017e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a16 expref: 33 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.822004:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb017e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a16 expref: 33 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.822015:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb017e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a16 expref: 33 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.822027:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066806.822030:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb025e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066806.822037:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb025e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066806.822044:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb025e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066806.822064:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.822081:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985233792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.822088:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9062 00000100:00100000:0.0:1746066806.823772:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9061 00000100:00100000:0.0:1746066806.826461:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.833678:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.833860:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985234304 00000100:00100000:1.0:1746066806.833866:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985234304 00010000:00010000:1.0:1746066806.833922:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 11 pid: 9592 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066806.833944:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9063 00000100:00100000:1.0:1746066806.833950:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985234304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.833962:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.833979:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 11 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.833987:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 11 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.834009:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb01af lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a40 expref: 11 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.834033:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.834035:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.834041:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.834049:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.834076:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.834087:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985034368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.835175:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.835459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.835493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.835646:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985234432 00000100:00100000:0.0:1746066806.835651:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985234432 00010000:00010000:0.0:1746066806.835675:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a9b expref: 17 pid: 9592 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746066806.835698:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9064 00000100:00100000:0.0:1746066806.835704:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985234432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.835715:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.835730:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a9b expref: 17 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.835739:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a9b expref: 17 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.835758:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfb0226 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a9b expref: 17 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.835773:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.835775:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.835780:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 34 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.835787:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 34 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.835807:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 34 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.835815:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985034496:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066806.835847:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.838559:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985034368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.838584:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.839006:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985234304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5053us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.839016:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9063 00000100:00100000:0.0:1746066806.839877:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.840056:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.840080:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985234688 00000100:00100000:0.0:1746066806.840086:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985234688 00002000:00100000:0.0:1746066806.840126:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3989504->3993599) req@ffff880093c4df80 x1830882985234688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.840136:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4df80 with x1830882985234688 ext(3989504->3993599) 00002000:00010000:0.0:1746066806.840141:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4df80 00000100:00100000:0.0:1746066806.840154:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985234816 00000100:00100000:0.0:1746066806.840157:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985234816 00002000:00100000:0.0:1746066806.840170:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (2007040->2097151) req@ffff880093c4ca80 x1830882985234816/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.840177:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ca80 with x1830882985234816 ext(2007040->2097151) 00010000:00010000:0.0:1746066806.840184:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 35 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.840202:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 35 pid: 9592 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066806.840208:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c4ca80 00000100:00100000:0.0:1746066806.840219:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2128 00000100:00100000:0.0:1746066806.840225:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985234816:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066806.840790:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985034496:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.840807:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.840829:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985234432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5125us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.840837:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9064 00000100:00100000:0.0:1746066806.843263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.844150:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985234816:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3924us (4092us total) trans 17179875283 rc 0/0 00000100:00100000:0.0:1746066806.844157:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2128 00002000:00100000:0.0:1746066806.844162:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (2007040->2097151) req@ffff880093c4ca80 x1830882985234816/t17179875283(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.844169:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ca80 with x1830882985234816 ext(2007040->2097151) 00010000:00010000:0.0:1746066806.844176:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 39 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.844188:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 39 pid: 9592 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066806.844194:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c4ca80 00000100:00100000:0.0:1746066806.845305:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985235328 00000100:00100000:0.0:1746066806.845312:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985235328 00002000:00100000:0.0:1746066806.845334:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4136960->4141055) req@ffff8800986cd500 x1830882985235328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.845348:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd500 with x1830882985235328 ext(4136960->4141055) 00002000:00010000:0.0:1746066806.845352:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cd500 00000100:00100000:0.0:1746066806.845380:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7403 00000100:00100000:0.0:1746066806.845386:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985235328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066806.845474:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985235328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 87us (1252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066806.845480:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7403 00002000:00100000:0.0:1746066806.845483:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4136960->4141055) req@ffff8800986cd500 x1830882985235328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.845490:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd500 with x1830882985235328 ext(4136960->4141055) 00002000:00010000:0.0:1746066806.845492:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cd500 00000100:00100000:0.0:1746066806.850439:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.852419:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985235456 00000100:00100000:1.0:1746066806.852428:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985235456 00010000:00010000:1.0:1746066806.852458:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 37 pid: 9592 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066806.852488:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9065 00000100:00100000:1.0:1746066806.852494:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985235456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.852507:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.852527:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 37 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.852537:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 37 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.852570:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d30600/0xf1867c21abfb01f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a86 expref: 37 pid: 9592 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.852597:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.852599:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.852607:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.852614:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.852649:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.852660:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985034752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.852707:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.858076:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985034752:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.858099:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.858153:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985235456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5658us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.858163:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9065 00000100:00100000:0.0:1746066806.859823:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.865456:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.865652:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.865837:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2129 00000100:00100000:0.0:1746066806.865845:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985235968:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066806.883254:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985235968:12345-192.168.204.16@tcp:4:cat.0 Request processed in 17398us (17589us total) trans 21474842653 rc 0/0 00000100:00100000:1.0:1746066806.883269:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2129 00002000:00100000:1.0:1746066806.883282:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2142208->3145727) req@ffff88012ea34700 x1830882985235968/t21474842653(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 504/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.883292:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea34700 with x1830882985235968 ext(2142208->3145727) 00010000:00010000:1.0:1746066806.883303:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 12 pid: 20361 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.883321:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 12 pid: 20361 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066806.883328:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea34700 00000100:00100000:0.0:1746066806.883567:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.883615:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.883666:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19908 00000100:00100000:0.0:1746066806.883849:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985236224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066806.883859:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.883869:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb028f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6af6 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.883948:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985035008:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066806.884011:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.886343:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.886434:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985236352 00000100:00100000:1.0:1746066806.886440:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985236352 00010000:00010000:1.0:1746066806.886467:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 14 pid: 20361 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066806.887143:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9066 00000100:00100000:1.0:1746066806.887150:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985236352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.887162:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.887171:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 12 pid: 20361 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.887182:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 12 pid: 20361 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.887319:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfb0162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2142208->3145727] (req 2142208->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a0f expref: 12 pid: 20361 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.887338:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.887339:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.887345:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.887353:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.887378:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.887388:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985035136:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.887431:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.892804:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985035136:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.892820:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.892857:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985236352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5707us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.892865:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9066 00000100:00100000:0.0:1746066806.893076:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882985035520:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.893662:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985035392 00000100:00100000:0.0:1746066806.893666:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985035392 00000100:00100000:0.0:1746066806.893693:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1746066806.893698:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882985035392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.893731:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882985035392:12345-0@lo:400:kworker.0 Request processed in 33us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.893737:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1746066806.893757:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036160 00000100:00100000:0.0:1746066806.893759:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036160 00000100:00100000:0.0:1746066806.893785:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036288 00000100:00100000:0.0:1746066806.893787:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036288 00000100:00100000:0.0:1746066806.893799:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985035904 00000100:00100000:0.0:1746066806.893801:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985035904 00000100:00100000:0.0:1746066806.893813:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1746066806.893817:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830882985036288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.893844:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830882985036288:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.893849:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1746066806.893857:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1746066806.893861:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882985035904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.893900:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882985035904:12345-0@lo:400:kworker.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.893905:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:0.0:1746066806.893919:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746066806.893922:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066806.893928:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036416 00000100:00100000:0.0:1746066806.893930:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036416 00000100:00100000:0.0:1746066806.893943:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1746066806.893946:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985036416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.893965:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985036416:12345-0@lo:400:kworker.0 Request processed in 18us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.893969:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1746066806.893980:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.893990:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882985036032:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894004:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.894012:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985036544:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894024:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.894042:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036544 00000100:00100000:0.0:1746066806.894045:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036544 00000100:00100000:0.0:1746066806.894057:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1746066806.894060:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985036544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894076:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985036544:12345-0@lo:400:kworker.0 Request processed in 16us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.894080:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1746066806.894088:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985035520 00000100:00100000:0.0:1746066806.894090:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985035520 00000100:00100000:0.0:1746066806.894106:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985036032 00000100:00100000:0.0:1746066806.894108:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985036032 00000100:00100000:0.0:1746066806.894119:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1746066806.894122:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882985035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894138:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882985035520:12345-0@lo:400:kworker.0 Request processed in 16us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.894142:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1746066806.894147:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1746066806.894149:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3776:x1830882985036032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894161:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3776:x1830882985036032:12345-0@lo:400:kworker.0 Request processed in 11us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.894164:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1746066806.894178:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882985035520:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894184:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882985036032:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894191:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985036544:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894209:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882985035904:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894214:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985036416:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894220:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882985036800:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894226:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882985036288:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.894418:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985035776:0@lo:400:kworker.0 00000100:00100000:0.0:1746066806.896108:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985236608 00000100:00100000:0.0:1746066806.896114:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985236608 00002000:00100000:0.0:1746066806.896149:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098924e00 x1830882985236608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.896165:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882985236608 ext(2097152->3145727) 00002000:00010000:0.0:1746066806.896171:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:0.0:1746066806.896196:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7405 00000100:00100000:0.0:1746066806.896203:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985236608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066806.901980:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.902030:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985236864 00000100:00100000:1.0:1746066806.902042:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985236864 00002000:00100000:1.0:1746066806.902090:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88012ea37800 x1830882985236864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.902102:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37800 with x1830882985236864 ext(2097152->3145727) 00002000:00010000:1.0:1746066806.902108:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37800 00000100:00100000:1.0:1746066806.902144:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7406 00000100:00100000:1.0:1746066806.902153:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985236864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066806.902785:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.905170:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985236608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8960us (9132us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.905180:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7405 00002000:00100000:1.0:1746066806.905192:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098924e00 x1830882985236608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.905200:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882985236608 ext(2097152->3145727) 00002000:00010000:1.0:1746066806.905206:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:0.0:1746066806.912515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.912565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.912647:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985237504 00000100:00100000:1.0:1746066806.912656:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985237504 00000100:00100000:1.0:1746066806.912697:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19910 00000100:00100000:1.0:1746066806.912704:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3115:x1830882985237504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066806.912723:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.912742:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b04 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.912769:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.912771:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.912780:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b04 expref: 12 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.912795:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b04 expref: 12 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.912806:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2a00, rc 0) 00000100:00100000:1.0:1746066806.912836:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3115:x1830882985237504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.912842:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19910 00000100:00100000:1.0:1746066806.913827:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985236864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11675us (11954us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.913834:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7406 00002000:00100000:1.0:1746066806.913841:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88012ea37800 x1830882985236864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.913849:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37800 with x1830882985236864 ext(2097152->3145727) 00002000:00010000:1.0:1746066806.913853:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37800 00000100:00100000:0.0:1746066806.920702:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.923978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.924022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.924048:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985037184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746066806.924084:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.925975:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985037184 00000100:00100000:1.0:1746066806.925981:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985037184 00000100:00100000:1.0:1746066806.926017:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1746066806.926022:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985037184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746066806.926048:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:1.0:1746066806.926106:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985037184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.926112:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1746066806.926963:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985037184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746066806.926979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.926985:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066806.926993:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985037312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746066806.927025:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066806.927276:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985037312 00000100:00100000:0.0:1746066806.927280:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985037312 00000100:00100000:0.0:1746066806.927323:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1746066806.927328:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985037312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746066806.927350:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445552128 avail 1316089856 00000100:00100000:0.0:1746066806.927381:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985037312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.927386:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1746066806.927948:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985037312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746066806.928091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.933961:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985238272:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6222us (6905us total) trans 21474842654 rc 0/0 00000100:00100000:0.0:1746066806.933979:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2130 00002000:00100000:0.0:1746066806.933994:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3989504->4141055) req@ffff8800930e0700 x1830882985238272/t21474842654(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.934003:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0700 with x1830882985238272 ext(3989504->4141055) 00010000:00010000:0.0:1746066806.934015:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066806.934028:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066806.934035:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e0700 00000100:00100000:0.0:1746066806.937269:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.939466:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.939834:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985238784 00000100:00100000:1.0:1746066806.939842:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985238784 00010000:00010000:1.0:1746066806.939870:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066806.939927:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9067 00000100:00100000:1.0:1746066806.939932:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985238784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.939943:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.939961:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.939971:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.939993:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb0273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3989504->18446744073709551615] (req 3989504->4141055) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ada expref: 29 pid: 9591 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066806.940014:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.940017:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.940025:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.940038:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.940069:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.940082:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985037568:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066806.940140:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.943006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.943833:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985037568:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066806.943848:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.943863:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985238784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3931us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.943869:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9067 00000100:00100000:0.0:1746066806.945774:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.950925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.954530:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.954573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.954601:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.954632:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.954654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066806.954860:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19916 00000100:00100000:1.0:1746066806.954869:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985239808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066806.954877:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.954906:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b35 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.954918:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.954919:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.954925:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b35 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.954935:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b35 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.954943:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3c00, rc 0) 00000100:00100000:0.0:1746066806.954990:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19917 00000100:00100000:0.0:1746066806.954997:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985239936:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066806.955003:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.955009:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098890200/0xf1867c21abfb0306 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b3c expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.955018:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.955019:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.955024:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098890200/0xf1867c21abfb0306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b3c expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.955031:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098890200/0xf1867c21abfb0306 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b3c expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.955037:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098890200, rc 0) 00000100:00100000:1.0:1746066806.955353:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985239808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 484us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.955359:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19916 00000100:00100000:0.0:1746066806.955441:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985239936:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 444us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.955446:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19917 00000100:00100000:0.0:1746066806.958562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.959773:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.960876:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.962486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.963371:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.964044:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.970252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066806.993061:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.009448:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.014981:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.015025:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.015071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.015089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.015103:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985242752 00000100:00100000:0.0:1746066807.015107:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985242752 00010000:00010000:0.0:1746066807.015121:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098890200/0xf1867c21abfb0306 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b3c expref: 11 pid: 13363 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.015135:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985243008 00000100:00100000:0.0:1746066807.015137:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985243008 00010000:00010000:0.0:1746066807.015144:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746066807.015153:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9071 00000100:00100000:0.0:1746066807.015159:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985242624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.015177:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.015196:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.015249:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9073 00000100:00100000:1.0:1746066807.015259:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985243008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.015269:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.015404:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.015435:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.015442:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.015461:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb0281 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae8 expref: 31 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.015473:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.015493:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985242624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 335us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.015499:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9071 00000100:00100000:0.0:1746066807.015515:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9074 00000100:00100000:0.0:1746066807.015519:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985242880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.015527:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.015532:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b04 expref: 13 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.015539:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b04 expref: 13 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.015559:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb0296 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b04 expref: 13 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.015566:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.015577:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985242880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.015581:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9074 00000100:00100000:0.0:1746066807.015623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066807.016026:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfb02c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b0b expref: 28 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.016036:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.016051:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985243008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 797us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.016056:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9073 00000100:00100000:1.0:1746066807.016261:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985243136 00000100:00100000:1.0:1746066807.016265:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985243136 00010000:00010000:1.0:1746066807.016279:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb030d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b43 expref: 12 pid: 12255 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.016300:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9075 00000100:00100000:1.0:1746066807.016306:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985243136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.016313:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.016319:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb030d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b43 expref: 12 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.016327:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb030d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b43 expref: 12 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.016337:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb030d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b43 expref: 12 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.016346:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.016348:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.016355:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.016363:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.016392:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.016406:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985038720:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.016457:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.017921:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.018007:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985038720:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.018021:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.018052:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985243136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1746us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.018059:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9075 00000100:00100000:0.0:1746066807.022367:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985243520 00000100:00100000:0.0:1746066807.022376:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985243520 00000100:00100000:0.0:1746066807.022725:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19921 00000100:00100000:0.0:1746066807.022734:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3121:x1830882985243520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066807.022752:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.022770:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b74 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.022800:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.022814:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b35 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.022820:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb0288 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6aef expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.022827:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.022829:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.022832:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2785280->3145727] (req 2785280->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.022862:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb0288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6aef expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.022873:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb0288 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6aef expref: 19 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.022910:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095877100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985038848:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.023005:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b35 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.023012:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfb02ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b35 expref: 12 pid: 12237 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.023021:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095875880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985038976:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.023045:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.023052:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ad3 expref: 36 pid: 9591 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746066807.023060:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095876d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985039104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066807.023074:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.027816:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.031792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.031845:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985244672 00000100:00100000:1.0:1746066807.031851:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985244672 00002000:00100000:1.0:1746066807.031909:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->2789375) req@ffff880095874000 x1830882985244672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.031918:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095874000 with x1830882985244672 ext(2785280->2789375) 00002000:00010000:1.0:1746066807.031923:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095874000 00000100:00100000:1.0:1746066807.031944:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7416 00000100:00100000:1.0:1746066807.031951:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985244672:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.032088:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985244672:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 136us (304us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066807.032094:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7416 00002000:00100000:1.0:1746066807.032098:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->2789375) req@ffff880095874000 x1830882985244672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.032105:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095874000 with x1830882985244672 ext(2785280->2789375) 00002000:00010000:1.0:1746066807.032108:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095874000 00000100:00100000:0.0:1746066807.039400:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985244800 00000100:00100000:0.0:1746066807.039412:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985244800 00000100:00100000:0.0:1746066807.039472:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19922 00000100:00100000:0.0:1746066807.039480:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3121:x1830882985244800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066807.039498:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.039515:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9200/0xf1867c21abfb037d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b7b expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.039558:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.039567:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.039568:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.039572:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9200/0xf1867c21abfb037d lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->2465791] (req 2097152->2465791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b7b expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.041539:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.041569:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 26 pid: 13363 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.041589:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985039360:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.042089:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.043946:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985039360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.043977:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9200/0xf1867c21abfb037d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->2465791] (req 2097152->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b7b expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.043995:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9200, rc 0) 00000100:00100000:1.0:1746066807.044053:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3121:x1830882985244800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4572us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.044065:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19922 00000100:00100000:0.0:1746066807.046875:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.046999:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985244928 00000100:00100000:1.0:1746066807.047009:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985244928 00002000:00100000:1.0:1746066807.047061:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2142208->2539519) req@ffff880095876d80 x1830882985244928/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.047071:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095876d80 with x1830882985244928 ext(2142208->2539519) 00010000:00010000:1.0:1746066807.047081:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 27 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.047094:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 27 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.047120:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095876d80 00000100:00100000:1.0:1746066807.047156:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2131 00000100:00100000:1.0:1746066807.047165:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985244928:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066807.051980:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985244928:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4806us (5105us total) trans 21474842655 rc 0/0 00000100:00100000:1.0:1746066807.051993:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2131 00002000:00100000:1.0:1746066807.052006:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2142208->2539519) req@ffff880095876d80 x1830882985244928/t21474842655(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.052016:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095876d80 with x1830882985244928 ext(2142208->2539519) 00010000:00010000:1.0:1746066807.052027:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 29 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.052042:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb036f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2142208->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b6d expref: 29 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.052050:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095876d80 00000100:00100000:0.0:1746066807.054991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.061852:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.062023:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985245312 00000100:00100000:1.0:1746066807.062032:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985245312 00002000:00100000:1.0:1746066807.062081:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2461696->2465791) req@ffff880095875880 x1830882985245312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.062090:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095875880 with x1830882985245312 ext(2461696->2465791) 00002000:00010000:1.0:1746066807.062096:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095875880 00000100:00100000:1.0:1746066807.062131:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7417 00000100:00100000:1.0:1746066807.062139:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985245312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.062298:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985245312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (455us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066807.062304:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7417 00002000:00100000:1.0:1746066807.062310:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2461696->2465791) req@ffff880095875880 x1830882985245312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.062317:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095875880 with x1830882985245312 ext(2461696->2465791) 00002000:00010000:1.0:1746066807.062319:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095875880 00000100:00100000:0.0:1746066807.064628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.064716:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985245568 00000100:00100000:1.0:1746066807.064724:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985245568 00000100:00100000:1.0:1746066807.064801:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6442 00000100:00100000:1.0:1746066807.064809:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3121:x1830882985245568:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066807.065070:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3121:x1830882985245568:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 261us (451us total) trans 8589937614 rc 0/0 00000100:00100000:1.0:1746066807.065076:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6442 00000100:00100000:0.0:1746066807.166426:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.174576:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.175986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.190513:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.201578:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.215426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.227522:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.227869:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246976 00000100:00100000:1.0:1746066807.227879:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246976 00000100:00100000:1.0:1746066807.227975:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6443 00000100:00100000:1.0:1746066807.227984:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:3136:x1830882985246976:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066807.228198:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:3136:x1830882985246976:12345-192.168.204.16@tcp:35:cat.0 Request processed in 215us (687us total) trans 8589937618 rc 0/0 00000100:00100000:1.0:1746066807.228205:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6443 00000100:00100000:0.0:1746066807.236366:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.236427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.239915:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247232 00000100:00100000:1.0:1746066807.239920:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247232 00000100:00100000:1.0:1746066807.239981:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19923 00000100:00100000:1.0:1746066807.239989:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985247232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.240010:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066807.240018:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066807.240029:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c5c00/0xf1867c21abfb03df lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6b9e expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.240087:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985040000:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066807.240185:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.243556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.245535:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066807.245692:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066807 -> 1746066808 00000100:00100000:1.0:1746066807.245829:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985040000:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.245863:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c5c00/0xf1867c21abfb03df lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b9e expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.245879:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c5c00/0xf1867c21abfb03df lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b9e expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.245947:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5c00, rc 0) 00000100:00100000:1.0:1746066807.246693:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985247232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6704us (10264us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.246699:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19923 00000100:00100000:0.0:1746066807.267584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.267665:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248128 00000100:00100000:1.0:1746066807.267675:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248128 00002000:00100000:1.0:1746066807.267723:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5886a00 x1830882985248128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.267733:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985248128 ext(1048576->2097151) 00002000:00010000:1.0:1746066807.267739:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:1.0:1746066807.268301:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7418 00000100:00100000:1.0:1746066807.268311:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985248128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.279571:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.279606:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.283852:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985248128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15531us (16267us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066807.283864:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7418 00002000:00100000:0.0:1746066807.283877:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5886a00 x1830882985248128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.283902:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985248128 ext(1048576->2097151) 00002000:00010000:0.0:1746066807.283908:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:0.0:1746066807.283935:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248384 00000100:00100000:0.0:1746066807.283943:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248384 00002000:00100000:0.0:1746066807.283980:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5885180 x1830882985248384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 504/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.283987:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885180 with x1830882985248384 ext(2097152->4194303) 00002000:00010000:0.0:1746066807.283990:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5885180 00000100:00100000:0.0:1746066807.284009:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248640 00000100:00100000:0.0:1746066807.284012:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248640 00002000:00100000:0.0:1746066807.284027:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2465792->4194303) req@ffff8800a5887800 x1830882985248640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.284033:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5887800 with x1830882985248640 ext(2465792->4194303) 00002000:00010000:0.0:1746066807.284036:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5887800 00000100:00100000:0.0:1746066807.286279:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7419 00000100:00100000:0.0:1746066807.286296:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985248384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.294399:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.296610:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.304806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.311178:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249152 00000100:00100000:1.0:1746066807.311186:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249152 00000100:00100000:1.0:1746066807.311239:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19928 00000100:00100000:1.0:1746066807.311246:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+36:3136:x1830882985249152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.311262:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066807.312033:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066807.312518:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0425 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6bc1 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.312553:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.312562:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.312563:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.312567:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0425 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc1 expref: 37 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.312598:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.312609:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 19 pid: 13363 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.312622:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985040512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.312690:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.313599:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.313874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066807.314471:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314480:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314488:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314493:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.314494:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.314497:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfb042c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc8 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.314515:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314525:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.314553:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985040768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.314615:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314623:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 11 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.314631:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985040896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.314656:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.314669:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.314677:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985041024:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.314694:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.318023:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.318055:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249920 00000100:00100000:0.0:1746066807.318063:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249920 00002000:00100000:0.0:1746066807.318110:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->3145727) req@ffff8800a5887100 x1830882985249920/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.318120:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5887100 with x1830882985249920 ext(2785280->3145727) 00010000:00010000:0.0:1746066807.318130:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 22 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.318147:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 22 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066807.318154:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5887100 00000100:00100000:0.0:1746066807.318189:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2133 00000100:00100000:0.0:1746066807.318197:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985249920:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066807.318313:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985040512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.318335:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0425 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc1 expref: 37 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.318349:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751800, rc 0) 00000100:00100000:1.0:1746066807.319483:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:3136:x1830882985249152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8230us (8351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.319493:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19928 00000100:00100000:0.0:1746066807.321438:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.321478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.321624:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985040768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.321640:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985040896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.321648:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985041024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066807.321722:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.321740:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250176 00000100:00100000:0.0:1746066807.321744:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250176 00010000:00010000:0.0:1746066807.321760:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 22 pid: 1893 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.321811:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfb042c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc8 expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.321827:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575be00, rc 0) 00000100:00100000:1.0:1746066807.321851:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3133:x1830882985249792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8001us (8255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.322030:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9082 00000100:00100000:0.0:1746066807.322037:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985250048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.322050:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.322068:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 12 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746066807.322079:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 12 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746066807.322102:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728c00/0xf1867c21abfb02e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b19 expref: 12 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746066807.322123:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.322138:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985250048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.322143:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9082 00000100:00100000:1.0:1746066807.322207:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19929 00000100:00100000:1.0:1746066807.322323:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9083 00000100:00100000:1.0:1746066807.322330:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985250176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.322339:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.322349:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322358:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322371:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb01c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a55 expref: 21 pid: 1893 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322384:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.322400:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985250176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.322405:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9083 00000100:00100000:1.0:1746066807.322417:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9084 00000100:00100000:1.0:1746066807.322422:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985250304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.322429:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.322435:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322442:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322458:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb019a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a1d expref: 37 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.322466:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.322467:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.322474:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfb042c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc8 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.322482:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfb042c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc8 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.322510:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfb042c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bc8 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.322523:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985041152:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.322581:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.324339:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.324659:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985249920:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6461us (6645us total) trans 17179875284 rc 0/0 00000100:00100000:0.0:1746066807.324668:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2133 00002000:00100000:0.0:1746066807.324678:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->3145727) req@ffff8800a5887100 x1830882985249920/t17179875284(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.324688:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5887100 with x1830882985249920 ext(2785280->3145727) 00010000:00010000:0.0:1746066807.324696:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 20 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.324708:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfb0376 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b74 expref: 20 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066807.324714:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5887100 00000100:00100000:1.0:1746066807.324949:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.325097:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250688 00000100:00100000:0.0:1746066807.325100:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250688 00002000:00100000:0.0:1746066807.325122:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (794624->798719) req@ffff880094305f80 x1830882985250688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.325129:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882985250688 ext(794624->798719) 00002000:00010000:0.0:1746066807.325132:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:0.0:1746066807.325150:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7422 00000100:00100000:0.0:1746066807.325157:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985250688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066807.325580:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985250688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 422us (629us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066807.325586:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7422 00002000:00100000:0.0:1746066807.325591:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (794624->798719) req@ffff880094305f80 x1830882985250688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.325597:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882985250688 ext(794624->798719) 00002000:00010000:0.0:1746066807.325600:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:0.0:1746066807.329393:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.330158:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.330259:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.330321:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251200 00000100:00100000:0.0:1746066807.330325:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251200 00002000:00100000:0.0:1746066807.330358:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2621440->2625535) req@ffff880094304700 x1830882985251200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.330367:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830882985251200 ext(2621440->2625535) 00010000:00010000:0.0:1746066807.330375:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 29 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.330385:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 29 pid: 12237 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746066807.330391:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746066807.331787:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250944 00000100:00100000:0.0:1746066807.331792:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250944 00000100:00100000:1.0:1746066807.335502:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19931 00000100:00100000:1.0:1746066807.335523:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3133:x1830882985250944:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.335554:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.335575:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6bd6 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.335615:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb018c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a24 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.335623:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728000/0xf1867c21abfb02ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b20 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.335630:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a5c expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.335636:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.335638:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.335641:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 15 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.335674:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a5c expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.335685:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfb01d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a5c expref: 15 pid: 11630 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.335697:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041536:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.336453:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5728000/0xf1867c21abfb02ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b20 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.336462:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728000/0xf1867c21abfb02ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b20 expref: 9 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.336470:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041664:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.336500:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb018c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a24 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.336507:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb018c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a24 expref: 28 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.336514:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041792:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.336529:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.339507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.339546:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.339597:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251584 00000100:00100000:1.0:1746066807.339606:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251584 00002000:00100000:1.0:1746066807.339655:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011d857b80 x1830882985251584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 504/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.339665:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857b80 with x1830882985251584 ext(2097152->4194303) 00010000:00010000:1.0:1746066807.339675:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 29 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.339688:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 29 pid: 12237 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.339696:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d857b80 00000100:00100000:1.0:1746066807.339714:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251712 00000100:00100000:1.0:1746066807.339717:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251712 00002000:00100000:1.0:1746066807.339729:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88011d854a80 x1830882985251712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.339742:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854a80 with x1830882985251712 ext(2097152->4194303) 00002000:00010000:1.0:1746066807.339745:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d854a80 00000100:00100000:1.0:1746066807.339757:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2135 00000100:00100000:1.0:1746066807.339764:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985251584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.341137:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041536:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.347942:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728000/0xf1867c21abfb02ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6b20 expref: 9 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.347959:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041664:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.347970:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb018c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a24 expref: 31 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.347979:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985041792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.348003:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 14 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.348010:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56400, rc 0) 00000100:00100000:0.0:1746066807.348038:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3133:x1830882985250944:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12524us (17881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.348045:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19931 00000100:00100000:0.0:1746066807.357744:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.358824:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985251584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19053us (19321us total) trans 0 rc 2093056/2093056 00000100:00100000:1.0:1746066807.358837:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2135 00002000:00100000:1.0:1746066807.358849:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011d857b80 x1830882985251584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 504/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.358859:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857b80 with x1830882985251584 ext(2097152->4194303) 00010000:00010000:1.0:1746066807.358869:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 28 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.358911:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 28 pid: 12237 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.358918:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d857b80 00000100:00100000:1.0:1746066807.358944:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252352 00000100:00100000:1.0:1746066807.358951:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252352 00002000:00100000:1.0:1746066807.358980:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa1:0x0] (1531904->1535999) req@ffff88011d856d80 x1830882985252352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.358986:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856d80 with x1830882985252352 ext(1531904->1535999) 00002000:00010000:1.0:1746066807.358989:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d856d80 00000100:00100000:1.0:1746066807.359016:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7424 00000100:00100000:1.0:1746066807.359023:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985252352:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.359131:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985252352:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 108us (1398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066807.359137:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7424 00002000:00100000:1.0:1746066807.359141:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0xa1:0x0] (1531904->1535999) req@ffff88011d856d80 x1830882985252352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.359149:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856d80 with x1830882985252352 ext(1531904->1535999) 00002000:00010000:1.0:1746066807.359152:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d856d80 00000100:00100000:1.0:1746066807.367080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.367104:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252608 00000100:00100000:0.0:1746066807.367112:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252608 00000100:00100000:1.0:1746066807.367118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.367163:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6445 00000100:00100000:0.0:1746066807.367170:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3133:x1830882985252608:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066807.367355:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3133:x1830882985252608:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 186us (276us total) trans 8589937621 rc 0/0 00000100:00100000:0.0:1746066807.367361:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6445 00000100:00100000:0.0:1746066807.373254:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.373298:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.384822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.384921:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.385486:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9091 00000100:00100000:0.0:1746066807.385798:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985253376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.385808:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.385824:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 31 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.385834:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 31 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.385847:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67800/0xf1867c21abfb041e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bba expref: 31 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746066807.385861:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.385863:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.385867:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575bc00/0xf1867c21abfb0433 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bcf expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.385874:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575bc00/0xf1867c21abfb0433 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bcf expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.385880:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.385903:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.385906:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb0441 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bdd expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.385913:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb0441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bdd expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.385932:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb0441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bdd expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.385940:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985042304:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066807.385988:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575bc00/0xf1867c21abfb0433 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bcf expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.385996:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985042432:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066807.386011:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.394337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.405690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.405717:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.405768:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.405910:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7427 00000100:00100000:1.0:1746066807.405917:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985254144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066807.411146:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.411182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.411351:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985254144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5433us (5631us total) trans 0 rc 860160/860160 00000100:00100000:1.0:1746066807.411361:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7427 00002000:00100000:1.0:1746066807.411372:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (3334144->4194303) req@ffff88011d855f80 x1830882985254144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.411380:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855f80 with x1830882985254144 ext(3334144->4194303) 00002000:00010000:1.0:1746066807.411385:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d855f80 00000100:00100000:0.0:1746066807.416204:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.416412:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985254784 00000100:00100000:1.0:1746066807.416420:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985254784 00002000:00100000:1.0:1746066807.416468:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3334143) req@ffff8800a5765c00 x1830882985254784/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.416479:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985254784 ext(3145728->3334143) 00010000:00010000:1.0:1746066807.416486:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb0448 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6be4 expref: 36 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.416498:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb0448 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6be4 expref: 36 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.416505:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5765c00 00000100:00100000:1.0:1746066807.416532:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2137 00000100:00100000:1.0:1746066807.416550:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985254784:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066807.418932:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.424271:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.424467:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985254784:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7926us (8272us total) trans 17179875285 rc 0/0 00000100:00100000:1.0:1746066807.424478:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2137 00002000:00100000:1.0:1746066807.424491:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3334143) req@ffff8800a5765c00 x1830882985254784/t17179875285(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.424500:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985254784 ext(3145728->3334143) 00010000:00010000:1.0:1746066807.424511:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb0448 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6be4 expref: 38 pid: 13363 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.424524:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb0448 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6be4 expref: 38 pid: 13363 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.424531:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5765c00 00000100:00100000:0.0:1746066807.425444:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.425467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.426049:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.426675:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19937 00000100:00100000:0.0:1746066807.426682:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985255040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066807.426693:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.426701:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb0479 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6bf9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.426735:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985042944:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066807.427192:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.429016:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066807.429297:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066806 -> 1746066808 00002000:00010000:1.0:1746066807.429301:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066806 -> 1746066808 00002000:00010000:1.0:1746066807.429303:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066807 -> 1746066808 00000100:00100000:1.0:1746066807.429311:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985042944:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.429326:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb0479 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bf9 expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.429334:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb0479 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bf9 expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.429346:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c400, rc 0) 00000100:00100000:1.0:1746066807.429362:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985255040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2682us (5102us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.429368:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19937 00000100:00100000:0.0:1746066807.431003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.432502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.434579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.437387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.437628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.437643:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985256704 00000100:00100000:0.0:1746066807.437646:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985256704 00002000:00100000:0.0:1746066807.437663:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a5767b80 x1830882985256704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.437670:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767b80 with x1830882985256704 ext(3145728->4194303) 00002000:00010000:0.0:1746066807.437673:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5767b80 00000100:00100000:0.0:1746066807.437818:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7429 00000100:00100000:0.0:1746066807.437824:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985256704:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.439383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.440727:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.446835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.450433:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985256704:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12600us (12797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.450443:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7429 00002000:00100000:1.0:1746066807.450456:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a5767b80 x1830882985256704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.450466:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767b80 with x1830882985256704 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.450471:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5767b80 00010000:00010000:1.0:1746066807.451340:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7e00/0xf1867c21abfb04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066807.451354:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7e00/0xf1867c21abfb04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066807.451409:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:1.0:1746066807.451413:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066807.451427:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7e00/0xf1867c21abfb04b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066807.451464:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb04aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c23 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.451499:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7e00/0xf1867c21abfb04b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c23 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.451508:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066807.451510:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066807.451513:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7e00, rc 0) 00000100:00100000:1.0:1746066807.451555:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+10:3142:x1830882985256960:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 10177us (10831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.451562:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17160 00000100:00100000:0.0:1746066807.458944:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.458984:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.459014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.459026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.459060:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.466182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.466906:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985258240 00000100:00100000:1.0:1746066807.466911:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985258240 00000100:00100000:1.0:1746066807.466955:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17161 00000100:00100000:1.0:1746066807.466961:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+10:3142:x1830882985258240:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066807.466974:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.466993:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfb04db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c4d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.467090:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb04e2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066807.467105:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb04e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066807.467115:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb04e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066807.467126:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066807.467224:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfb04db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c4d expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.467254:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb04e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c4d expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.467262:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066807.467265:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066807.467268:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:1.0:1746066807.467296:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+12:3142:x1830882985258240:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 335us (1114us total) trans 8589937624 rc 0/0 00000100:00100000:1.0:1746066807.467302:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17161 00000100:00100000:0.0:1746066807.468406:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.472811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.472841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.472862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.474601:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.474632:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.474646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.476184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.476215:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.476245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.476584:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985259648 00000100:00100000:1.0:1746066807.476592:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985259648 00000100:00100000:1.0:1746066807.476621:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19951 00000100:00100000:1.0:1746066807.476627:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985259648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.476637:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.476651:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7200/0xf1867c21abfb051a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c54 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.476685:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985046016:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066807.476729:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.479645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.479837:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.480913:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985046016:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.480941:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7200/0xf1867c21abfb051a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c54 expref: 17 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.480955:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7200/0xf1867c21abfb051a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c54 expref: 17 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.480975:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7200, rc 0) 00000100:00100000:1.0:1746066807.481004:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985259648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4377us (4758us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.481010:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19951 00000100:00100000:1.0:1746066807.489994:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985260160 00000100:00100000:1.0:1746066807.490004:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985260160 00010000:00010000:1.0:1746066807.490041:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 22 pid: 9590 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.490084:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9099 00000100:00100000:1.0:1746066807.490089:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985260160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.490094:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.490109:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 22 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.490122:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 22 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.490140:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfb027a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ae1 expref: 22 pid: 9590 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.490157:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.490198:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985260160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.490204:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9099 00000100:00100000:1.0:1746066807.490259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490393:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985260928 00000100:00100000:1.0:1746066807.490396:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985260928 00000100:00100000:1.0:1746066807.490413:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19952 00000100:00100000:1.0:1746066807.490417:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985260928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.490429:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.490440:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfb0521 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c5b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.490481:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985046144:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066807.490523:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.490560:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490571:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985261056 00000100:00100000:1.0:1746066807.490573:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985261056 00000100:00100000:1.0:1746066807.490588:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19953 00000100:00100000:1.0:1746066807.490592:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985261056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.490599:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.490606:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb0528 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c62 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.490627:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985046272:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066807.490642:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.490674:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490684:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985261184 00000100:00100000:1.0:1746066807.490686:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985261184 00000100:00100000:1.0:1746066807.490702:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19954 00000100:00100000:1.0:1746066807.490706:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985261184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.490712:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.490717:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb052f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c69 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.490727:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.490732:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb052f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c69 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490740:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb052f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c69 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490747:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd600, rc 0) 00000100:00100000:1.0:1746066807.490760:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985261184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (86us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.490764:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19954 00000100:00100000:1.0:1746066807.490793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490803:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985261312 00000100:00100000:1.0:1746066807.490805:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985261312 00000100:00100000:1.0:1746066807.490817:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19955 00000100:00100000:1.0:1746066807.490821:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985261312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.490826:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.490833:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c70 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.490844:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd77, ctime: 0x6812dd77, blocks: 0x800 00010000:00010000:1.0:1746066807.490851:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.490853:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.490859:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c70 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490867:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c70 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490874:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7600, rc 0) 00000100:00100000:1.0:1746066807.490901:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985261312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.490905:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19955 00000100:00100000:1.0:1746066807.490933:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.490941:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985261440 00000100:00100000:1.0:1746066807.490944:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985261440 00000100:00100000:1.0:1746066807.490955:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19956 00000100:00100000:1.0:1746066807.490959:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985261440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.490964:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.490970:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb053d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c77 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.490978:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.490982:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb053d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c77 expref: 41 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490989:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb053d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c77 expref: 41 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.490996:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7000, rc 0) 00000100:00100000:1.0:1746066807.491007:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985261440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 48us (74us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.491012:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19956 00000100:00100000:1.0:1746066807.491048:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.491057:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985261568 00000100:00100000:1.0:1746066807.491059:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985261568 00000100:00100000:1.0:1746066807.491070:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19957 00000100:00100000:1.0:1746066807.491074:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985261568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.491079:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.491084:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfb0544 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c7e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.491093:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.491098:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfb0544 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c7e expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.491105:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfb0544 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c7e expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.491111:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6200, rc 0) 00000100:00100000:1.0:1746066807.491121:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985261568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 47us (72us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.491125:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19957 00000100:00100000:1.0:1746066807.493952:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.494086:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.494176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.494260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.494274:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985262080 00000100:00100000:1.0:1746066807.494281:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985262080 00000100:00100000:1.0:1746066807.494319:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19958 00000100:00100000:1.0:1746066807.494327:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3139:x1830882985262080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.494343:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.494359:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c85 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.494382:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.494386:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb0513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.494392:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.494396:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.494413:0:12255:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb0513 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.494425:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.494436:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd000, rc 0) 00000100:00100000:1.0:1746066807.494486:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3139:x1830882985262080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 159us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.494491:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19958 00000100:00100000:1.0:1746066807.495909:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985046272:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.495929:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb0528 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c62 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.495939:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb0528 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c62 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.495947:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bda00, rc 0) 00000100:00100000:1.0:1746066807.495967:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882985261056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5375us (5407us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.495973:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19953 00000100:00100000:1.0:1746066807.496922:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985046144:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.496937:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfb0521 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c5b expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.496950:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfb0521 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c5b expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.496957:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bca00, rc 0) 00000100:00100000:1.0:1746066807.496977:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985260928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6560us (6597us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.496983:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19952 00000100:00100000:1.0:1746066807.497579:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985262336 00000100:00100000:1.0:1746066807.497583:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985262336 00010000:00010000:1.0:1746066807.497595:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 14 pid: 12237 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.497619:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9109 00000100:00100000:1.0:1746066807.497624:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985262336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.497631:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.497641:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 14 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.497650:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 14 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.497662:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb043a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6bd6 expref: 14 pid: 12237 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.497671:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.497673:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.497675:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb04f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.497681:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb04f7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.497705:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.498124:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985262336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 499us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.498130:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9109 00000100:00100000:0.0:1746066807.498521:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.498608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.498637:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.498650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.498663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.498684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.499275:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985263104 00000100:00100000:1.0:1746066807.499277:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985263104 00000100:00100000:1.0:1746066807.499295:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19960 00000100:00100000:1.0:1746066807.499299:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985262720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.499305:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.499319:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6c9a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.499333:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd76, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x800 00010000:00010000:1.0:1746066807.499345:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499347:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499353:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c9a expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499364:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c9a expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499379:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd800, rc 0) 00000100:00100000:1.0:1746066807.499401:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985262720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.499406:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19960 00000100:00100000:1.0:1746066807.499419:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19961 00000100:00100000:1.0:1746066807.499422:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985262976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.499427:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.499434:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ca8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.499443:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd78, atime: 0x6812dd78, ctime: 0x6812dd78, blocks: 0x1000 00010000:00010000:1.0:1746066807.499449:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499450:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499453:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499462:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499468:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd200, rc 0) 00000100:00100000:1.0:1746066807.499479:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985262976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.499483:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19961 00000100:00100000:1.0:1746066807.499491:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19963 00000100:00100000:1.0:1746066807.499495:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985262848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.499500:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.499506:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ca1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.499514:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499515:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.499518:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca1 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499526:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca1 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.499533:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bde00, rc 0) 00000100:00100000:1.0:1746066807.499557:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985262848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 62us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.499564:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19963 00000100:00100000:0.0:1746066807.501270:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.501307:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.501331:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.501350:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.501374:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.501421:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985263488 00000100:00100000:1.0:1746066807.501425:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985263488 00000100:00100000:1.0:1746066807.501848:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19968 00000100:00100000:1.0:1746066807.501854:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882985263488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.501860:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.501866:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6cc4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.501876:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.501877:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.501905:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cc4 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.501919:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cc4 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.501925:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bce00, rc 0) 00000100:00100000:1.0:1746066807.502400:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985263488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 545us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.502406:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19968 00000100:00100000:0.0:1746066807.503509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.504046:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.504100:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985264384 00000100:00100000:1.0:1746066807.504103:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985264384 00000100:00100000:1.0:1746066807.504137:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17163 00000100:00100000:1.0:1746066807.504142:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+12:3142:x1830882985264384:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066807.504163:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.504182:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7e00/0xf1867c21abfb04b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c23 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.504195:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066807.504198:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfb05ad lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066807.504204:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.504234:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+11:3142:x1830882985264384:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 91us (187us total) trans 0 rc -16/-16 00000100:00100000:1.0:1746066807.504239:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17163 00000100:00100000:0.0:1746066807.504850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.510009:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985265024 00000100:00100000:1.0:1746066807.510014:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985265024 00000100:00100000:1.0:1746066807.510040:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6447 00000100:00100000:1.0:1746066807.510046:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3142:x1830882985265024:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066807.510196:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3142:x1830882985265024:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 149us (661us total) trans 8589937625 rc 0/0 00000100:00100000:1.0:1746066807.510201:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6447 00000100:00100000:0.0:1746066807.512281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.512341:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985265280 00000100:00100000:1.0:1746066807.512349:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985265280 00000100:00100000:1.0:1746066807.512391:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6448 00000100:00100000:1.0:1746066807.512398:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3142:x1830882985265280:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066807.512546:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+12:3142:x1830882985265280:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 149us (271us total) trans 8589937627 rc 0/0 00000100:00100000:1.0:1746066807.512552:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6448 00000100:00100000:0.0:1746066807.513207:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.520373:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.520425:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985265664 00000100:00100000:1.0:1746066807.520434:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985265664 00000100:00100000:1.0:1746066807.520492:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19969 00000100:00100000:1.0:1746066807.520501:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3144:x1830882985265664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.520518:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.520546:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ce0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520579:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520588:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2000/0xf1867c21abfb0575 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6caf expref: 38 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520594:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.520596:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.520599:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2797568->3039231] (req 2797568->3039231) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520635:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2000/0xf1867c21abfb0575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6caf expref: 38 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520648:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2000/0xf1867c21abfb0575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6caf expref: 38 pid: 13363 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.520661:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985046656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.520767:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.520775:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.520783:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5826d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985046784:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.520802:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.522992:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.523090:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.523177:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985046656:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.523187:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985046784:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.523214:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2797568->3039231] (req 2797568->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.523233:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd400, rc 0) 00000100:00100000:1.0:1746066807.523271:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3144:x1830882985265664:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2772us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.523280:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19969 00000100:00100000:1.0:1746066807.523432:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9112 00000100:00100000:1.0:1746066807.523438:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985265920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.523444:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.523455:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.523464:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.523477:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd000/0xf1867c21abfb054b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c85 expref: 23 pid: 12255 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.523493:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.523495:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.523501:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.523509:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.523532:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.523553:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985046912:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.523600:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.529104:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985046912:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.529124:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.529162:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985265920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5723us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.529171:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9112 00000100:00100000:0.0:1746066807.537367:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.545011:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.545056:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985266688 00000100:00100000:1.0:1746066807.545066:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985266688 00000100:00100000:1.0:1746066807.545125:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6449 00000100:00100000:1.0:1746066807.545132:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3144:x1830882985266688:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066807.546555:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3144:x1830882985266688:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1420us (1551us total) trans 8589937629 rc 0/0 00000100:00100000:1.0:1746066807.546563:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6449 00000100:00100000:0.0:1746066807.602531:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.602651:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985266816 00000100:00100000:1.0:1746066807.602661:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985266816 00000100:00100000:1.0:1746066807.602725:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19970 00000100:00100000:1.0:1746066807.602734:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:3146:x1830882985266816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.602754:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.602774:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ce7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.602805:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.602813:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.602814:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.602818:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2785280->3145727] (req 2785280->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.602853:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.602864:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 21 pid: 3528 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.602876:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985047040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.603008:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.605477:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985047040:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.605511:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2785280->3145727] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.605528:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bc400, rc 0) 00000100:00100000:1.0:1746066807.605598:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:3146:x1830882985266816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2865us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.605606:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19970 00000100:00100000:0.0:1746066807.605670:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.613189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.613576:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985267072 00000100:00100000:1.0:1746066807.613586:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985267072 00010000:00010000:1.0:1746066807.613628:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 24 pid: 3528 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.613671:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9113 00000100:00100000:1.0:1746066807.613679:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985267072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.613694:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.613716:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 24 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.613728:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 24 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.613752:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd400/0xf1867c21abfb05de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3039231) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce0 expref: 24 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.613785:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.613787:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.613794:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.613803:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.613835:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.613848:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985047168:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.613965:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.617726:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.617791:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985047168:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066807.617812:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.617852:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985267072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4173us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.617863:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9113 00000100:00100000:0.0:1746066807.629695:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.629797:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985267712 00000100:00100000:1.0:1746066807.629806:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985267712 00000100:00100000:1.0:1746066807.629864:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19971 00000100:00100000:1.0:1746066807.629871:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:3146:x1830882985267712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.630001:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.630020:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6cf5 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.630052:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.630060:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.630066:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.630068:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.630071:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->2465791] (req 2097152->2465791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.630101:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.630112:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 32 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.630125:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5826d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047296:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.632702:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.632719:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 15 pid: 11630 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.632879:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.633207:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047424:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.633276:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.636761:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.636790:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985267840 00000100:00100000:0.0:1746066807.636797:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985267840 00010000:00010000:0.0:1746066807.636829:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 33 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.636859:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9114 00000100:00100000:0.0:1746066807.636868:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985267840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.636915:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.636937:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 33 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746066807.636949:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 33 pid: 9590 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746066807.636975:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.637023:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985267840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.637029:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9114 00010000:00010000:1.0:1746066807.637158:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb058a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ccb expref: 32 pid: 9590 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.637178:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047296:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.639915:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066807.640058:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985268096 00000100:00100000:1.0:1746066807.640067:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985268096 00000100:00100000:1.0:1746066807.640118:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6450 00000100:00100000:1.0:1746066807.640127:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3156:x1830882985268096:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066807.640335:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3156:x1830882985268096:12345-192.168.204.16@tcp:35:cat.0 Request processed in 209us (374us total) trans 8589937631 rc 0/0 00000100:00100000:1.0:1746066807.640341:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6450 00000100:00100000:1.0:1746066807.640438:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985268224 00000100:00100000:1.0:1746066807.640441:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985268224 00010000:00010000:1.0:1746066807.640458:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 16 pid: 11630 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746066807.640477:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9115 00000100:00100000:1.0:1746066807.640481:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985268224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.640492:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.640508:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 16 pid: 11630 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.640518:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 16 pid: 11630 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746066807.640555:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.640557:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.640564:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.640572:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.640604:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.640617:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5825c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985047552:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.640676:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746066807.641644:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb0560 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca8 expref: 16 pid: 11630 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746066807.641678:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047424:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066807.641705:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.641716:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00000100:00100000:0.0:1746066807.641758:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:3146:x1830882985267712:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11887us (12076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.641765:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19971 00000100:00100000:0.0:1746066807.642275:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.642767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.642789:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.642801:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985268992 00000100:00100000:0.0:1746066807.642805:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985268992 00000100:00100000:1.0:1746066807.642851:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5825c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985047552:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.642862:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.642900:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985268224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2401us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.642908:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9115 00000100:00100000:1.0:1746066807.642934:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.645172:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985269504 00000100:00100000:1.0:1746066807.645178:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985269504 00002000:00100000:1.0:1746066807.645208:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5886d80 x1830882985269504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.645217:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985269504 ext(1048576->2097151) 00002000:00010000:1.0:1746066807.645221:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5886d80 00000100:00100000:1.0:1746066807.645246:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7441 00000100:00100000:1.0:1746066807.645252:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985269504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.645468:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985269376 00000100:00100000:0.0:1746066807.645472:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985269376 00000100:00100000:0.0:1746066807.645506:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19973 00000100:00100000:0.0:1746066807.645510:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985269376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066807.645518:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.645544:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb061d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6d03 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.645579:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047808:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066807.645625:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.650567:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.652691:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985047808:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066807.652729:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb061d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d03 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.652743:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb061d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d03 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.652754:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fade00, rc 0) 00000100:00100000:0.0:1746066807.652808:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985269376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7294us (7789us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066807.652816:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19973 00000100:00100000:0.0:1746066807.653004:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985268480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9690us (10729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066807.653011:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7438 00002000:00100000:0.0:1746066807.653021:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012b165c00 x1830882985268480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.653030:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165c00 with x1830882985268480 ext(0->1048575) 00002000:00010000:0.0:1746066807.653034:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165c00 00000100:00100000:0.0:1746066807.653049:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985269760 00000100:00100000:0.0:1746066807.653055:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985269760 00002000:00100000:0.0:1746066807.653081:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2461696->2465791) req@ffff8800a5b0c700 x1830882985269760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.653087:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0c700 with x1830882985269760 ext(2461696->2465791) 00002000:00010000:0.0:1746066807.653090:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0c700 00000100:00100000:0.0:1746066807.653118:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7442 00000100:00100000:0.0:1746066807.653125:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985269760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.653215:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985269760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 91us (2659us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066807.653221:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7442 00002000:00100000:0.0:1746066807.653225:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2461696->2465791) req@ffff8800a5b0c700 x1830882985269760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.653230:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0c700 with x1830882985269760 ext(2461696->2465791) 00002000:00010000:0.0:1746066807.653233:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0c700 00000100:00100000:0.0:1746066807.666651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.666692:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.666716:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.666746:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.666769:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985270016 00000100:00100000:0.0:1746066807.666776:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985270016 00002000:00100000:0.0:1746066807.666809:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5b0d500 x1830882985270016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.666818:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0d500 with x1830882985270016 ext(0->1048575) 00002000:00010000:0.0:1746066807.666823:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0d500 00000100:00100000:0.0:1746066807.666837:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985270400 00000100:00100000:0.0:1746066807.666839:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985270400 00002000:00100000:0.0:1746066807.666850:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5b0f480 x1830882985270400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.666856:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0f480 with x1830882985270400 ext(1048576->2097151) 00002000:00010000:0.0:1746066807.666858:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0f480 00000100:00100000:0.0:1746066807.666865:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985270528 00000100:00100000:0.0:1746066807.666866:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985270528 00002000:00100000:0.0:1746066807.666873:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5b0df80 x1830882985270528/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.666879:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0df80 with x1830882985270528 ext(1048576->2097151) 00002000:00010000:0.0:1746066807.666904:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0df80 00000100:00100000:0.0:1746066807.666911:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985270784 00000100:00100000:0.0:1746066807.666913:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985270784 00002000:00100000:0.0:1746066807.666922:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880097c00700 x1830882985270784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.666927:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00700 with x1830882985270784 ext(1048576->2097151) 00002000:00010000:0.0:1746066807.666929:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c00700 00000100:00100000:0.0:1746066807.666939:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7443 00000100:00100000:0.0:1746066807.666945:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985270016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.667805:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7444 00000100:00100000:0.0:1746066807.667812:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985270400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.668421:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7445 00000100:00100000:0.0:1746066807.668428:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985270528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066807.669347:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985269504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24093us (24229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.669355:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7441 00002000:00100000:1.0:1746066807.669363:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5886d80 x1830882985269504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.669371:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985269504 ext(1048576->2097151) 00002000:00010000:1.0:1746066807.669376:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5886d80 00000100:00100000:1.0:1746066807.669495:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882985268736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26133us (26727us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.669501:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7439 00002000:00100000:1.0:1746066807.669506:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5b0d880 x1830882985268736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.669513:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0d880 with x1830882985268736 ext(1048576->2097151) 00002000:00010000:1.0:1746066807.669517:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0d880 00000100:00100000:0.0:1746066807.691999:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985270528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23563us (25273us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066807.692014:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7445 00002000:00100000:0.0:1746066807.692024:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5b0df80 x1830882985270528/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.692033:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0df80 with x1830882985270528 ext(1048576->2097151) 00002000:00010000:0.0:1746066807.692038:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0df80 00000100:00100000:0.0:1746066807.697916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.697985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.698070:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271424 00000100:00100000:1.0:1746066807.698081:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271424 00002000:00100000:1.0:1746066807.698128:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c01f80 x1830882985271424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 504/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.698139:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01f80 with x1830882985271424 ext(2097152->4194303) 00002000:00010000:1.0:1746066807.698145:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c01f80 00000100:00100000:1.0:1746066807.698165:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271552 00000100:00100000:1.0:1746066807.698167:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271552 00002000:00100000:1.0:1746066807.698181:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2465792->4194303) req@ffff880097c00000 x1830882985271552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.698187:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00000 with x1830882985271552 ext(2465792->4194303) 00002000:00010000:1.0:1746066807.698191:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c00000 00000100:00100000:1.0:1746066807.698204:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7447 00000100:00100000:1.0:1746066807.698210:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985271424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.710292:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.710334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.718688:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985271424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20472us (20811us total) trans 0 rc 1736704/1736704 00000100:00100000:1.0:1746066807.718697:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7447 00002000:00100000:1.0:1746066807.718707:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c01f80 x1830882985271424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 504/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1736704/1736704 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.718715:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01f80 with x1830882985271424 ext(2097152->4194303) 00002000:00010000:1.0:1746066807.718720:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c01f80 00000100:00100000:0.0:1746066807.719241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.721085:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.721159:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272064 00000100:00100000:1.0:1746066807.721164:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272064 00002000:00100000:1.0:1746066807.721194:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->3145727) req@ffff88012c493b80 x1830882985272064/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.721201:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882985272064 ext(2785280->3145727) 00010000:00010000:1.0:1746066807.721206:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 39 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.721216:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 39 pid: 3528 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.721221:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c493b80 00000100:00100000:1.0:1746066807.721355:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2141 00000100:00100000:1.0:1746066807.721361:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985272064:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066807.726647:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985272064:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5285us (5561us total) trans 17179875288 rc 0/0 00000100:00100000:1.0:1746066807.726655:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2141 00002000:00100000:1.0:1746066807.726667:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2785280->3145727) req@ffff88012c493b80 x1830882985272064/t17179875288(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.726675:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882985272064 ext(2785280->3145727) 00010000:00010000:1.0:1746066807.726680:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.726694:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746066807.726700:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c493b80 00000100:00100000:0.0:1746066807.730812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.730974:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272320 00000100:00100000:1.0:1746066807.730982:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272320 00010000:00010000:1.0:1746066807.731014:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.731049:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9116 00000100:00100000:1.0:1746066807.731056:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985272320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.731067:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.731082:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.731097:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.731116:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb05e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2785280->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ce7 expref: 42 pid: 3528 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.731137:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.731140:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.731145:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e362600/0xf1867c21abfb0632 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d18 expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.731153:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e362600/0xf1867c21abfb0632 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d18 expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.731159:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.731160:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.731162:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfb0639 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d1f expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.731167:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfb0639 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d1f expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.731191:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfb0639 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d1f expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.731200:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5826680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985048320:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.731298:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e362600/0xf1867c21abfb0632 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d18 expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.731305:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985048448:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.731322:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.733009:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985048320:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.733018:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985048448:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.733034:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.733060:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985272320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2004us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.733068:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9116 00000100:00100000:0.0:1746066807.735065:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.735150:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272576 00000100:00100000:1.0:1746066807.735156:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272576 00002000:00100000:1.0:1746066807.735188:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c491180 x1830882985272576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.735197:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985272576 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.735201:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:1.0:1746066807.735225:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7449 00000100:00100000:1.0:1746066807.735231:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985272576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066807.736030:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.747797:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985272576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12557us (12727us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.748002:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7449 00002000:00100000:1.0:1746066807.748013:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c491180 x1830882985272576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.748028:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985272576 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.748033:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:0.0:1746066807.752031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.754589:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.754874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.767334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.769019:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.769061:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985273600 00000100:00100000:1.0:1746066807.769065:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985273600 00010000:00010000:1.0:1746066807.769083:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfb05ec lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cf5 expref: 35 pid: 3528 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.769254:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9117 00000100:00100000:1.0:1746066807.769260:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985273600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.769268:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.769270:0:11928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie f1867c21abfb05ec) 00010000:00010000:1.0:1746066807.769272:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.769388:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985273600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (368us total) trans 0 rc 116/116 00000100:00100000:1.0:1746066807.769394:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9117 00000100:00100000:0.0:1746066807.771161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.773188:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.773214:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.773233:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985273984 00000100:00100000:1.0:1746066807.773237:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985273984 00010000:00010000:1.0:1746066807.773255:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb0608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cee expref: 27 pid: 7245 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.773279:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274112 00000100:00100000:1.0:1746066807.773281:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274112 00010000:00010000:1.0:1746066807.773289:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb05d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cd9 expref: 42 pid: 7245 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746066807.773305:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9119 00000100:00100000:1.0:1746066807.773310:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985274112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.773317:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.773320:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb05d0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cd9 expref: 42 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.773354:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb05d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cd9 expref: 42 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.773369:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb05d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cd9 expref: 42 pid: 7245 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746066807.773454:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066807.773457:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.773479:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985274112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 168us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.773484:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9119 00000100:00100000:0.0:1746066807.774926:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.774955:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.775946:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.803423:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.808497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.813820:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985275008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9817us (10395us total) trans 0 rc 667648/667648 00000100:00100000:0.0:1746066807.813829:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7454 00002000:00100000:0.0:1746066807.813839:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c774380 x1830882985275008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.813847:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774380 with x1830882985275008 ext(4194304->4861951) 00002000:00010000:0.0:1746066807.813852:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774380 00000100:00100000:0.0:1746066807.852110:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.855412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.857636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.862099:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.871494:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.876490:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.876525:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.876587:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276160 00000100:00100000:1.0:1746066807.876592:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276160 00010000:00010000:1.0:1746066807.876612:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb0663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d3b expref: 33 pid: 12237 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066807.876628:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9122 00000100:00100000:1.0:1746066807.876632:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985276160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.876639:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.876652:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb0663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d3b expref: 33 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066807.876659:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb0663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d3b expref: 33 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066807.876677:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb0663 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d3b expref: 33 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066807.876751:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.876765:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985276160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.876768:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9122 00000100:00100000:0.0:1746066807.879262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.894415:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.894462:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.894611:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276800 00000100:00100000:1.0:1746066807.894618:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276800 00000100:00100000:1.0:1746066807.894655:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19984 00000100:00100000:1.0:1746066807.894662:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985276800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.894675:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.894688:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfb0694 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6d5e expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.894740:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985050112:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066807.894835:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.897220:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.897400:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985050112:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066807.897435:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfb0694 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d5e expref: 33 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.897447:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfb0694 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d5e expref: 33 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.897464:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c800, rc 0) 00000100:00100000:1.0:1746066807.897503:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985276800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2841us (3039us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.897511:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19984 00000100:00100000:1.0:1746066807.897544:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276928 00000100:00100000:1.0:1746066807.897549:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276928 00000100:00100000:1.0:1746066807.897575:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19985 00000100:00100000:1.0:1746066807.897580:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+42:3162:x1830882985276928:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.897594:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.897608:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6d65 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.897629:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb0559 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c8c expref: 23 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.897637:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfb0583 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cb6 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.897643:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.897644:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.897647:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 41 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.897669:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfb0583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cb6 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.897680:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfb0583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cb6 expref: 41 pid: 12233 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066807.897696:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985050240:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.898056:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb0559 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c8c expref: 23 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.898066:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb0559 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c8c expref: 23 pid: 13363 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066807.898074:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5826680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985050368:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.898162:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.900129:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985050240:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066807.900147:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985050368:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066807.900179:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 41 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.900195:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c200, rc 0) 00000100:00100000:1.0:1746066807.900234:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+41:3162:x1830882985276928:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2652us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.900242:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19985 00000100:00100000:0.0:1746066807.900583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.900618:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.900767:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985277056 00000100:00100000:1.0:1746066807.900771:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985277056 00000100:00100000:1.0:1746066807.900802:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 19986 00000100:00100000:1.0:1746066807.900808:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+42:3167:x1830882985277056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066807.900821:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.900834:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6d6c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.900853:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.900857:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.900863:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.900867:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [106496->1048575] (req 106496->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d6c expref: 43 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.900913:0:12237:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.901279:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [106496->1048575] (req 106496->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d6c expref: 43 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.901294:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d000, rc 0) 00000100:00100000:1.0:1746066807.901318:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+42:3167:x1830882985277056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 509us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.901324:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 19986 00000100:00100000:1.0:1746066807.901685:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.903311:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.907383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.907649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.913389:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.913646:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9127 00000100:00100000:0.0:1746066807.913651:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985278080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.913657:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.913674:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0567 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c93 expref: 16 pid: 13363 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066807.914315:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0567 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c93 expref: 16 pid: 13363 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066807.914340:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0567 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c93 expref: 16 pid: 13363 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066807.914391:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.914393:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.914399:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.914407:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.914440:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.914451:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985051008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.915155:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.916373:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985051008:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.916390:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.916419:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985278080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2768us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.916429:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9127 00000100:00100000:0.0:1746066807.917429:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.917475:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278336 00000100:00100000:1.0:1746066807.917482:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278336 00010000:00010000:1.0:1746066807.917506:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066807.917539:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9128 00000100:00100000:1.0:1746066807.917545:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985278336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.917558:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.917574:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.917585:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.917607:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb069b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d65 expref: 43 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.917728:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.917730:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.917736:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d6c expref: 42 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.917745:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d6c expref: 42 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.917773:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb06a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d6c expref: 42 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.917785:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985051136:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.917992:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.919337:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.919420:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985051136:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.919436:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.919463:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985278336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1918us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.919472:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9128 00000100:00100000:0.0:1746066807.923254:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.934356:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.937825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.937916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.945622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.950122:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.950173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.959131:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.961738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.964264:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.966494:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066807.975226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.976808:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280512 00000100:00100000:1.0:1746066807.976818:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280512 00010000:00010000:1.0:1746066807.976908:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfb067f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d49 expref: 26 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066807.976946:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9129 00000100:00100000:1.0:1746066807.976953:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985280512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.976967:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.976985:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfb067f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d49 expref: 26 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.976995:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfb067f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d49 expref: 26 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.977017:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfb067f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2449408->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d49 expref: 26 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.977053:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.977055:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.978187:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.978204:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.978244:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.978256:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985051904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.978343:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.980780:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985051904:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.980803:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.980843:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985280512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3889us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.980853:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9129 00000100:00100000:0.0:1746066807.981623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.981790:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280640 00000100:00100000:1.0:1746066807.981796:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280640 00010000:00010000:1.0:1746066807.981821:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 34 pid: 12237 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746066807.982152:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066807.985651:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9130 00000100:00100000:1.0:1746066807.985670:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985280640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.985694:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.985722:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 34 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.985739:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 34 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.985762:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb06a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d73 expref: 34 pid: 12237 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066807.985799:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.985801:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.985809:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.985817:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.985854:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.985868:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985052032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066807.985966:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.988315:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985052032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066807.988339:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.988383:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985280640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2719us (6760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.988396:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9130 00000100:00100000:0.0:1746066807.992216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.000702:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.003137:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.008915:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.010585:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985281536 00000100:00100000:1.0:1746066808.010598:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985281536 00010000:00010000:1.0:1746066808.010646:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb0686 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d50 expref: 18 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.010693:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9131 00000100:00100000:1.0:1746066808.010700:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985281536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.010716:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.010735:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb0686 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d50 expref: 18 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.010746:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb0686 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d50 expref: 18 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.010769:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb0686 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d50 expref: 18 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.010798:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.010800:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.010807:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.010815:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.010850:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.010862:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985052288:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.010980:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.013176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.013431:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5827b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985052288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.013454:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.013490:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985281536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2790us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.013500:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9131 00000100:00100000:0.0:1746066808.013979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.020392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.024262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.024750:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985282304 00000100:00100000:1.0:1746066808.024760:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985282304 00002000:00100000:1.0:1746066808.024805:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a4d24380 x1830882985282304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.024814:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24380 with x1830882985282304 ext(2097152->4194303) 00002000:00010000:1.0:1746066808.024820:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d24380 00000100:00100000:1.0:1746066808.024857:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7464 00000100:00100000:1.0:1746066808.024865:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985282304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066808.044247:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.044289:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.055998:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.057501:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985282304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32634us (33247us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066808.057510:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7464 00002000:00100000:0.0:1746066808.057519:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a4d24380 x1830882985282304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/440 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.057538:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24380 with x1830882985282304 ext(2097152->4194303) 00002000:00010000:0.0:1746066808.057543:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d24380 00000100:00100000:0.0:1746066808.067639:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.068849:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.069914:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985283072 00000100:00100000:1.0:1746066808.069920:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985283072 00010000:00010000:1.0:1746066808.069942:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 45 pid: 9592 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.069974:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9132 00000100:00100000:1.0:1746066808.069980:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985283072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.069989:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.070006:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 45 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.070016:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 45 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.070033:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb06cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d96 expref: 45 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.070054:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.070088:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985283072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.070094:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9132 00000100:00100000:0.0:1746066808.078098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.083615:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.083669:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.083726:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985283712 00000100:00100000:1.0:1746066808.083736:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985283712 00010000:00010000:1.0:1746066808.083772:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb06e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dab expref: 26 pid: 9592 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066808.083814:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9133 00000100:00100000:1.0:1746066808.083823:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985283712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.083836:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.083854:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb06e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dab expref: 27 pid: 9592 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.083865:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb06e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dab expref: 27 pid: 9592 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.083935:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb06e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dab expref: 28 pid: 9592 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.083965:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.084012:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985283712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 189us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.084018:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9133 00000100:00100000:0.0:1746066808.088482:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.094768:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.095664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.095700:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.095734:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985284352 00000100:00100000:1.0:1746066808.095737:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985284352 00000100:00100000:1.0:1746066808.095760:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985284480 00000100:00100000:1.0:1746066808.095762:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985284480 00000100:00100000:1.0:1746066808.095781:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20000 00000100:00100000:1.0:1746066808.095788:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985284352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.095804:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.095823:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6dce expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.095846:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.095848:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.095856:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dce expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.095871:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dce expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.095904:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:1.0:1746066808.095948:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985284352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 161us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.095954:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20000 00000100:00100000:1.0:1746066808.095971:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20001 00000100:00100000:1.0:1746066808.095975:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985284480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.095981:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.095990:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb070b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6dd5 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.096009:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb070b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dd5 expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.096017:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb070b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dd5 expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.096036:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76c00, rc 0) 00000100:00100000:1.0:1746066808.096051:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985284480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (351us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.096056:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20001 00000100:00100000:0.0:1746066808.103775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.113987:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.115378:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.115403:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985285248 00000100:00100000:0.0:1746066808.115409:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985285248 00000100:00100000:0.0:1746066808.121390:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.121694:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985285376 00000100:00100000:1.0:1746066808.121706:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985285376 00000100:00100000:1.0:1746066808.121778:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20004 00000100:00100000:1.0:1746066808.121790:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985285376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.121816:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.121837:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0720 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6dea expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.121875:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0720 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dea expref: 45 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.121959:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0720 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dea expref: 45 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.122000:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:1.0:1746066808.122064:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985285376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 275us (682us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.122071:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20004 00000100:00100000:0.0:1746066808.123850:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.135429:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.137085:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20005 00000100:00100000:1.0:1746066808.137098:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985285760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.137121:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.137142:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb0727 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6df1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.137182:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb0727 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6df1 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.137194:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb0727 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6df1 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.137569:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:1.0:1746066808.137659:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985285760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 561us (2241us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.137666:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20005 00000100:00100000:1.0:1746066808.142000:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985052800 00000100:00100000:1.0:1746066808.142009:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985052800 00000100:00100000:1.0:1746066808.142087:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1746066808.142096:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985052800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746066808.142123:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1196960192 pending 5255168 free 3909910528 avail 3678388224 00000100:00100000:1.0:1746066808.142174:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985052800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.142181:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1746066808.142232:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985052800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066808.142839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.142941:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985285888 00000100:00100000:1.0:1746066808.142945:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985285888 00000100:00100000:1.0:1746066808.143062:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20006 00000100:00100000:1.0:1746066808.143070:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985285888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.143083:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.143104:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb072e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6df8 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.143135:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb072e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6df8 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.143146:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb072e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6df8 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.143156:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70e00, rc 0) 00000100:00100000:1.0:1746066808.143664:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985285888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 593us (827us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.143670:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20006 00000100:00100000:0.0:1746066808.153453:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.153628:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985286016 00000100:00100000:1.0:1746066808.153639:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985286016 00000100:00100000:1.0:1746066808.153693:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20007 00000100:00100000:1.0:1746066808.153701:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3176:x1830882985286016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066808.153722:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.153740:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0735 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6dff expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153774:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb06f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc0 expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153782:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb06fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc7 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153788:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066808.153790:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066808.153793:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0735 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3190784->3731455] (req 3190784->3731455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dff expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153823:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb06fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc7 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153840:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb06fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc7 expref: 27 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.153852:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985052928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.153980:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb06f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc0 expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.153988:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130800c00/0xf1867c21abfb06f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dc0 expref: 43 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.153996:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985053056:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.154015:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.158076:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.158143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.158260:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985052928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.158321:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985053056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.158350:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfb0735 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3190784->3731455] (req 3190784->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dff expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.158549:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:1.0:1746066808.158601:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3176:x1830882985286016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4899us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.158608:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20007 00000100:00100000:0.0:1746066808.160562:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.165032:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.296211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.296572:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985286912 00000100:00100000:1.0:1746066808.296584:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985286912 00000100:00100000:1.0:1746066808.296646:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20008 00000100:00100000:1.0:1746066808.296654:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3182:x1830882985286912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066808.296675:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.296694:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e06 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.296724:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.296733:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dce expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.296739:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.296741:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.296744:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1613824->1785855] (req 1613824->1785855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 19 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.296776:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dce expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.296787:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfb0704 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6dce expref: 34 pid: 3528 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066808.296798:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985053312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.297639:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.297806:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 19 pid: 9592 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.297816:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985053440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.297872:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.299039:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985053312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066808.300730:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.301151:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.301435:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985053440:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066808.301461:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1613824->1785855] (req 1613824->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 20 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.301482:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70e00, rc 0) 00000100:00100000:0.0:1746066808.301505:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9137 00000100:00100000:0.0:1746066808.301510:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985287168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066808.301516:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066808.301535:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 20 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.301543:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 20 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.301555:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb06d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d9d expref: 20 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.302495:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.302551:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3182:x1830882985286912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5896us (6349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.302559:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20008 00000100:00100000:1.0:1746066808.304167:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985287168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2652us (3011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.304176:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9137 00000100:00100000:0.0:1746066808.311282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.324818:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066808.327010:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066808.328643:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.328694:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.329078:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985288320 00000100:00100000:1.0:1746066808.329084:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985288320 00000100:00100000:1.0:1746066808.329130:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985288192 00000100:00100000:1.0:1746066808.329133:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985288192 00000100:00100000:1.0:1746066808.329149:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6452 00000100:00100000:1.0:1746066808.329155:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:314:x1830882985288320:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066808.329391:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:314:x1830882985288320:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 234us (756us total) trans 8589937635 rc 0/0 00000100:00100000:1.0:1746066808.329398:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6452 00000100:00100000:0.0:1746066808.332538:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.332629:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.332677:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985288448 00000100:00100000:0.0:1746066808.332685:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985288448 00010000:00010000:0.0:1746066808.332726:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb0671 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d42 expref: 44 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.332727:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985288576 00000100:00100000:1.0:1746066808.332731:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985288576 00010000:00010000:1.0:1746066808.332747:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb0655 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d34 expref: 27 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746066808.332758:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9138 00000100:00100000:0.0:1746066808.332764:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985288448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066808.333031:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9139 00000100:00100000:1.0:1746066808.333038:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985288576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066808.333209:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066808.333216:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb0671 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d42 expref: 44 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.333227:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb0671 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d42 expref: 44 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.333945:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb0671 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d42 expref: 44 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.333968:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066808.333973:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066808.333982:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066808.333986:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066808.333992:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066808.334022:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.334029:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb0655 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d34 expref: 27 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746066808.334039:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985288448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1274us (1520us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066808.334045:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb0655 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d34 expref: 27 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746066808.334045:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9138 00010000:00010000:1.0:1746066808.334060:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb0655 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d34 expref: 27 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.334082:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066808.334086:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334093:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334100:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334121:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.334143:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985288576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1105us (1514us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066808.334148:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066808.334150:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9139 00010000:00010000:0.0:1746066808.334159:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066808.334236:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:1.0:1746066808.334240:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066808.334263:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334274:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334285:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334291:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334297:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334303:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334307:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066808.334310:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334316:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334323:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066808.334325:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066808.334328:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334333:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb074a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334342:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334350:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334355:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334358:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa1e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066808.334361:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334365:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334370:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cd9e00) 00010000:00010000:1.0:1746066808.334372:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066808.334374:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334378:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb0751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.334407:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1a00/0xf1867c21abfb0743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.334416:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.334421:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066808.334423:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066808.334425:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0600, rc 0) 00000100:00100000:1.0:1746066808.334446:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+13:3183:x1830882985287808:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9224us (9641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.334452:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17168 00000100:00100000:0.0:1746066808.338449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.338487:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.338551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.338575:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066808.338592:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066808.338607:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.338645:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066808.338653:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066808.338682:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985289216 00000100:00100000:0.0:1746066808.338684:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985289216 00000100:00100000:0.0:1746066808.338710:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20010 00000100:00100000:0.0:1746066808.338714:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985289088:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066808.338719:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066808.338735:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e29 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.338757:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.338759:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.338767:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e29 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.338780:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e29 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.338790:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44e00, rc 0) 00000100:00100000:0.0:1746066808.338828:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985289088:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 113us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.338835:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20010 00000100:00100000:0.0:1746066808.338871:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20012 00000100:00100000:0.0:1746066808.338876:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985288704:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066808.338897:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066808.338904:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45e00/0xf1867c21abfb076d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e14 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.338914:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20013 00010000:00010000:0.0:1746066808.338914:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.338915:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.338919:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45e00/0xf1867c21abfb076d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e14 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066808.338920:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985288960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066808.338926:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066808.338928:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45e00/0xf1867c21abfb076d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e14 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.338933:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e22 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.338934:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45e00, rc 0) 00010000:00010000:1.0:1746066808.338942:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.338943:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.338947:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e22 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066808.338947:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985288704:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 71us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.338952:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20012 00010000:00010000:1.0:1746066808.338956:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e22 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.338962:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70000, rc 0) 00000100:00100000:0.0:1746066808.338962:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20014 00000100:00100000:0.0:1746066808.338966:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985289216:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066808.338970:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066808.338975:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985288960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 57us (367us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066808.338976:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0782 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e30 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.338982:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20013 00000100:00100000:0.0:1746066808.339003:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985054080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066808.339047:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00002000:00010000:1.0:1746066808.341251:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066808 -> 1746066809 00002000:00010000:1.0:1746066808.341256:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066808 -> 1746066809 00002000:00010000:1.0:1746066808.341258:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066808 -> 1746066809 00000100:00100000:1.0:1746066808.341499:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985054080:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066808.341536:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0782 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e30 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.341553:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfb0782 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e30 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.341696:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:1.0:1746066808.341738:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985289216:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2769us (3091us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.341744:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20014 00000100:00100000:0.0:1746066808.344965:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.345014:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985289600 00000100:00100000:0.0:1746066808.345018:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.345025:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985289600 00000100:00100000:1.0:1746066808.345065:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985289856 00000100:00100000:1.0:1746066808.345067:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985289856 00000100:00100000:1.0:1746066808.345174:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17169 00000100:00100000:1.0:1746066808.345184:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+13:3183:x1830882985289600:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066808.345200:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.345215:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfb0789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e3e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.345304:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.345317:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.345322:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.345349:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.345360:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 14 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.345372:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985054208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.346092:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.346587:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985054208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.346606:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066808.346840:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.346989:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985289984 00000100:00100000:1.0:1746066808.346995:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985289984 00010000:00010000:1.0:1746066808.347018:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 15 pid: 7245 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.347046:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9140 00000100:00100000:1.0:1746066808.347051:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985289984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.347061:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.347066:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 15 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.347076:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 15 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.347096:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb0758 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e0d expref: 15 pid: 7245 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.347148:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066808.347152:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.347160:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066808.347163:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066808.347165:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066808.347171:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.347175:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.347179:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.347434:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066808.348346:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066808.348352:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066808.348364:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066808.348421:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfb0789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e3e expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.348855:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc400/0xf1867c21abfb0790 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e3e expref: 15 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.348862:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066808.348864:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066808.348867:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc400, rc 0) 00000100:00100000:0.0:1746066808.348903:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+15:3183:x1830882985289600:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3721us (3948us total) trans 8589937638 rc 0/0 00000100:00100000:0.0:1746066808.348908:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17169 00000100:00100000:1.0:1746066808.349231:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985289984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2178us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.349240:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9140 00000100:00100000:1.0:1746066808.349289:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985290112 00000100:00100000:1.0:1746066808.349294:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985290112 00000100:00100000:1.0:1746066808.349325:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20015 00000100:00100000:1.0:1746066808.349331:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985290112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.349343:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.349355:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb07b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e4c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.349401:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985054336:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066808.349444:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.349713:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.352020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.352677:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985054336:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066808.352700:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb07b3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e4c expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.352710:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb07b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e4c expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.352726:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc800, rc 0) 00000100:00100000:1.0:1746066808.352775:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985290112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3441us (5610us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.352793:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20015 00000100:00100000:0.0:1746066808.358513:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985290752 00000100:00100000:0.0:1746066808.358530:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985290752 00002000:00100000:0.0:1746066808.358575:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->106495) req@ffff88009c776a00 x1830882985290752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.358583:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776a00 with x1830882985290752 ext(0->106495) 00002000:00010000:0.0:1746066808.358588:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776a00 00000100:00100000:0.0:1746066808.358765:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7477 00000100:00100000:0.0:1746066808.358772:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985290752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066808.360626:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.361118:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985290880 00000100:00100000:1.0:1746066808.361125:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985290880 00010000:00010000:1.0:1746066808.361154:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e45 expref: 45 pid: 17253 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.361189:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9141 00000100:00100000:1.0:1746066808.361196:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985290880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.361207:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.361213:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e45 expref: 45 pid: 17253 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.361224:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e45 expref: 45 pid: 17253 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.361250:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfb079e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e45 expref: 45 pid: 17253 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.361265:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066808.361270:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfb07c8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.361281:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfb07c8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.361287:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfb07c8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066808.361690:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.361727:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985290880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 531us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.361734:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9141 00000100:00100000:0.0:1746066808.361913:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985290752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3142us (3570us total) trans 0 rc 106496/106496 00000100:00100000:0.0:1746066808.361920:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7477 00002000:00100000:0.0:1746066808.361928:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->106495) req@ffff88009c776a00 x1830882985290752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/440 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 106496/106496 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.361937:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776a00 with x1830882985290752 ext(0->106495) 00002000:00010000:0.0:1746066808.361941:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776a00 00000100:00100000:0.0:1746066808.364966:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.365054:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.365127:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985291264 00000100:00100000:1.0:1746066808.365131:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985291264 00000100:00100000:1.0:1746066808.365170:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6454 00000100:00100000:1.0:1746066808.365177:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+13:3183:x1830882985291264:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066808.365348:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+14:3183:x1830882985291264:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 172us (294us total) trans 8589937639 rc 0/0 00000100:00100000:1.0:1746066808.365354:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6454 00000100:00100000:0.0:1746066808.372826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.372930:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.372968:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.373147:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985291520 00000100:00100000:1.0:1746066808.373157:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985291520 00000100:00100000:1.0:1746066808.373572:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20019 00000100:00100000:1.0:1746066808.373577:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985291520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.373583:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.373591:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfb07dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6e68 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.373615:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985054976:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066808.373634:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.377338:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985054976:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066808.377356:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfb07dd lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e68 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.377371:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfb07dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e68 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.377382:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4000, rc 0) 00000100:00100000:0.0:1746066808.377405:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985291520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3828us (4524us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066808.377410:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20019 00000100:00100000:0.0:1746066808.381560:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.382092:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.382207:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985291904 00000100:00100000:1.0:1746066808.382211:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985291904 00010000:00010000:1.0:1746066808.382229:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 21 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.382247:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9142 00000100:00100000:1.0:1746066808.382252:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985291904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.382261:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.382279:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 21 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.382289:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 21 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.382306:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb073c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e06 expref: 21 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.382330:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.382332:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.382338:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.382351:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.382358:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.382359:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.382361:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.382367:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.382394:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.382406:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985055104:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.382474:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.382482:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985055232:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.382498:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.389153:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985055104:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.389168:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985055232:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.389188:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066808.389193:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.389236:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985291904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6982us (7142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.389248:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9142 00000100:00100000:0.0:1746066808.389464:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.405154:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.407225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.407720:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.418630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.419409:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985292928 00000100:00100000:1.0:1746066808.419420:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985292928 00010000:00010000:1.0:1746066808.419457:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb06ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2797568->3145727] (req 2797568->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db9 expref: 46 pid: 1893 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.419505:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9143 00000100:00100000:1.0:1746066808.419513:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882985292928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.419533:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.419553:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb06ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2797568->3145727] (req 2797568->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db9 expref: 46 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.419566:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb06ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2797568->3145727] (req 2797568->3039231) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db9 expref: 46 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.419585:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb06ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2797568->3145727] (req 2797568->3039231) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db9 expref: 46 pid: 1893 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.419615:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.419617:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.419624:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf800/0xf1867c21abfb07eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e7d expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.419631:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf800/0xf1867c21abfb07eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e7d expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.419640:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.419642:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.419645:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0c00/0xf1867c21abfb07f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e84 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.419651:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0c00/0xf1867c21abfb07f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e84 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.419677:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0c00/0xf1867c21abfb07f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e84 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.419687:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985055488:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.419779:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf800/0xf1867c21abfb07eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e7d expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.419833:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985055616:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.419852:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.423062:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985055488:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.423074:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985055616:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.423091:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.423178:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882985292928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3664us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.423187:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9143 00000100:00100000:0.0:1746066808.425496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.426041:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.426100:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985293440 00000100:00100000:0.0:1746066808.426104:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985293440 00002000:00100000:0.0:1746066808.426177:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098fbf800 x1830882985293440/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.426186:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882985293440 ext(2097152->3145727) 00002000:00010000:0.0:1746066808.426189:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf800 00000100:00100000:0.0:1746066808.426212:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7481 00000100:00100000:0.0:1746066808.426217:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882985293440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066808.437200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.445560:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.448054:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.448096:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.448438:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20025 00000100:00100000:1.0:1746066808.448449:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:3189:x1830882985294080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.448465:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.448477:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ea0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.448499:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.448503:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea0 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.448514:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea0 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.448533:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1600, rc 0) 00000100:00100000:1.0:1746066808.448567:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+48:3189:x1830882985294080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.448573:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20025 00000100:00100000:0.0:1746066808.450306:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.457817:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.459341:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.459372:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.464514:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.464548:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.464594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.465225:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9148 00000100:00100000:0.0:1746066808.465233:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985294976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066808.465356:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066808.465366:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfb06b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d7a expref: 30 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.465375:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfb06b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d7a expref: 30 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.465388:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfb06b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6d7a expref: 30 pid: 12237 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.466465:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.466468:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.466476:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb0823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea7 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.466490:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb0823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea7 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.466536:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb0823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea7 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066808.466552:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985056512:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066808.466606:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.473106:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.473164:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.473833:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.473993:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985056512:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066808.474013:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066808.474050:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985294976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8820us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.474059:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9148 00000100:00100000:0.0:1746066808.474093:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7483 00000100:00100000:0.0:1746066808.474097:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985295616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066808.474157:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985295616:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 59us (992us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066808.474163:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7483 00002000:00100000:0.0:1746066808.474167:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2449408->2453503) req@ffff880098fbea00 x1830882985295616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/4536 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.474174:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882985295616 ext(2449408->2453503) 00002000:00010000:0.0:1746066808.474176:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066808.474185:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7484 00000100:00100000:0.0:1746066808.474191:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985295872:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066808.477066:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.483364:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.496651:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.496691:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.504143:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.504389:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.504407:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.504444:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.504694:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985297408 00000100:00100000:0.0:1746066808.504696:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985297408 00010000:00010000:0.0:1746066808.504713:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06600/0xf1867c21abfb06e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db2 expref: 20 pid: 1893 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746066808.504731:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9150 00000100:00100000:0.0:1746066808.504735:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985297408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066808.504745:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066808.504764:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06600/0xf1867c21abfb06e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db2 expref: 20 pid: 1893 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.504774:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06600/0xf1867c21abfb06e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db2 expref: 20 pid: 1893 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.504789:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06600/0xf1867c21abfb06e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6db2 expref: 20 pid: 1893 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746066808.504800:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.505112:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.505125:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985297536 00000100:00100000:1.0:1746066808.505128:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985297536 00010000:00010000:1.0:1746066808.505139:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 36 pid: 9592 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.505156:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9151 00000100:00100000:1.0:1746066808.505159:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985297536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.505166:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.505173:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 36 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.505180:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 36 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.505191:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb06da lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6da4 expref: 36 pid: 9592 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.505201:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.505214:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985297536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.505219:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9151 00000100:00100000:1.0:1746066808.505255:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.505264:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985297280 00000100:00100000:1.0:1746066808.505266:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985297280 00010000:00010000:1.0:1746066808.505274:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfb0774 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e37 expref: 10 pid: 9590 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746066808.505284:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9152 00000100:00100000:1.0:1746066808.505288:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985297280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.505294:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.505299:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfb0774 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e37 expref: 10 pid: 9590 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.505306:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfb0774 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e37 expref: 10 pid: 9590 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.505316:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfb0774 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e37 expref: 10 pid: 9590 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746066808.505335:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.505337:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.505940:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.505952:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.505975:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.505984:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985057536:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.506005:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.506246:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985297408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1508us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.506253:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9150 00000100:00100000:0.0:1746066808.510054:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985057536:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066808.510069:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066808.510094:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985297280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4804us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.510104:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9152 00000100:00100000:0.0:1746066808.510240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.512284:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.512324:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.512442:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.512544:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20031 00000100:00100000:1.0:1746066808.512556:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985298176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.512567:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.512585:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0846 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6eca expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.512611:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0846 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eca expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.512620:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0846 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eca expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.512633:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:1.0:1746066808.512671:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985298176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 120us (346us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.512676:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20031 00000100:00100000:0.0:1746066808.514587:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.516343:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.517013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.524866:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.524960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.525001:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985298944 00000100:00100000:1.0:1746066808.525005:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985298944 00000100:00100000:1.0:1746066808.525050:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20035 00000100:00100000:1.0:1746066808.525059:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985299072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.525078:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.525094:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0862 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6eed expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.525126:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0862 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eed expref: 48 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.525137:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0862 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eed expref: 48 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.525155:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0200, rc 0) 00000100:00100000:1.0:1746066808.525196:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882985299072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 138us (340us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.525201:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20035 00000100:00100000:0.0:1746066808.528628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.528674:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.528811:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985299328 00000100:00100000:1.0:1746066808.528815:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985299328 00000100:00100000:1.0:1746066808.529043:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20038 00000100:00100000:1.0:1746066808.529049:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985299328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.529060:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.529076:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfb0870 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6efb expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.529108:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfb0870 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6efb expref: 47 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.529118:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfb0870 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6efb expref: 47 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.529129:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0800, rc 0) 00000100:00100000:1.0:1746066808.529171:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985299328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 122us (497us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.529177:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20038 00000100:00100000:0.0:1746066808.668085:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.668139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.674283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.678482:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.689962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.697268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.718767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.723440:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.735902:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985300480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12233us (12438us total) trans 17179875294 rc 0/0 00000100:00100000:0.0:1746066808.735914:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2152 00002000:00100000:0.0:1746066808.735927:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2449408->3145727) req@ffff88012b1f5180 x1830882985300480/t17179875294(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/448 e 0 to 0 dl 1746066819 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.735936:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5180 with x1830882985300480 ext(2449408->3145727) 00010000:00010000:0.0:1746066808.735946:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb0815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2449408->3145727] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e99 expref: 49 pid: 12255 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746066808.735960:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb0815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2449408->3145727] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e99 expref: 49 pid: 12255 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746066808.735967:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1f5180 00000100:00100000:1.0:1746066808.736104:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.740484:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985058688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.740496:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985058816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.740560:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb089a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3944448->4009983] (req 3944448->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f1e expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.740576:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:1.0:1746066808.740613:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3204:x1830882985300608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4295us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.740621:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20043 00000100:00100000:0.0:1746066808.742169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.742204:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.742235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.742313:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985300992 00000100:00100000:1.0:1746066808.742322:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985300992 00010000:00010000:1.0:1746066808.742357:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130800200/0xf1867c21abfb0815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2449408->3145727] (req 2449408->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e99 expref: 50 pid: 12255 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.742382:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985301248 00000100:00100000:1.0:1746066808.742384:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985301248 00010000:00010000:1.0:1746066808.742402:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb080e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e92 expref: 30 pid: 20361 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746066808.742416:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9155 00000100:00100000:1.0:1746066808.742422:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985301120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.742550:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.742642:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea0 expref: 49 pid: 12233 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.742650:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea0 expref: 49 pid: 12233 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.742664:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1600/0xf1867c21abfb081c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ea0 expref: 49 pid: 12233 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746066808.742680:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.742706:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985301120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 284us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.742712:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9155 00000100:00100000:0.0:1746066808.745506:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.745736:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985301504 00000100:00100000:1.0:1746066808.745743:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985301504 00002000:00100000:1.0:1746066808.745777:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (3944448->3948543) req@ffff88012b1f5c00 x1830882985301504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.745788:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5c00 with x1830882985301504 ext(3944448->3948543) 00002000:00010000:1.0:1746066808.745792:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f5c00 00000100:00100000:1.0:1746066808.745809:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7491 00000100:00100000:1.0:1746066808.745815:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985301504:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066808.745949:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985301504:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 134us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066808.745955:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7491 00002000:00100000:1.0:1746066808.745960:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (3944448->3948543) req@ffff88012b1f5c00 x1830882985301504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:214/0 lens 488/4536 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.745967:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5c00 with x1830882985301504 ext(3944448->3948543) 00002000:00010000:1.0:1746066808.745970:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f5c00 00000100:00100000:0.0:1746066808.750838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.750979:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.751052:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985301760 00000100:00100000:1.0:1746066808.751058:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985301760 00002000:00100000:1.0:1746066808.751095:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4005888->4009983) req@ffff88012b1f5f80 x1830882985301760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.751110:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5f80 with x1830882985301760 ext(4005888->4009983) 00002000:00010000:1.0:1746066808.751114:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f5f80 00000100:00100000:1.0:1746066808.751137:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7492 00000100:00100000:1.0:1746066808.751145:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985301760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066808.751252:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985301760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 107us (421us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066808.751258:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7492 00002000:00100000:1.0:1746066808.751263:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4005888->4009983) req@ffff88012b1f5f80 x1830882985301760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:214/0 lens 488/4536 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.751270:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5f80 with x1830882985301760 ext(4005888->4009983) 00002000:00010000:1.0:1746066808.751273:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f5f80 00000100:00100000:0.0:1746066808.751335:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.751353:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985301888 00000100:00100000:0.0:1746066808.751356:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985301888 00000100:00100000:0.0:1746066808.751375:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985302016 00000100:00100000:0.0:1746066808.751376:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985302016 00000100:00100000:0.0:1746066808.751390:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20044 00000100:00100000:0.0:1746066808.751394:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985301888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066808.751401:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066808.751412:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb08b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f2c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.751595:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.751597:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.751603:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb08b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f2c expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.751620:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb08b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f2c expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.751629:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66400, rc 0) 00000100:00100000:0.0:1746066808.751648:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985301888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 253us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066808.751652:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20044 00000100:00100000:0.0:1746066808.751664:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20045 00000100:00100000:0.0:1746066808.751668:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985302016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066808.751674:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066808.751680:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb08bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f33 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066808.751712:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985059200:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066808.752348:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.752376:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.752390:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985302528 00000100:00100000:0.0:1746066808.752393:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985302528 00002000:00100000:0.0:1746066808.752408:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88012b1f6d80 x1830882985302528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.752416:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f6d80 with x1830882985302528 ext(2097152->3145727) 00002000:00010000:0.0:1746066808.752420:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f6d80 00000100:00100000:0.0:1746066808.752430:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7493 00000100:00100000:0.0:1746066808.752434:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882985302528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066808.771940:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.778714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.786836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.791266:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.795915:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.796443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.800663:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.801562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.801955:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985303936 00000100:00100000:1.0:1746066808.801959:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985303936 00002000:00100000:1.0:1746066808.801986:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012b1f4700 x1830882985303936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.801993:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f4700 with x1830882985303936 ext(3145728->4194303) 00002000:00010000:1.0:1746066808.801996:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f4700 00000100:00100000:1.0:1746066808.802021:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7497 00000100:00100000:1.0:1746066808.802027:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985303936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066808.814549:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.814777:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985303936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12748us (13214us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066808.814788:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7497 00002000:00100000:1.0:1746066808.814794:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012b1f4700 x1830882985303936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:214/0 lens 488/440 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.814801:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f4700 with x1830882985303936 ext(3145728->4194303) 00002000:00010000:1.0:1746066808.814805:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f4700 00000100:00100000:0.0:1746066808.819997:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.823788:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.823938:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985304704 00000100:00100000:1.0:1746066808.823944:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985304704 00000100:00100000:1.0:1746066808.824028:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20051 00000100:00100000:1.0:1746066808.824035:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3209:x1830882985304704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.824048:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.824061:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f5d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.824080:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.824088:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.824089:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.824092:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f5d expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.824234:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.824245:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 34 pid: 12255 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.824259:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985060096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.824373:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.824801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.826316:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985060096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.826555:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f5d expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.826568:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd15c00, rc 0) 00000100:00100000:1.0:1746066808.826593:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3209:x1830882985304704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2559us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.826599:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20051 00000100:00100000:0.0:1746066808.832957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.832984:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.833039:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985305216 00000100:00100000:1.0:1746066808.833046:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985305216 00000100:00100000:0.0:1746066808.833052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.833076:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985305344 00000100:00100000:1.0:1746066808.833078:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985305344 00000100:00100000:0.0:1746066808.833086:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20052 00000100:00100000:0.0:1746066808.833093:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985305216:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066808.833102:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20053 00000100:00100000:1.0:1746066808.833105:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985305344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066808.833107:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.833111:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.833120:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb08ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f6b expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.833120:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb08f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f64 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.833137:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.833145:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb08f5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f64 expref: 50 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066808.833152:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb08f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f64 expref: 50 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066808.833158:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985060224:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066808.833162:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751800, rc 0) 00000100:00100000:0.0:1746066808.833189:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985305216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 98us (239us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066808.833194:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20052 00000100:00100000:1.0:1746066808.833201:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066808.834676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066808.834968:0:20361:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880096ec9880 x1830882985060224) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 39 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.834995:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb082a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6eae expref: 39 pid: 12255 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.835010:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985060224:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066808.835032:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb08ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f6b expref: 38 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.835040:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb08ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f6b expref: 38 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.835047:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:1.0:1746066808.835073:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985305344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1965us (2087us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066808.835079:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20053 00000100:00100000:0.0:1746066808.837396:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.837428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.837478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.837922:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985305984 00000100:00100000:1.0:1746066808.837930:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985305984 00000100:00100000:1.0:1746066808.837973:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20054 00000100:00100000:1.0:1746066808.837979:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:3202:x1830882985305984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.837993:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.838009:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f72 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.838033:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009718d600/0xf1867c21abfb08e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3190784->18446744073709551615] (req 3190784->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f56 expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.838045:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.838047:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.838050:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f72 expref: 50 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.838582:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009718d600/0xf1867c21abfb08e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3190784->18446744073709551615] (req 3190784->3731455) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f56 expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.838594:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009718d600/0xf1867c21abfb08e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3190784->18446744073709551615] (req 3190784->3731455) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f56 expref: 50 pid: 9592 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.838607:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985060608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.839295:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.844433:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985060608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.844471:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f72 expref: 49 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.844496:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895800, rc 0) 00000100:00100000:1.0:1746066808.844574:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:3202:x1830882985305984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6590us (7140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.844585:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20054 00000100:00100000:0.0:1746066808.847699:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.852647:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.853121:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985306624 00000100:00100000:1.0:1746066808.853128:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985306624 00000100:00100000:1.0:1746066808.853170:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20055 00000100:00100000:1.0:1746066808.853176:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3209:x1830882985306624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066808.853191:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.853204:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f79 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.853224:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.853226:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.853229:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.853237:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.853246:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895c00, rc 0) 00000100:00100000:1.0:1746066808.853277:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3209:x1830882985306624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.853282:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20055 00000100:00100000:0.0:1746066808.853454:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.866612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.875310:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.875353:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.875443:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.875464:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985307648 00000100:00100000:0.0:1746066808.875467:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985307648 00002000:00100000:0.0:1746066808.875489:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a5827b80 x1830882985307648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066808.875502:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827b80 with x1830882985307648 ext(3145728->4194303) 00002000:00010000:0.0:1746066808.875505:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5827b80 00000100:00100000:0.0:1746066808.875531:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7501 00000100:00100000:0.0:1746066808.875537:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985307648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066808.880528:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.891984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.910065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.910328:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985308288 00000100:00100000:1.0:1746066808.910337:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985308288 00000100:00100000:1.0:1746066808.910385:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20057 00000100:00100000:1.0:1746066808.910392:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3213:x1830882985308288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066808.910411:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.910428:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f87 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.910455:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c70 expref: 49 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910466:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e29 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910472:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca1 expref: 33 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910477:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.910479:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.910482:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.910522:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca1 expref: 33 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910533:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bde00/0xf1867c21abfb056e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ca1 expref: 33 pid: 11630 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066808.910544:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985060992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.910640:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e29 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910648:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfb075f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e29 expref: 10 pid: 12255 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066808.910665:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061120:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.910697:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c70 expref: 49 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066808.910704:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7600/0xf1867c21abfb0536 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c70 expref: 49 pid: 9591 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066808.910711:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061248:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.911343:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.911666:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985060992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.911676:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066808.912874:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.913472:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061248:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.913498:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.913520:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:1.0:1746066808.913658:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3213:x1830882985308288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3266us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.913664:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20057 00000100:00100000:0.0:1746066808.913675:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.915810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.918367:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.918552:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985309056 00000100:00100000:1.0:1746066808.918558:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985309056 00000100:00100000:1.0:1746066808.918602:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20058 00000100:00100000:1.0:1746066808.918609:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3213:x1830882985309056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066808.918622:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.918636:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f8e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918660:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfb0893 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f17 expref: 48 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918667:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f72 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918673:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918678:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.918680:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066808.918682:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2523135] (req 2097152->2523135) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918704:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918713:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.918722:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061504:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.918812:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f72 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918819:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfb08fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f72 expref: 48 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.918831:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061632:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.918853:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfb0893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f17 expref: 48 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.918977:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfb0893 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f17 expref: 48 pid: 12237 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.918985:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.919027:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.920627:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.920634:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061632:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.920639:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985061760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.920660:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2523135] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.920671:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00000100:00100000:1.0:1746066808.920695:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3213:x1830882985309056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2087us (2334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.920701:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20058 00000100:00100000:0.0:1746066808.921589:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.921631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.923175:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985309440 00000100:00100000:0.0:1746066808.923179:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985309440 00010000:00010000:0.0:1746066808.923194:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066808.923384:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9167 00000100:00100000:0.0:1746066808.923392:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2013:x1830882985309440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066808.923400:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066808.923408:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066808.923416:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066808.923427:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb0903 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f79 expref: 33 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066808.923663:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.923665:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066808.923671:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.923680:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066808.923704:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066808.923714:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985061888:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066808.924115:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.925233:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985061888:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.925247:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.925331:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985309440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1931us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.925344:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9167 00000100:00100000:0.0:1746066808.928684:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.975978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.976021:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985309824 00000100:00100000:1.0:1746066808.976029:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985309824 00000100:00100000:1.0:1746066808.976081:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20059 00000100:00100000:1.0:1746066808.976089:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:3218:x1830882985309824:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066808.976104:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066808.976119:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f95 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976144:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976152:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976158:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.976159:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.976162:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1613824->1785855] (req 1613824->1785855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976187:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976197:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 19 pid: 12255 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.976207:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985062016:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.976297:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.976304:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.976311:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985062144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.976455:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.978931:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985062016:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066808.978940:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985062144:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066808.978967:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1613824->1785855] (req 1613824->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.978978:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895400, rc 0) 00000100:00100000:1.0:1746066808.979005:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:3218:x1830882985309824:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2918us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.979012:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20059 00000100:00100000:0.0:1746066808.980233:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.980309:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985309952 00000100:00100000:1.0:1746066808.980314:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985309952 00010000:00010000:1.0:1746066808.980341:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.980372:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9168 00000100:00100000:1.0:1746066808.980378:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985309952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.980393:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.980409:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.980419:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.980436:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb07e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e76 expref: 20 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.980465:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.980497:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985309952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.980503:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9168 00000100:00100000:0.0:1746066808.983087:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066808.983579:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985310080 00000100:00100000:1.0:1746066808.983585:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985310080 00010000:00010000:1.0:1746066808.983612:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066808.983643:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9169 00000100:00100000:1.0:1746066808.983648:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985310080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066808.983658:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066808.983670:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.983677:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.983692:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb07cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e61 expref: 38 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066808.983702:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.983703:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066808.983707:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.983712:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066808.983731:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066808.983738:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985062272:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066808.983799:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066808.984992:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985062272:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066808.985007:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066808.985034:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985310080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1384us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066808.985041:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9169 00000100:00100000:0.0:1746066808.985683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066808.988503:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.004036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.004086:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.004248:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985310720 00000100:00100000:1.0:1746066809.004259:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985310720 00000100:00100000:1.0:1746066809.004314:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20060 00000100:00100000:1.0:1746066809.004321:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985310720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066809.004337:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.004351:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb0926 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6f9c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.004395:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985062400:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066809.004467:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00080000:0.0:1746066809.004585:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1746066809.005475:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.005483:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.005485:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066807 -> 1746066809 00000100:00100000:1.0:1746066809.005500:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985062400:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066809.005532:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb0926 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f9c expref: 50 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.005542:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb0926 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f9c expref: 50 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.005567:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:1.0:1746066809.005597:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985310720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1276us (1572us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066809.005603:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20060 00000100:00100000:0.0:1746066809.011933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066809.012287:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066809.030445:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985311232 00000100:00100000:0.0:1746066809.030454:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985311232 00000100:00100000:0.0:1746066809.030517:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20062 00000100:00100000:0.0:1746066809.030526:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:3222:x1830882985311232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066809.030544:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.030562:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb0934 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6faa expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.030592:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.030604:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066809.030606:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066809.030609:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb0934 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6faa expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.030641:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.030653:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 31 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066809.030666:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985062656:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.030744:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.032857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.039139:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.039233:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985311488 00000100:00100000:1.0:1746066809.039242:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985311488 00010000:00010000:1.0:1746066809.039277:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 34 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.039315:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9170 00000100:00100000:1.0:1746066809.039324:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2013:x1830882985311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.039337:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.039359:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 34 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.039369:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 34 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.039390:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfb0911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f87 expref: 34 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.039718:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.039721:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.039729:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb0934 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6faa expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.039737:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb0934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6faa expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.039771:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb0934 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6faa expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.039784:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985062784:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.040107:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.041289:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985062784:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.041305:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.041377:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2013:x1830882985311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2052us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.041386:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9170 00000100:00100000:0.0:1746066809.044275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.063840:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.069406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.077978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.078173:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985312128 00000100:00100000:1.0:1746066809.078183:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985312128 00010000:00010000:1.0:1746066809.078220:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 35 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.078258:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9171 00000100:00100000:1.0:1746066809.078266:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2014:x1830882985312128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.078282:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.078302:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 35 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.078314:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 35 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.078337:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894000/0xf1867c21abfb0918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f8e expref: 35 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.078371:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.078373:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.078381:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.078389:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.078427:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.078439:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985063040:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.078530:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.081183:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985063040:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.081206:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.081246:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2014:x1830882985312128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2980us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.081256:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9171 00000100:00100000:0.0:1746066809.089054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.090450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.090533:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985312640 00000100:00100000:1.0:1746066809.090538:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985312640 00002000:00100000:1.0:1746066809.090561:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4e300 x1830882985312640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.090569:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e300 with x1830882985312640 ext(2097152->4194303) 00002000:00010000:1.0:1746066809.090573:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4e300 00000100:00100000:1.0:1746066809.092004:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7512 00000100:00100000:1.0:1746066809.092015:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985312640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066809.113870:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985312640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21845us (23409us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066809.113915:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7512 00002000:00100000:1.0:1746066809.113928:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4e300 x1830882985312640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.113944:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e300 with x1830882985312640 ext(2097152->4194303) 00002000:00010000:1.0:1746066809.113950:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4e300 00000100:00100000:0.0:1746066809.125715:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.126463:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985312896 00000100:00100000:1.0:1746066809.126472:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985312896 00002000:00100000:1.0:1746066809.126524:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4c700 x1830882985312896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.126534:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c700 with x1830882985312896 ext(4194304->4861951) 00002000:00010000:1.0:1746066809.126540:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4c700 00000100:00100000:0.0:1746066809.137690:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.137734:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.137752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.137879:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985313280 00000100:00100000:1.0:1746066809.137898:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985313280 00000100:00100000:1.0:1746066809.137922:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20065 00000100:00100000:1.0:1746066809.137928:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882985313152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066809.137936:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.137945:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6fbf expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.137960:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.137961:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.137970:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.137984:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.137994:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:1.0:1746066809.138273:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2015:x1830882985313152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 344us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.138280:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20065 00000100:00100000:1.0:1746066809.138368:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985312896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11735us (12664us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066809.138375:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7513 00002000:00100000:1.0:1746066809.138385:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4c700 x1830882985312896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.138394:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c700 with x1830882985312896 ext(4194304->4861951) 00002000:00010000:1.0:1746066809.138399:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4c700 00000100:00100000:0.0:1746066809.143093:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.151221:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.151264:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.151303:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.151402:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985313536 00000100:00100000:1.0:1746066809.151412:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985313536 00010000:00010000:1.0:1746066809.151450:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb088c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f10 expref: 50 pid: 12237 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.151478:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985313664 00000100:00100000:1.0:1746066809.151480:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985313664 00010000:00010000:1.0:1746066809.151491:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb08b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f2c expref: 36 pid: 12255 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.151520:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9172 00000100:00100000:1.0:1746066809.151528:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985313536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.151545:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.151567:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb088c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f10 expref: 50 pid: 12237 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.151578:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb088c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f10 expref: 50 pid: 12237 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.151601:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb088c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f10 expref: 50 pid: 12237 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.151994:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.152037:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985313536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 509us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.152045:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9172 00000100:00100000:0.0:1746066809.154609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.164803:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.166344:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985314304 00000100:00100000:1.0:1746066809.166358:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985314304 00002000:00100000:1.0:1746066809.166414:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (815104->819199) req@ffff880095801f80 x1830882985314304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.166426:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985314304 ext(815104->819199) 00010000:00010000:1.0:1746066809.166435:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfb0957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fcd expref: 49 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.166450:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfb0957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fcd expref: 49 pid: 9592 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.166456:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095801f80 00000100:00100000:1.0:1746066809.166490:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2161 00000100:00100000:1.0:1746066809.166497:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985314304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066809.166649:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985314304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 151us (1857us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066809.166655:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2161 00002000:00100000:1.0:1746066809.166661:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (815104->819199) req@ffff880095801f80 x1830882985314304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/4536 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.166668:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985314304 ext(815104->819199) 00010000:00010000:1.0:1746066809.166671:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfb0957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fcd expref: 49 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.166680:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfb0957 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->819199) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fcd expref: 49 pid: 9592 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.166685:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095801f80 00000100:00100000:0.0:1746066809.173487:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.188513:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.188817:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985314688 00000100:00100000:1.0:1746066809.188827:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985314688 00000100:00100000:1.0:1746066809.188916:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17174 00000100:00100000:1.0:1746066809.188925:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+14:3233:x1830882985314688:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.188950:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.188969:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb0965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6fdb expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.189029:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189043:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189054:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189066:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189075:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189080:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189158:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189169:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 27 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.189176:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb08a8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f25 expref: 46 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.189182:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.189211:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb08a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f25 expref: 46 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.189220:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb08a8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f25 expref: 46 pid: 17253 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.189232:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985063808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.189342:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 27 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.189351:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 27 pid: 17253 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.189362:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985063936:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.189380:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.191668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.193297:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985063808:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.194284:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985063936:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.194305:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066809.198774:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985315200 00000100:00100000:1.0:1746066809.198777:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985315200 00010000:00010000:1.0:1746066809.198797:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 28 pid: 17253 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.198823:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9175 00000100:00100000:1.0:1746066809.198827:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985315200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.198840:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.198846:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 28 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.198855:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 28 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.198875:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfb0800 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e8b expref: 28 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.198906:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.198911:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.198920:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.198924:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.198928:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.198969:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985315200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.198975:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9175 00000100:00100000:0.0:1746066809.199214:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985064064:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066809.199231:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.199262:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985314816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6554us (7601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.199269:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9174 00000100:00100000:0.0:1746066809.202988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066809.203564:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203573:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066809.203627:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:1.0:1746066809.203632:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066809.203648:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203657:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203667:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203672:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203677:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203686:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203691:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066809.203695:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203700:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203707:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066809.203709:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066809.203712:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203716:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb096c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203725:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203729:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203733:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203736:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066809.203738:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203743:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203752:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476900) 00010000:00010000:1.0:1746066809.203754:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066809.203756:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203760:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfb0973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.203793:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb0965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fdb expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.203805:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fdb expref: 15 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.203811:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.203813:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066809.203815:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:1.0:1746066809.203852:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+15:3233:x1830882985314688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 14927us (15360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.203858:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17174 00000100:00100000:0.0:1746066809.206680:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.206739:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.206857:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985315840 00000100:00100000:1.0:1746066809.206863:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985315840 00000100:00100000:1.0:1746066809.206923:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985316096 00000100:00100000:1.0:1746066809.206925:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985316096 00000100:00100000:1.0:1746066809.206941:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20069 00000100:00100000:1.0:1746066809.206946:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985315840:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.206961:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.206975:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfb0981 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6fe9 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.207018:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985064192:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066809.207050:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20070 00000100:00100000:0.0:1746066809.207057:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985316096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066809.207065:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066809.207073:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00010000:00010000:0.0:1746066809.207075:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ff7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.207087:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.207089:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.207098:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.207116:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.207130:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497600, rc 0) 00000100:00100000:0.0:1746066809.207150:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985316096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 95us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.207156:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20070 00000100:00100000:0.0:1746066809.208410:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985315712 00000100:00100000:1.0:1746066809.208411:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985315968 00000100:00100000:1.0:1746066809.208415:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985315968 00000100:00100000:0.0:1746066809.208415:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985315712 00000100:00100000:0.0:1746066809.208438:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985316224 00000100:00100000:0.0:1746066809.208440:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985316224 00000100:00100000:0.0:1746066809.208458:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20071 00000100:00100000:1.0:1746066809.208463:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985064192:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066809.208463:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985315712:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066809.208472:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.208482:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6fe2 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.208488:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfb0981 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe9 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.208495:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.208496:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.208498:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfb0981 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe9 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.208502:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 13 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.208525:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 13 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.208526:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00010000:00010000:0.0:1746066809.208534:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496e00, rc 0) 00000100:00100000:0.0:1746066809.208552:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2014:x1830882985315712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 89us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.208553:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985315840:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1606us (1874us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066809.208556:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20071 00000100:00100000:1.0:1746066809.208559:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20069 00000100:00100000:0.0:1746066809.208568:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20072 00000100:00100000:0.0:1746066809.208572:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985316224:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066809.208578:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066809.208586:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20073 00010000:00010000:0.0:1746066809.208586:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ffe expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.208591:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985315968:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066809.208594:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.208595:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.208597:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.208600:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ffe expref: 10 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.208603:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d6ff0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.208608:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ffe expref: 10 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.208614:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.208614:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496a00, rc 0) 00010000:00010000:1.0:1746066809.208615:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.208619:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066809.208626:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985316224:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.208631:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20072 00010000:00010000:1.0:1746066809.208633:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.208640:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894400, rc 0) 00000100:00100000:1.0:1746066809.208654:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+13:2014:x1830882985315968:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 64us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.208659:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20073 00000100:00100000:0.0:1746066809.211150:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.211308:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985316480 00000100:00100000:1.0:1746066809.211317:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985316480 00000100:00100000:1.0:1746066809.211497:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17175 00000100:00100000:1.0:1746066809.211517:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+15:3233:x1830882985316480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.211534:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.211551:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfb09a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7005 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.211658:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.211673:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fdb expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.211680:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.211708:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fdb expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.211722:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb097a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fdb expref: 16 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.211734:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985064320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.212683:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.213857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.214676:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985064320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.214698:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066809.220292:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.221120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.222052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066809.225274:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.225281:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066809.225300:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066809.225412:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfb09a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.225427:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.225434:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.225436:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066809.225438:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895c00, rc 0) 00000100:00100000:1.0:1746066809.225459:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+16:3233:x1830882985316480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 13955us (14319us total) trans 8589937644 rc 0/0 00000100:00100000:1.0:1746066809.225464:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17175 00000100:00100000:0.0:1746066809.234474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.234493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.234519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.234544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.234739:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985316992:12345-192.168.204.16@tcp:4:cat.0 Request processed in 13085us (13617us total) trans 21474842664 rc 0/0 00000100:00100000:0.0:1746066809.234751:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2163 00002000:00100000:0.0:1746066809.234763:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1613824->1785855) req@ffff880097a89c00 x1830882985316992/t21474842664(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/448 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.234772:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89c00 with x1830882985316992 ext(1613824->1785855) 00010000:00010000:0.0:1746066809.234782:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 39 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.234795:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb091f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f95 expref: 39 pid: 20361 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746066809.234801:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a89c00 00000100:00100000:1.0:1746066809.234985:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985317120 00000100:00100000:1.0:1746066809.234993:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985317120 00010000:00010000:1.0:1746066809.235024:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ffe expref: 10 pid: 12237 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.235051:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985317248 00000100:00100000:1.0:1746066809.235053:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985317248 00010000:00010000:1.0:1746066809.235060:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb090a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f80 expref: 39 pid: 12255 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.235071:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985317376 00000100:00100000:1.0:1746066809.235072:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985317376 00010000:00010000:1.0:1746066809.235079:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f5d expref: 22 pid: 20361 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.235089:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9178 00000100:00100000:1.0:1746066809.235094:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985317120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.235106:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.235121:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ffe expref: 10 pid: 12237 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.235129:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098496a00/0xf1867c21abfb0996 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ffe expref: 10 pid: 12237 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.235152:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.235168:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985317120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.235172:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9178 00000100:00100000:1.0:1746066809.235180:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9179 00000100:00100000:1.0:1746066809.235184:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985317248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.235188:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.235192:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb090a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f80 expref: 39 pid: 12255 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.235199:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb090a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f80 expref: 39 pid: 12255 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.235207:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.235215:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985317248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.235219:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9179 00000100:00100000:1.0:1746066809.235224:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9180 00000100:00100000:1.0:1746066809.235228:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985317376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.235233:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.235237:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f5d expref: 22 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.235244:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb08e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6f5d expref: 22 pid: 20361 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.235252:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.235253:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.235260:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66600/0xf1867c21abfb09b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7013 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.235272:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66600/0xf1867c21abfb09b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7013 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.235298:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66600/0xf1867c21abfb09b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7013 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.235308:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985064960:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.235352:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.235371:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985317504 00000100:00100000:1.0:1746066809.235373:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985317504 00000100:00100000:1.0:1746066809.235398:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17176 00000100:00100000:1.0:1746066809.235402:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+16:3233:x1830882985317504:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.235419:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.235431:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb09c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d701a expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.235500:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb09ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.235524:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.235530:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb09ce lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.235547:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.235560:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 17 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.235568:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985065088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.235588:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.240092:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985064960:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066809.240111:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066809.240116:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.240537:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985317376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5305us (6015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.240544:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9180 00000100:00100000:0.0:1746066809.241740:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.241801:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985317760 00000100:00100000:1.0:1746066809.241806:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985317760 00010000:00010000:1.0:1746066809.241828:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 18 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.241856:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9182 00000100:00100000:1.0:1746066809.241862:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+18:2015:x1830882985317760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.241871:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.241876:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 18 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.241905:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 18 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.241929:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfb09ab lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7005 expref: 18 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.241946:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.241950:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb09ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.241959:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb09ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.241964:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb09ce lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.241993:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.242028:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+17:2015:x1830882985317760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.242034:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9182 00000100:00100000:0.0:1746066809.242565:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985318016 00000100:00100000:0.0:1746066809.242573:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985318016 00002000:00100000:0.0:1746066809.242605:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (3813376->3817471) req@ffff88012ea35500 x1830882985318016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.242614:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985318016 ext(3813376->3817471) 00002000:00010000:0.0:1746066809.242618:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea35500 00000100:00100000:0.0:1746066809.242639:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7515 00000100:00100000:0.0:1746066809.242645:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985318016:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066809.243965:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985318016:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1315us (1417us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066809.243973:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7515 00002000:00100000:0.0:1746066809.243980:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3813376->3817471) req@ffff88012ea35500 x1830882985318016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/4536 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.243989:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985318016 ext(3813376->3817471) 00002000:00010000:0.0:1746066809.243992:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea35500 00000100:00100000:0.0:1746066809.246024:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.246072:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.246167:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985318144 00000100:00100000:1.0:1746066809.246174:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985318144 00000100:00100000:1.0:1746066809.246216:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985318272 00000100:00100000:1.0:1746066809.246217:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985318272 00000100:00100000:1.0:1746066809.246230:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20076 00000100:00100000:1.0:1746066809.246236:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985318144:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.246252:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.246267:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7021 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.246286:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.246288:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.246295:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7021 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.246312:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7021 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.246322:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57800, rc 0) 00000100:00100000:1.0:1746066809.246360:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985318144:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.246366:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20076 00000100:00100000:1.0:1746066809.246378:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20077 00000100:00100000:1.0:1746066809.246382:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985318272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.246387:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.246394:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfb09dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7028 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.246425:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985065344:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066809.246476:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.249161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066809.249285:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066809 -> 1746066810 00002000:00010000:1.0:1746066809.249289:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066809 -> 1746066810 00002000:00010000:1.0:1746066809.249290:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066809 -> 1746066810 00000100:00100000:1.0:1746066809.249305:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985065344:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066809.249335:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfb09dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7028 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.249345:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfb09dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7028 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.249357:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57000, rc 0) 00000100:00100000:1.0:1746066809.249384:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985318272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3002us (3313us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066809.249390:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20077 00000100:00100000:1.0:1746066809.251746:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.251781:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.251801:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985318912 00000100:00100000:1.0:1746066809.251808:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985318912 00000100:00100000:1.0:1746066809.251837:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20078 00000100:00100000:1.0:1746066809.251843:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:3229:x1830882985318912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066809.251858:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.251872:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d702f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.251924:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.251933:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.251940:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.251945:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.251947:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.251951:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 37 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.251978:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.251988:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 37 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.251998:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065472:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.252136:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985318784 00010000:00010000:1.0:1746066809.252140:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066809.252140:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985318784 00010000:00010000:1.0:1746066809.252152:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 12 pid: 20361 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.252161:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065600:192.168.204.16@tcp:104: 00002000:00100000:0.0:1746066809.252162:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800966e1880 x1830882985318784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.252169:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985318784 ext(1048576->2097151) 00002000:00010000:0.0:1746066809.252173:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:0.0:1746066809.252192:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7517 00000100:00100000:0.0:1746066809.252197:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2015:x1830882985318784:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:1.0:1746066809.252207:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.252213:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf56c00/0xf1867c21abfb093b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fb1 expref: 49 pid: 12255 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.252217:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065728:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.252228:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.254077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.264340:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.264368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.264481:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2015:x1830882985318784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12283us (12740us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066809.264492:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7517 00002000:00100000:0.0:1746066809.264513:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800966e1880 x1830882985318784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.264522:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985318784 ext(1048576->2097151) 00002000:00010000:0.0:1746066809.264527:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:1.0:1746066809.264546:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985319296 00000100:00100000:1.0:1746066809.264566:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985319296 00010000:00010000:1.0:1746066809.264601:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 38 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.264617:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.265308:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9183 00000100:00100000:1.0:1746066809.265314:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985319296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.265322:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.265616:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 38 pid: 9592 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.265629:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 38 pid: 9592 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.265640:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.265655:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985319296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 342us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.265660:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9183 00010000:00010000:1.0:1746066809.265697:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb0950 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fc6 expref: 37 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.265721:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065472:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.265732:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497600/0xf1867c21abfb0988 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff7 expref: 12 pid: 20361 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.265740:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.265749:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065728:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.265775:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.265784:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd15600, rc 0) 00000100:00100000:1.0:1746066809.265799:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:3229:x1830882985318912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13957us (14018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.265805:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20078 00000100:00100000:0.0:1746066809.268410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.274990:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.275020:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.275044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.275068:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985319936 00000100:00100000:0.0:1746066809.275077:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985319936 00000100:00100000:0.0:1746066809.275125:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985320320 00000100:00100000:0.0:1746066809.275127:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985320320 00000100:00100000:0.0:1746066809.275143:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20079 00000100:00100000:0.0:1746066809.275151:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985319936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066809.275169:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.275185:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d703d expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.275208:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.275210:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.275219:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d703d expref: 50 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.275233:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d703d expref: 50 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.275243:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943ea000, rc 0) 00000100:00100000:1.0:1746066809.275437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.275452:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985320448 00000100:00100000:1.0:1746066809.275455:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985320448 00000100:00100000:1.0:1746066809.275474:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20081 00000100:00100000:1.0:1746066809.275478:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985320448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066809.275484:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.275492:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb0a06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d704b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.275544:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065984:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066809.275602:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.275665:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.276932:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985319936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1778us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.276939:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20079 00000100:00100000:0.0:1746066809.281040:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066809.281206:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066809 -> 1746066810 00002000:00010000:1.0:1746066809.281211:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066809 -> 1746066810 00002000:00010000:1.0:1746066809.281213:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066809 -> 1746066810 00000100:00100000:1.0:1746066809.281232:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985065984:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066809.281269:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb0a06 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d704b expref: 51 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.281283:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb0a06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d704b expref: 51 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.281295:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:1.0:1746066809.281340:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985320448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5860us (5903us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066809.281349:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20081 00000100:00100000:0.0:1746066809.282705:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.282748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.291596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.291640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.291707:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985321856 00000100:00100000:1.0:1746066809.291714:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985321856 00002000:00100000:1.0:1746066809.291750:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a03d7480 x1830882985321856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.291758:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985321856 ext(1048576->2097151) 00002000:00010000:1.0:1746066809.291762:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d7480 00000100:00100000:1.0:1746066809.291781:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7522 00000100:00100000:1.0:1746066809.291787:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985321856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066809.316674:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985321856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24873us (25020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066809.316688:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7522 00002000:00100000:1.0:1746066809.316700:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a03d7480 x1830882985321856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.316709:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985321856 ext(1048576->2097151) 00002000:00010000:1.0:1746066809.316716:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d7480 00000100:00100000:0.0:1746066809.322002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.322117:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985322112 00000100:00100000:1.0:1746066809.322127:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985322112 00002000:00100000:1.0:1746066809.322175:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4460544->4861951) req@ffff8800a03d4e00 x1830882985322112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.322186:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882985322112 ext(4460544->4861951) 00002000:00010000:1.0:1746066809.322191:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:1.0:1746066809.322223:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7523 00000100:00100000:1.0:1746066809.322231:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2014:x1830882985322112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066809.326971:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2014:x1830882985322112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4729us (4969us total) trans 0 rc 401408/401408 00000100:00100000:1.0:1746066809.326984:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7523 00002000:00100000:1.0:1746066809.326997:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4460544->4861951) req@ffff8800a03d4e00 x1830882985322112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.327006:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882985322112 ext(4460544->4861951) 00002000:00010000:1.0:1746066809.327013:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:0.0:1746066809.333328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.333422:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.337325:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.340381:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.343261:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985322624 00000100:00100000:0.0:1746066809.343274:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985322624 00002000:00100000:0.0:1746066809.343344:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4460543) req@ffff8800966e0380 x1830882985322624/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.343358:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0380 with x1830882985322624 ext(4194304->4460543) 00010000:00010000:0.0:1746066809.343368:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 36 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.343381:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 36 pid: 12255 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746066809.343388:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e0380 00000100:00100000:0.0:1746066809.343422:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2164 00000100:00100000:0.0:1746066809.343430:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2016:x1830882985322624:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066809.352935:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985322624:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9496us (12554us total) trans 17179875300 rc 0/0 00000100:00100000:1.0:1746066809.352948:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2164 00002000:00100000:1.0:1746066809.352959:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4460543) req@ffff8800966e0380 x1830882985322624/t17179875300(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/448 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.352968:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0380 with x1830882985322624 ext(4194304->4460543) 00010000:00010000:1.0:1746066809.352977:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 38 pid: 12255 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.352993:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fd15600/0xf1867c21abfb09e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d702f expref: 38 pid: 12255 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.352999:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e0380 00000100:00100000:0.0:1746066809.358672:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.364757:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985066624:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066809.364783:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.364852:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2014:x1830882985322752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5867us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.364864:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9186 00000100:00100000:0.0:1746066809.365454:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985323008 00000100:00100000:0.0:1746066809.365461:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985323008 00002000:00100000:0.0:1746066809.365499:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880095dd5880 x1830882985323008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.365519:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5880 with x1830882985323008 ext(2097152->3145727) 00002000:00010000:0.0:1746066809.365524:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5880 00000100:00100000:0.0:1746066809.365558:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7524 00000100:00100000:0.0:1746066809.365565:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985323008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066809.377038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.380182:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.400708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.403792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.406862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.411688:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.412846:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.412920:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.413020:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985324288 00000100:00100000:1.0:1746066809.413030:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985324288 00002000:00100000:1.0:1746066809.413081:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800986cc700 x1830882985324288/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.413091:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cc700 with x1830882985324288 ext(2097152->4194303) 00002000:00010000:1.0:1746066809.413096:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cc700 00000100:00100000:1.0:1746066809.413123:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7525 00000100:00100000:1.0:1746066809.413130:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985324288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066809.429831:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985324288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16687us (16974us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066809.429844:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7525 00002000:00100000:1.0:1746066809.429858:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800986cc700 x1830882985324288/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.429868:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cc700 with x1830882985324288 ext(2097152->4194303) 00002000:00010000:1.0:1746066809.429874:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cc700 00000100:00100000:0.0:1746066809.435702:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.440749:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.443472:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.446011:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.449962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.454395:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.457745:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.472856:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.504351:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.525156:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.531242:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.531273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.531292:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985326592 00000100:00100000:1.0:1746066809.531298:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985326592 00010000:00010000:1.0:1746066809.531325:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 12 pid: 12233 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.531358:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9191 00000100:00100000:1.0:1746066809.531365:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985326592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.531377:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.531399:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 12 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531409:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 12 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531431:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfb099d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6ff0 expref: 12 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531447:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.531463:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985326592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.531469:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9191 00000100:00100000:1.0:1746066809.531518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.531529:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985326848 00000100:00100000:1.0:1746066809.531533:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985326848 00010000:00010000:1.0:1746066809.531542:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 38 pid: 12233 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.531555:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9193 00000100:00100000:1.0:1746066809.531559:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985326848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.531566:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.531571:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 38 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531579:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 38 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531589:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfb0949 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fbf expref: 38 pid: 12233 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.531598:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.531600:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.531607:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf600/0xf1867c21abfb0a68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7091 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.531614:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf600/0xf1867c21abfb0a68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7091 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.531637:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf600/0xf1867c21abfb0a68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7091 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.531647:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985068032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.531696:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.534160:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.534391:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985068032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.534410:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.534445:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985326848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2885us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.534453:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9193 00000100:00100000:0.0:1746066809.539819:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.544255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.545688:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985327360 00000100:00100000:1.0:1746066809.545699:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985327360 00010000:00010000:1.0:1746066809.545739:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfb0a4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7083 expref: 52 pid: 9592 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.545783:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9194 00000100:00100000:1.0:1746066809.545792:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985327360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.545806:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.545827:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfb0a4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7083 expref: 52 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.545839:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfb0a4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7083 expref: 52 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.545863:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfb0a4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7083 expref: 52 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.545906:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.545909:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.545916:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.545924:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.546166:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.546179:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985068288:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.546577:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.551301:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985068288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.551320:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.551345:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985327360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5554us (7100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.551352:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9194 00000100:00100000:0.0:1746066809.564613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.586847:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.586955:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.614159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.614200:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.614412:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2013:x1830882985328256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27116us (27578us total) trans 0 rc 1990656/1990656 00000100:00100000:0.0:1746066809.614423:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7532 00002000:00100000:0.0:1746066809.614435:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2203648->4194303) req@ffff88008e435f80 x1830882985328256/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 1990656/1990656 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.614444:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435f80 with x1830882985328256 ext(2203648->4194303) 00002000:00010000:0.0:1746066809.614451:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435f80 00000100:00100000:1.0:1746066809.614805:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20093 00000100:00100000:1.0:1746066809.614814:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+53:2014:x1830882985328768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066809.614821:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.614829:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb0a84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d70ad expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.614853:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985068544:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066809.614926:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.616564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.617656:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985068544:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066809.617688:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb0a84 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ad expref: 54 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.617701:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfb0a84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ad expref: 54 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.617722:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c200, rc 0) 00000100:00100000:1.0:1746066809.617907:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+55:2014:x1830882985328768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3094us (3706us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066809.617913:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20093 00000100:00100000:0.0:1746066809.622971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.623006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.624462:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7534 00000100:00100000:0.0:1746066809.624469:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2015:x1830882985329152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066809.626354:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.629975:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2015:x1830882985329152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5495us (6993us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066809.629987:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7534 00002000:00100000:1.0:1746066809.629999:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e435500 x1830882985329152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:215/0 lens 488/440 e 0 to 0 dl 1746066820 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.630009:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435500 with x1830882985329152 ext(4194304->4861951) 00002000:00010000:1.0:1746066809.630015:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435500 00000100:00100000:0.0:1746066809.632568:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.633721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.633865:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985329664 00000100:00100000:1.0:1746066809.633869:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985329664 00010000:00010000:1.0:1746066809.633910:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf600/0xf1867c21abfb0a68 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7091 expref: 42 pid: 9590 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.634285:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9195 00000100:00100000:1.0:1746066809.634291:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2016:x1830882985329664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.634304:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.634306:0:7232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie f1867c21abfb0a68) 00010000:00010000:1.0:1746066809.634308:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.634345:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2016:x1830882985329664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (625us total) trans 0 rc 116/116 00000100:00100000:1.0:1746066809.634351:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9195 00000100:00100000:0.0:1746066809.635596:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.636182:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2170 00000100:00100000:1.0:1746066809.636189:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985329920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066809.636312:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985329920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 124us (716us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066809.636317:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2170 00002000:00100000:1.0:1746066809.636322:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (2011136->2015231) req@ffff88008e434a80 x1830882985329920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/4536 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.636329:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434a80 with x1830882985329920 ext(2011136->2015231) 00010000:00010000:1.0:1746066809.636333:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 53 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.636341:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 53 pid: 12233 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.636346:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e434a80 00000100:00100000:0.0:1746066809.637793:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.639055:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.639119:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.639513:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985330304 00000100:00100000:1.0:1746066809.639517:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985330304 00002000:00100000:1.0:1746066809.639549:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (2011136->2097151) req@ffff8800958ad880 x1830882985330304/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.639558:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882985330304 ext(2011136->2097151) 00010000:00010000:1.0:1746066809.639564:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.639573:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.639580:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958ad880 00000100:00100000:1.0:1746066809.639604:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2171 00000100:00100000:1.0:1746066809.639610:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+55:2016:x1830882985330304:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066809.641928:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.644097:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+56:2016:x1830882985330304:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4484us (5041us total) trans 17179875303 rc 0/0 00000100:00100000:1.0:1746066809.644104:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2171 00002000:00100000:1.0:1746066809.644111:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (2011136->2097151) req@ffff8800958ad880 x1830882985330304/t17179875303(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/448 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066809.644118:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882985330304 ext(2011136->2097151) 00010000:00010000:1.0:1746066809.644124:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.644133:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746066809.644138:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958ad880 00000100:00100000:1.0:1746066809.647010:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985330688 00000100:00100000:1.0:1746066809.647019:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985330688 00010000:00010000:1.0:1746066809.647053:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.647078:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9196 00000100:00100000:1.0:1746066809.647084:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+56:2014:x1830882985330688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.647096:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.647115:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.647130:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.647153:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfb0a8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70b4 expref: 56 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.647170:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.647172:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.647178:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.647186:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.647219:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.647229:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985069440:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.647292:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.651245:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985069440:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.651265:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.651303:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:2014:x1830882985330688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4217us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.651313:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9196 00000100:00100000:0.0:1746066809.652615:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.652681:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.652743:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985331200 00000100:00100000:1.0:1746066809.652747:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985331200 00010000:00010000:1.0:1746066809.652764:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 41 pid: 9590 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.652793:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9197 00000100:00100000:1.0:1746066809.652799:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2014:x1830882985331200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.652811:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.652831:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 41 pid: 9590 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.652842:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 41 pid: 9590 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.652865:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfb0a6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7098 expref: 41 pid: 9590 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.652905:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.652907:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.652914:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.652921:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.652949:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.652959:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985069568:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066809.653012:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.660232:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985069568:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066809.660254:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.660300:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985331200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7499us (7616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.660310:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9197 00000100:00100000:1.0:1746066809.661525:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.661588:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985331456 00000100:00100000:0.0:1746066809.661595:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985331456 00002000:00100000:0.0:1746066809.661626:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2519040->2523135) req@ffff8800966e3b80 x1830882985331456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/0 e 0 to 0 dl 1746066820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.661632:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3b80 with x1830882985331456 ext(2519040->2523135) 00002000:00010000:0.0:1746066809.661635:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3b80 00000100:00100000:0.0:1746066809.667981:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.688570:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.710023:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.716660:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.716713:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.719386:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985332736 00000100:00100000:1.0:1746066809.719394:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985332736 00010000:00010000:1.0:1746066809.719426:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098faea00/0xf1867c21abfb0a5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d708a expref: 31 pid: 17253 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.719453:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9198 00000100:00100000:1.0:1746066809.719459:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985332736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.719472:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.719478:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098faea00/0xf1867c21abfb0a5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d708a expref: 31 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.719489:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098faea00/0xf1867c21abfb0a5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d708a expref: 31 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.719523:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faea00/0xf1867c21abfb0a5a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d708a expref: 31 pid: 17253 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.719541:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.719545:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.719557:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.719561:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.719566:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.720331:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985332736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 870us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.720338:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9198 00000100:00100000:0.0:1746066809.723932:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.723984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.724030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.724099:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985333248 00000100:00100000:1.0:1746066809.724103:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985333248 00000100:00100000:1.0:1746066809.724338:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20101 00000100:00100000:1.0:1746066809.724343:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985333248:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066809.724350:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.724359:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d70ec expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.724371:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.724372:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.724377:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.724386:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.724393:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944e00, rc 0) 00000100:00100000:1.0:1746066809.724936:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985333248:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 591us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.724943:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20101 00000100:00100000:0.0:1746066809.730714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.733534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.733834:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985333632 00000100:00100000:1.0:1746066809.733842:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985333632 00010000:00010000:1.0:1746066809.733876:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d7 expref: 19 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.733950:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9200 00000100:00100000:1.0:1746066809.733957:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985333632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.733969:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.733975:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d7 expref: 19 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.733986:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d7 expref: 19 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.734170:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0ac3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d7 expref: 19 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.734195:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.734200:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb0ae6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.734472:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb0ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.734478:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb0ae6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.734508:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.734866:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985333632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 909us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.734875:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9200 00000100:00100000:0.0:1746066809.739427:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.740650:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985070208 00000100:00100000:1.0:1746066809.740655:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985070208 00000100:00100000:1.0:1746066809.740702:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1746066809.740708:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985070208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746066809.740724:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 450560 granted 1302453568 pending 10661888 free 3906400256 avail 3674877952 00000100:00100000:1.0:1746066809.740760:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985070208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.740765:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1746066809.741676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745463:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.745508:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334144 00000100:00100000:0.0:1746066809.745516:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334144 00000100:00100000:0.0:1746066809.745555:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334400 00000100:00100000:0.0:1746066809.745557:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334400 00000100:00100000:0.0:1746066809.745568:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334656 00000100:00100000:0.0:1746066809.745570:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334656 00000100:00100000:0.0:1746066809.745579:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334272 00000100:00100000:0.0:1746066809.745580:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334272 00000100:00100000:0.0:1746066809.745588:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334528 00000100:00100000:0.0:1746066809.745589:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334528 00000100:00100000:0.0:1746066809.745600:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20102 00000100:00100000:0.0:1746066809.745607:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985334144:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066809.745653:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfb0b10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.745672:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 39 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.745681:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d703d expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.745688:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.745694:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.745695:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.745699:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfb0b10 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.745730:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.745742:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 14 pid: 12237 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.745756:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985070336:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.745834:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d703d expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.745842:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943ea000/0xf1867c21abfb09f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d703d expref: 54 pid: 12233 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.745850:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985070464:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.745875:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 39 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.745905:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 39 pid: 9592 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066809.745913:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985070592:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.745940:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.745959:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20103 00000100:00100000:0.0:1746066809.745964:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985334400:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066809.745985:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746001:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c9a expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746008:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e22 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746014:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cc4 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746019:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.746021:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.746022:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746038:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cc4 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746046:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb0591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6cc4 expref: 38 pid: 3528 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.746056:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070720:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.746081:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e22 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746088:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70000/0xf1867c21abfb077b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6e22 expref: 12 pid: 3528 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.746099:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070848:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.746120:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c9a expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.746126:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb0552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6c9a expref: 21 pid: 11630 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.746132:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070976:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.746146:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.746162:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20104 00000100:00100000:0.0:1746066809.746168:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985334656:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066809.746184:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746193:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746197:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066809.746198:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066809.746200:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746212:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.746222:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 54 pid: 12233 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066809.746229:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985071104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.746246:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.746282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.746422:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985334784 00000100:00100000:1.0:1746066809.746427:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985334784 00000100:00100000:1.0:1746066809.746449:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20105 00000100:00100000:1.0:1746066809.746455:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985334272:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066809.746472:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746482:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746490:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a400/0xf1867c21abfb09ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7044 expref: 38 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746508:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7021 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746518:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746519:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746521:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746536:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7021 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746544:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf57800/0xf1867c21abfb09d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7021 expref: 13 pid: 12255 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.746551:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071232:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.746581:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0a400/0xf1867c21abfb09ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7044 expref: 38 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746587:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e0a400/0xf1867c21abfb09ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7044 expref: 38 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.746594:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.746615:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746622:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 21 pid: 9592 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.746634:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071488:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.746651:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.746667:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20106 00000100:00100000:1.0:1746066809.746673:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985334528:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066809.746690:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746700:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746706:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746711:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746713:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746715:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746729:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746736:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.746744:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985071616:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.746770:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746777:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37000/0xf1867c21abfb0a92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70bb expref: 54 pid: 12233 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.746784:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985071744:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.746801:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.746817:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20107 00000100:00100000:1.0:1746066809.746822:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985334784:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066809.746837:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746846:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746853:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746859:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfb0a76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d709f expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746865:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746870:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.746872:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.746905:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfb0a76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d709f expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.746912:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfb0a76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d709f expref: 21 pid: 9590 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.746920:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985071872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.747270:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.747279:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 13 pid: 9590 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.747482:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985072000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.747526:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.747533:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 38 pid: 9590 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.747540:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985072128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066809.747560:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.754878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.754976:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070720:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.755010:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066809.755027:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755058:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985070976:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.755085:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.755120:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985071104:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066809.755129:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.755206:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9201 00000100:00100000:1.0:1746066809.755217:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985334912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.755232:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066809.755238:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985071616:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.755252:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 15 pid: 12237 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.755262:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 15 pid: 12237 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746066809.755269:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985071744:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.755281:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfb098f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fe2 expref: 15 pid: 12237 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746066809.755284:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.755327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755529:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066809.755535:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.755569:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985334912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 356us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.755575:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9201 00000100:00100000:0.0:1746066809.755641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755650:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755657:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755688:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.755712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.756240:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.756276:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.756336:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.756458:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9205 00000100:00100000:1.0:1746066809.756465:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985335680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.756473:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.756485:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 40 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756505:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 40 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756519:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb095e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6fd4 expref: 40 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756533:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.756535:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.756538:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfb0b10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.756544:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfb0b10 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.756563:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.756582:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2013:x1830882985335680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.756588:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9205 00000100:00100000:1.0:1746066809.756601:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9208 00000100:00100000:1.0:1746066809.756606:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985336064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.756612:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.756621:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.756629:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.756640:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfb0aca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70de expref: 14 pid: 9592 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746066809.756648:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.756665:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985336064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.756670:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9208 00000100:00100000:1.0:1746066809.756683:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9210 00000100:00100000:1.0:1746066809.756688:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985336320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.756694:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.756704:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 21 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756712:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 21 pid: 9592 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756724:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.756739:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985336320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.756745:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9210 00000100:00100000:1.0:1746066809.756757:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9212 00000100:00100000:1.0:1746066809.756762:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985336576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.756768:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.756778:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 38 pid: 9590 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756785:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 38 pid: 9590 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.756795:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.756810:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985336576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.756815:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9212 00000100:00100000:1.0:1746066809.756853:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071232:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756862:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a400/0xf1867c21abfb09ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7044 expref: 37 pid: 9592 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.756873:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756901:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718d000/0xf1867c21abfb09b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d700c expref: 20 pid: 9592 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.756911:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985071488:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756927:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.756947:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985071872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756956:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944e00/0xf1867c21abfb0ad8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70ec expref: 13 pid: 9590 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746066809.756964:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985072000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756972:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfb0a29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d706e expref: 36 pid: 9590 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.756979:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985072128:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066809.756995:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757218:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757224:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757237:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757242:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757248:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757258:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b32000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066809.757260:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757265:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757274:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757279:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32000/0xf1867c21abfb0b17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.757328:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985334400:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11363us (11890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.757336:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20103 00010000:00010000:0.0:1746066809.757356:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757362:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757373:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757378:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757385:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757389:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066809.757392:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757397:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757405:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.757410:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb0b2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.757441:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985334528:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 10768us (11964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.757446:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20106 00010000:00010000:1.0:1746066809.757730:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757739:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757753:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757760:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757767:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757773:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066809.757776:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757783:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757793:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.757803:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abfb0b25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.757844:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985334272:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11388us (12378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.757850:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20105 00000100:00100000:0.0:1746066809.758432:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066809.759350:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759357:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759370:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759376:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759382:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759387:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066809.759390:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759397:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759407:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.759412:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfb0b33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.759445:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985334784:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12623us (13162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.759450:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20107 00000100:00100000:0.0:1746066809.764488:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:2013:x1830882985335296:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6558us (8807us total) trans 17179875305 rc 0/0 00000100:00100000:0.0:1746066809.764509:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2173 00002000:00100000:0.0:1746066809.764523:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2523135) req@ffff8800a59c4000 x1830882985335296/t17179875305(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:215/0 lens 488/448 e 0 to 0 dl 1746066820 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066809.764538:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4000 with x1830882985335296 ext(2097152->2523135) 00010000:00010000:0.0:1746066809.764547:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.764564:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746066809.764571:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a59c4000 00000100:00100000:0.0:1746066809.774018:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985336832 00000100:00100000:0.0:1746066809.774028:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985336832 00010000:00010000:0.0:1746066809.774065:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066809.774103:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9215 00000100:00100000:0.0:1746066809.774419:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+55:2016:x1830882985336832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.774437:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066809.774460:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.774473:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.774507:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfb0aa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2523135) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70d0 expref: 55 pid: 12233 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.774527:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.774530:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.774535:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.774544:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.774577:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.774619:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+54:2016:x1830882985336832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 204us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.774626:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9215 00010000:00010000:1.0:1746066809.774748:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774764:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774782:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774789:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774795:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774802:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009326da00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066809.774806:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774814:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774829:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.774835:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb0b1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.774932:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985334656:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 28763us (29478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.774941:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20104 00000100:00100000:0.0:1746066809.776433:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.779482:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.781124:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.781249:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.781273:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.781319:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.782008:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985337344 00000100:00100000:1.0:1746066809.782015:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985337344 00000100:00100000:1.0:1746066809.782026:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985337472 00000100:00100000:1.0:1746066809.782028:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985337472 00010000:00010000:1.0:1746066809.782048:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb0154 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a01 expref: 48 pid: 7244 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.782075:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985337600 00000100:00100000:1.0:1746066809.782077:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985337600 00010000:00010000:1.0:1746066809.782086:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 31 pid: 7244 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.782098:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985337728 00000100:00100000:1.0:1746066809.782100:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985337728 00010000:00010000:1.0:1746066809.782107:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 32 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.782120:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9218 00000100:00100000:1.0:1746066809.782124:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985337600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.782129:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.782133:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 32 pid: 7244 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782142:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 32 pid: 7244 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746066809.782185:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9219 00000100:00100000:0.0:1746066809.782192:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985337728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.782198:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066809.782202:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 32 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782389:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb015b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6a08 expref: 32 pid: 7244 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746066809.782428:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 31 pid: 7245 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782666:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.782670:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb0b3a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.782678:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066809.782763:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e82800/0xf1867c21abfb014d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d69fa expref: 31 pid: 7245 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.782814:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985337600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 690us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.782819:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9218 00010000:00010000:1.0:1746066809.782840:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb02b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6afd expref: 29 pid: 7244 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746066809.782853:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9220 00000100:00100000:1.0:1746066809.782857:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882985337344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.782863:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.782867:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb02b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6afd expref: 29 pid: 7244 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782874:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb02b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6afd expref: 29 pid: 7244 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782897:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb02b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d6afd expref: 29 pid: 7244 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746066809.782906:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066809.782909:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb0b3a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.782914:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb0b3a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.782920:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb0b3a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066809.782947:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066809.782989:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066809.782993:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.783014:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985337728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 822us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.783019:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9219 00000100:00100000:1.0:1746066809.783786:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985337344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.783792:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9220 00000001:00080000:1.0:1746066809.792380:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937653 is committed 00000004:00080000:1.0:1746066809.792394:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1145 committed 00000004:00080000:1.0:1746066809.792434:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1133 committed 00000004:00080000:1.0:1746066809.792451:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1132 committed 00000004:00080000:1.0:1746066809.792453:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1131 committed 00000004:00080000:1.0:1746066809.792454:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1130 committed 00000004:00080000:1.0:1746066809.792456:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1144 committed 00000004:00080000:1.0:1746066809.792457:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1129 committed 00000004:00080000:1.0:1746066809.792460:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1143 committed 00000004:00080000:1.0:1746066809.792461:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1128 committed 00000004:00080000:1.0:1746066809.792463:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1142 committed 00000004:00080000:1.0:1746066809.792464:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1141 committed 00000004:00080000:1.0:1746066809.792465:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1140 committed 00000004:00080000:1.0:1746066809.792467:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1127 committed 00000004:00080000:1.0:1746066809.792468:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1126 committed 00000004:00080000:1.0:1746066809.792470:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1139 committed 00000004:00080000:1.0:1746066809.792471:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1138 committed 00000004:00080000:1.0:1746066809.792472:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1125 committed 00000001:00080000:1.0:1746066809.792480:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937650 is committed 00000001:00080000:1.0:1746066809.792485:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937649 is committed 00000100:00100000:0.0:1746066809.793684:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.793705:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793718:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.793732:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793741:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.793755:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793765:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.793776:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793788:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746066809.793793:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.793805:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793816:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.793826:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793835:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.793845:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793854:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a59c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.793866:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.793896:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073024 00000100:00100000:0.0:1746066809.793899:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073024 00000100:00100000:0.0:1746066809.793917:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073536 00000100:00100000:0.0:1746066809.793919:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073536 00000100:00100000:0.0:1746066809.793927:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074048 00000100:00100000:0.0:1746066809.793928:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074048 00000100:00100000:0.0:1746066809.793940:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074560 00000100:00100000:0.0:1746066809.793942:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074560 00000100:00100000:0.0:1746066809.793947:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073152 00000100:00100000:0.0:1746066809.793949:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073152 00000100:00100000:0.0:1746066809.793955:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073664 00000100:00100000:0.0:1746066809.793956:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073664 00000100:00100000:0.0:1746066809.793962:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074176 00000100:00100000:0.0:1746066809.793963:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074176 00000100:00100000:0.0:1746066809.793968:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074688 00000100:00100000:0.0:1746066809.793969:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074688 00000100:00100000:0.0:1746066809.793976:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20111 00000100:00100000:0.0:1746066809.793980:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3774:x1830882985073024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.794044:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3774:x1830882985073024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (337us total) trans 17179875309 rc 0/0 00000100:00100000:0.0:1746066809.794049:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20111 00000100:00100000:0.0:1746066809.794057:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20112 00000100:00100000:0.0:1746066809.794061:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3774:x1830882985073536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066809.794093:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066809.794095:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066809.794097:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066809.794099:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066809.794101:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066809.794114:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3774:x1830882985073536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (381us total) trans 17179875310 rc 0/0 00000100:00100000:0.0:1746066809.794117:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20112 00000100:00100000:0.0:1746066809.794124:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20113 00000100:00100000:0.0:1746066809.794128:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3774:x1830882985074048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.794184:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882985074048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (428us total) trans 21474842666 rc 0/0 00000100:00100000:0.0:1746066809.794189:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20113 00000100:00100000:0.0:1746066809.794195:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073280 00000100:00100000:0.0:1746066809.794197:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073280 00000100:00100000:0.0:1746066809.794203:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985073792 00000100:00100000:0.0:1746066809.794204:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985073792 00000100:00100000:0.0:1746066809.794209:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20114 00000100:00100000:0.0:1746066809.794212:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3774:x1830882985074560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.794250:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882985074560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (473us total) trans 21474842667 rc 0/0 00000100:00100000:0.0:1746066809.794254:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20114 00000100:00100000:0.0:1746066809.794259:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074304 00000100:00100000:0.0:1746066809.794261:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074304 00000100:00100000:0.0:1746066809.794266:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074816 00000100:00100000:0.0:1746066809.794268:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074816 00000100:00100000:0.0:1746066809.794272:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985074432 00000100:00100000:0.0:1746066809.794273:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985074432 00000100:00100000:0.0:1746066809.794278:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20115 00000100:00100000:0.0:1746066809.794281:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882985073152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.794365:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882985073152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (558us total) trans 21474842668 rc 0/0 00000100:00100000:0.0:1746066809.794369:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20115 00000100:00100000:0.0:1746066809.794377:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20117 00000100:00100000:0.0:1746066809.794380:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882985074176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.794420:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882985074176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (573us total) trans 21474842669 rc 0/0 00000100:00100000:1.0:1746066809.794423:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20118 00000100:00100000:1.0:1746066809.794429:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882985074688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.794485:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3774:x1830882985074688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (619us total) trans 21474842670 rc 0/0 00000100:00100000:1.0:1746066809.794490:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20118 00000100:00100000:1.0:1746066809.794515:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20120 00000100:00100000:1.0:1746066809.794520:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985073792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.794571:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985073792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (389us total) trans 17179875313 rc 0/0 00000100:00100000:1.0:1746066809.794576:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20120 00000100:00100000:1.0:1746066809.794585:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20122 00000100:00100000:1.0:1746066809.794589:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882985074816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.794641:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882985074816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (411us total) trans 21474842672 rc 0/0 00000100:00100000:1.0:1746066809.794646:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20122 00000100:00100000:1.0:1746066809.794656:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20124 00000100:00100000:1.0:1746066809.794659:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3776:x1830882985074944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.794708:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985074944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (397us total) trans 17179875314 rc 0/0 00000100:00100000:1.0:1746066809.794713:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20124 00000100:00100000:0.0:1746066809.795060:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20117 00000004:00080000:0.0:1746066809.795094:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a59c5500/2, rc 0, transno 21474842668 00000100:00100000:0.0:1746066809.795097:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.795104:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54d500/2, rc 0, transno 17179875311 00000100:00100000:0.0:1746066809.795107:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.795112:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a59c5880/2, rc 0, transno 21474842669 00000100:00100000:0.0:1746066809.795114:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.795119:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a59c6680/2, rc 0, transno 21474842670 00000100:00100000:0.0:1746066809.795121:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.795127:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d24700/2, rc 0, transno 17179875309 00000100:00100000:0.0:1746066809.795129:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.795133:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54f480/2, rc 0, transno 17179875310 00000100:00100000:0.0:1746066809.795136:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985073536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.795140:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a59c6d80/2, rc 0, transno 21474842666 00000100:00100000:0.0:1746066809.795142:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.795148:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a59c5f80/2, rc 0, transno 21474842667 00000100:00100000:0.0:1746066809.795150:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a59c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985074560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.801008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.811471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.816029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.816066:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.816100:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066809.816111:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985338368 00000100:00100000:0.0:1746066809.816113:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985338368 00000100:00100000:0.0:1746066809.816212:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20125 00000100:00100000:0.0:1746066809.816219:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985338112:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066809.816238:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.816252:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7116 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066809.816270:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd7a, atime: 0x6812dd79, ctime: 0x6812dd7a, blocks: 0x800 00010000:00010000:0.0:1746066809.816283:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.816285:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.816290:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.816303:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.816312:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944e00, rc 0) 00000100:00100000:0.0:1746066809.816579:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985338112:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 352us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.816590:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20125 00000100:00100000:1.0:1746066809.816722:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.816759:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.816819:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066809.816874:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20129 00000100:00100000:1.0:1746066809.816879:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985338496:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066809.816901:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.816908:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d712b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066809.816918:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd7a, atime: 0x6812dd7a, ctime: 0x6812dd7a, blocks: 0x800 00010000:00010000:1.0:1746066809.816925:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.816926:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.816930:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.816937:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.816943:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d200, rc 0) 00000100:00100000:1.0:1746066809.816955:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985338496:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.816959:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20129 00010000:00010000:1.0:1746066810.645272:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066810.821307:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.822461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.822497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.822519:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.822531:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.822556:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985339008 00000100:00100000:0.0:1746066810.822563:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985339008 00000100:00100000:0.0:1746066810.822609:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985339520 00000100:00100000:0.0:1746066810.822611:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985339520 00000100:00100000:0.0:1746066810.822620:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985338880 00000100:00100000:0.0:1746066810.822622:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985338880 00000100:00100000:0.0:1746066810.822632:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985339136 00000100:00100000:0.0:1746066810.822634:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985339136 00000100:00100000:0.0:1746066810.822707:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20132 00000100:00100000:0.0:1746066810.822712:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985339520:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066810.822791:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985339520:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.822798:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20132 00000100:00100000:0.0:1746066810.822812:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20134 00000100:00100000:0.0:1746066810.822816:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985338880:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066810.822840:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985338880:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.822845:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20134 00000100:00100000:0.0:1746066810.822939:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.833972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.837439:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.838649:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.839323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.841175:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7540 00000100:00100000:1.0:1746066810.841188:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985340800:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066810.841228:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.841244:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.841246:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.841250:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.841263:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066810.841782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.841799:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985341568 00000100:00100000:0.0:1746066810.841803:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985341568 00000100:00100000:0.0:1746066810.841838:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7543 00000100:00100000:0.0:1746066810.841844:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985341568:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066810.841860:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb0b9c lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.841867:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066810.841868:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066810.841871:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb0b9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.841879:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb0b9c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066810.842076:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.842093:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985341952 00000100:00100000:1.0:1746066810.842096:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985341952 00000100:00100000:1.0:1746066810.843002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066810.852101:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852793:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852802:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852808:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2c800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066810.852813:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852822:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852843:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.852849:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb0b87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066810.852964:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985340800:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 11775us (15530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066810.852973:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7540 00000100:00100000:0.0:1746066810.879776:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.879909:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985342336 00000100:00100000:1.0:1746066810.879919:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985342336 00000100:00100000:1.0:1746066810.880012:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 936 00000100:00100000:1.0:1746066810.880021:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3259:x1830882985342336:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:1.0:1746066810.880367:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066810.880399:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfb0afb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d70fa expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.880427:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066810.880432:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066810.880487:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3259:x1830882985342336:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 468us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066810.880494:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 936 00000100:00100000:0.0:1746066810.882414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.884363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.898327:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.901410:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.902590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.904330:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.904370:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.904930:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.904956:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.904973:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.905003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.905021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.905057:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20143 00000100:00100000:0.0:1746066810.905065:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985344000:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066810.905076:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20145 00010000:00010000:0.0:1746066810.905080:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066810.905084:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985344640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066810.905092:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066810.905095:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d714e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.905101:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb0c13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d716a expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.905113:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066810.905114:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.905116:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066810.905116:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.905122:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb0c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d716a expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066810.905123:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d714e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.905132:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb0c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d716a expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066810.905136:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d714e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.905140:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb800, rc 0) 00010000:00010000:0.0:1746066810.905145:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6200, rc 0) 00000100:00100000:1.0:1746066810.905153:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985344640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066810.905157:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20145 00000100:00100000:1.0:1746066810.905169:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20147 00000100:00100000:1.0:1746066810.905174:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985344768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066810.905178:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066810.905178:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985344000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 115us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066810.905184:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb600/0xf1867c21abfb0c21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7171 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066810.905187:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20143 00010000:00010000:1.0:1746066810.905191:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.905192:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.905196:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb600/0xf1867c21abfb0c21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7171 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.905208:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb600/0xf1867c21abfb0c21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7171 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.905214:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb600, rc 0) 00000100:00100000:1.0:1746066810.905223:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985344768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.905225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.905228:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20147 00000100:00100000:0.0:1746066810.906767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.906829:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985345920 00000100:00100000:1.0:1746066810.906836:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985345920 00000100:00100000:1.0:1746066810.906903:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17190 00000100:00100000:1.0:1746066810.906911:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3268:x1830882985345920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066810.906924:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066810.906933:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb0c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71a9 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.906993:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.907003:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.907010:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066810.907906:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.907928:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.907951:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.907980:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.907997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.908013:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.908027:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985345280 00000100:00100000:0.0:1746066810.908034:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985345280 00000100:00100000:1.0:1746066810.908101:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20151 00000100:00100000:1.0:1746066810.908108:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985345024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066810.908115:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066810.908123:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d717f expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.908134:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.908136:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066810.908141:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d717f expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.908149:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d717f expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066810.908156:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb400, rc 0) 00000100:00100000:1.0:1746066810.908175:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985345024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066810.908788:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20151 00000100:00100000:0.0:1746066810.908835:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985346176 00000100:00100000:0.0:1746066810.908839:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985346176 00010000:00010000:0.0:1746066810.908854:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfb0bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7140 expref: 32 pid: 7245 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746066810.908901:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9223 00000100:00100000:0.0:1746066810.908907:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985346176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066810.908915:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066810.908919:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfb0bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7140 expref: 32 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.908929:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfb0bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7140 expref: 32 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.908949:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfb0bc6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7140 expref: 32 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.908975:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066810.908979:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb0bfe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066810.908987:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb0bfe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066810.908993:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb0bfe lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066810.909005:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066810.909010:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066810.909089:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066810.909120:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066810.909140:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985346176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 233us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.909146:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9223 00010000:00010000:1.0:1746066810.909315:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.909325:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066810.909336:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066810.909401:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb0c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a9 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.909421:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a9 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.909426:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066810.909428:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066810.909431:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbebc00, rc 0) 00000100:00100000:1.0:1746066810.909457:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3268:x1830882985345920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2547us (2693us total) trans 8589937661 rc 0/0 00000100:00100000:1.0:1746066810.909463:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17190 00000100:00100000:0.0:1746066810.919299:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.919344:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.919676:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985346432 00000100:00100000:1.0:1746066810.919686:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985346432 00000100:00100000:1.0:1746066810.919791:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985346560 00000100:00100000:1.0:1746066810.919794:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985346560 00000100:00100000:1.0:1746066810.919815:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17191 00000100:00100000:0.0:1746066810.919822:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17192 00000100:00100000:1.0:1746066810.919823:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3272:x1830882985346432:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066810.919830:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:3270:x1830882985346560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066810.919847:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066810.919847:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066810.919865:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71b0 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.919869:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb0c7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71b7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.919950:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb0c7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b7 expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.919963:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb0c7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b7 expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066810.919980:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066810.919983:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066810.919986:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6400, rc 0) 00000100:00100000:0.0:1746066810.920030:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:3270:x1830882985346560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 201us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.920036:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17192 00010000:00010000:1.0:1746066810.920130:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.920142:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.920153:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066810.920156:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066810.920158:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeae00, rc 0) 00000100:00100000:1.0:1746066810.920607:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3272:x1830882985346432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 784us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066810.920613:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17191 00000100:00100000:0.0:1746066810.929754:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.929858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.931501:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.931542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.931582:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985347328 00000100:00100000:0.0:1746066810.931587:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985347328 00002000:00100000:0.0:1746066810.931651:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009c774000 x1830882985347328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:216/0 lens 488/0 e 0 to 0 dl 1746066821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066810.931659:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774000 with x1830882985347328 ext(1048576->2097151) 00002000:00010000:0.0:1746066810.931663:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774000 00000100:00100000:0.0:1746066810.931686:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7547 00000100:00100000:0.0:1746066810.931693:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985347072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066810.932140:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7548 00000100:00100000:1.0:1746066810.932148:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985347584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066810.933106:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.933126:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985347840 00000100:00100000:1.0:1746066810.933131:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985347840 00002000:00100000:1.0:1746066810.933158:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095801180 x1830882985347840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:216/0 lens 488/0 e 0 to 0 dl 1746066821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066810.933167:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801180 with x1830882985347840 ext(0->1048575) 00002000:00010000:1.0:1746066810.933171:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801180 00000100:00100000:1.0:1746066810.933192:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7550 00000100:00100000:1.0:1746066810.933198:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985347840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066810.933662:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7552 00000100:00100000:0.0:1746066810.933672:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985348480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066810.934601:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985348608 00000100:00100000:0.0:1746066810.934607:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985348608 00002000:00100000:0.0:1746066810.934637:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880093c4d180 x1830882985348608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:216/0 lens 488/0 e 0 to 0 dl 1746066821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066810.936291:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d180 with x1830882985348608 ext(1048576->2097151) 00002000:00010000:0.0:1746066810.936299:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d180 00000100:00100000:0.0:1746066810.936427:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7553 00000100:00100000:0.0:1746066810.936441:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985348608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066810.945033:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985347584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12873us (13479us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066810.945045:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7548 00002000:00100000:1.0:1746066810.945056:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009c774a80 x1830882985347584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:216/0 lens 488/440 e 0 to 0 dl 1746066821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066810.945065:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774a80 with x1830882985347584 ext(1048576->2097151) 00002000:00010000:1.0:1746066810.945071:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774a80 00000100:00100000:1.0:1746066810.957081:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985347840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23870us (23965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066810.957094:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7550 00002000:00100000:1.0:1746066810.957107:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095801180 x1830882985347840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:216/0 lens 488/440 e 0 to 0 dl 1746066821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066810.957116:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801180 with x1830882985347840 ext(0->1048575) 00002000:00010000:1.0:1746066810.957122:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801180 00000100:00100000:0.0:1746066810.984699:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.984767:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.984797:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985348864 00000100:00100000:1.0:1746066810.984807:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985348864 00000100:00100000:0.0:1746066810.984838:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066810.984873:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17193 00000100:00100000:1.0:1746066810.984912:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:3267:x1830882985348864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066810.984938:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066810.984942:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066810.984972:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb0c7c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b7 expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985001:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066810.985005:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066810.985017:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfb0c83 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71be expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985064:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.985077:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985084:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985090:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.985118:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985302:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 12 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066810.985315:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985075456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066810.985397:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066810.985406:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 8 pid: 7245 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066810.985413:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985075584:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066810.985433:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066810.992531:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985075456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066810.992544:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985075584:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066810.992569:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066810.992600:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985349760 00000100:00100000:1.0:1746066810.992606:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985349760 00002000:00100000:1.0:1746066810.992651:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5b01180 x1830882985349760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:216/0 lens 488/0 e 0 to 0 dl 1746066821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066810.992660:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01180 with x1830882985349760 ext(2097152->4194303) 00002000:00010000:1.0:1746066810.992664:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b01180 00000100:00100000:1.0:1746066810.992691:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985349888 00000100:00100000:1.0:1746066810.992694:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985349888 00002000:00100000:1.0:1746066810.992708:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b00380 x1830882985349888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:216/0 lens 488/0 e 0 to 0 dl 1746066821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066810.992721:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00380 with x1830882985349888 ext(2097152->4194303) 00002000:00010000:1.0:1746066810.992724:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b00380 00000100:00100000:1.0:1746066810.992853:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7557 00000100:00100000:1.0:1746066810.992861:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985349888:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066810.994103:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066810.994323:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985350016 00000100:00100000:0.0:1746066810.994329:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985350016 00000100:00100000:1.0:1746066810.994355:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066810.994360:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 9 pid: 7245 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746066810.994385:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985350144 00000100:00100000:0.0:1746066810.994387:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985350144 00010000:00010000:0.0:1746066810.994398:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066810.994399:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9224 00000100:00100000:1.0:1746066810.994406:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985350016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066810.994418:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9225 00010000:00010000:1.0:1746066810.994419:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066810.994423:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985350144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066810.994426:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 9 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.994431:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066810.994435:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066810.994451:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 9 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.994461:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066810.994496:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb0b41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7108 expref: 9 pid: 7245 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.994501:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb0c75 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71b0 expref: 13 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066810.994518:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066810.994524:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066810.994533:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066810.994541:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.994552:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066810.994555:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066810.994564:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066810.994580:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985350016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 174us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066810.994584:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985350144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 160us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066810.994586:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9224 00000100:00100000:0.0:1746066810.994591:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9225 00010000:00010000:1.0:1746066810.994606:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066810.994613:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000040:00080000:1.0:1746066810.994880:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1157, 88 off109400 00000004:00080000:1.0:1746066810.994908:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206023589ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.994938:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1171, 88 off110544 00000004:00080000:1.0:1746066810.994947:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206063668ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995122:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1172, 88 off110632 00000004:00080000:1.0:1746066810.995126:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206242466ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995137:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1158, 88 off109488 00000004:00080000:1.0:1746066810.995140:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206256563ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995163:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1159, 88 off109576 00000004:00080000:1.0:1746066810.995166:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206283086ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995174:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1173, 88 off110720 00000004:00080000:1.0:1746066810.995176:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206292993ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995182:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1174, 88 off110808 00000004:00080000:1.0:1746066810.995185:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206301885ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995191:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1175, 88 off110896 00000004:00080000:1.0:1746066810.995194:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206310730ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995200:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1160, 88 off109664 00000004:00080000:1.0:1746066810.995202:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206319118ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995209:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1176, 88 off110984 00000004:00080000:1.0:1746066810.995211:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206328266ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995218:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1161, 88 off109752 00000004:00080000:1.0:1746066810.995219:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206336248ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995226:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1177, 88 off111072 00000004:00080000:1.0:1746066810.995228:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206344851ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066810.995234:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1162, 88 off109840 00000004:00080000:1.0:1746066810.995237:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206353613ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995245:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1163, 88 off109928 00000004:00080000:1.0:1746066810.995247:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206363873ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995253:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1164, 88 off110016 00000004:00080000:1.0:1746066810.995256:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206372686ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995262:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1165, 88 off110104 00000004:00080000:1.0:1746066810.995265:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779206381299ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066810.995272:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1178, 88 off111160 00000004:00080000:1.0:1746066810.995274:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779206390525ns, next at 733263917711ns, rc = 0 00000001:00080000:1.0:1746066811.001535:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937662 is committed 00000004:00080000:1.0:1746066811.001543:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1153 committed 00000004:00080000:1.0:1746066811.001559:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1142 committed 00000004:00080000:1.0:1746066811.001575:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1141 committed 00000004:00080000:1.0:1746066811.001576:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1140 committed 00000004:00080000:1.0:1746066811.001578:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1139 committed 00000004:00080000:1.0:1746066811.001579:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1152 committed 00000004:00080000:1.0:1746066811.001581:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1138 committed 00000004:00080000:1.0:1746066811.001582:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1151 committed 00000004:00080000:1.0:1746066811.001583:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1137 committed 00000004:00080000:1.0:1746066811.001585:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1150 committed 00000004:00080000:1.0:1746066811.001586:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1149 committed 00000004:00080000:1.0:1746066811.001588:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1148 committed 00000004:00080000:1.0:1746066811.001589:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1136 committed 00000004:00080000:1.0:1746066811.001591:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1135 committed 00000004:00080000:1.0:1746066811.001593:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1147 committed 00000004:00080000:1.0:1746066811.001594:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1146 committed 00000004:00080000:1.0:1746066811.001596:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1134 committed 00000001:00080000:1.0:1746066811.001601:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937661 is committed 00000001:00080000:1.0:1746066811.001615:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937655 is committed 00010000:00010000:1.0:1746066811.001684:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.001697:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.001700:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066811.001714:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfb0c83 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 30 pid: 17253 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066811.001730:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.001759:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.001761:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066811.001764:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0e00, rc 0) 00000100:00100000:0.0:1746066811.001798:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985075712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.001805:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:3267:x1830882985348864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 16925us (17121us total) trans 8589937662 rc 0/0 00000100:00100000:1.0:1746066811.001813:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17193 00000100:00100000:0.0:1746066811.001832:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.001838:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985075840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.001852:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.001865:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985075968 00000100:00100000:1.0:1746066811.001872:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985075968 00000100:00100000:0.0:1746066811.001878:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.001916:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985076480 00000100:00100000:0.0:1746066811.001919:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985076480 00000100:00100000:1.0:1746066811.001927:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985076224 00000100:00100000:1.0:1746066811.001928:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985076224 00000100:00100000:0.0:1746066811.001946:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985076096 00000100:00100000:0.0:1746066811.001948:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985076096 00000100:00100000:1.0:1746066811.001952:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20156 00000100:00100000:1.0:1746066811.001957:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3774:x1830882985075712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.001960:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20157 00000100:00100000:0.0:1746066811.001964:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882985076480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.002077:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882985076480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (225us total) trans 17179875315 rc 0/0 00000100:00100000:0.0:1746066811.002083:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20157 00000100:00100000:0.0:1746066811.002094:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20160 00002000:00010000:1.0:1746066811.002097:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746066811.002098:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882985076608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066811.002100:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066810 -> 1746066810 00002000:00010000:1.0:1746066811.002102:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066809 -> 1746066809 00002000:00010000:1.0:1746066811.002104:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066810 -> 1746066810 00002000:00010000:1.0:1746066811.002107:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066811.002130:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985075712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (298us total) trans 17179875317 rc 0/0 00000100:00100000:1.0:1746066811.002135:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20156 00002000:00010000:0.0:1746066811.002142:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:0.0:1746066811.002144:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066811.002146:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066811.002148:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066811.002150:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066811.002156:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.002167:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985076608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (182us total) trans 17179875319 rc 0/0 00000100:00100000:1.0:1746066811.002171:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985076352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.002173:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20160 00000100:00100000:1.0:1746066811.002184:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.002189:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985076352 00000100:00100000:0.0:1746066811.002191:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985076352 00000100:00100000:0.0:1746066811.002201:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20162 00000100:00100000:0.0:1746066811.002205:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985076352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.002246:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875314 gen 2 00000004:00080000:1.0:1746066811.002250:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d26680, transno 17179875225 00000004:00080000:1.0:1746066811.002256:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03480, transno 17179875232 00000004:00080000:1.0:1746066811.002259:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c00a80, transno 17179875233 00000100:00100000:0.0:1746066811.002261:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3775:x1830882985076352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (76us total) trans 17179875322 rc 0/0 00000004:00080000:1.0:1746066811.002262:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c02a00, transno 17179875234 00000004:00080000:1.0:1746066811.002264:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03100, transno 17179875235 00000004:00080000:1.0:1746066811.002266:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c01880, transno 17179875236 00000100:00100000:0.0:1746066811.002267:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20162 00000004:00080000:1.0:1746066811.002269:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c01500, transno 17179875237 00000004:00080000:1.0:1746066811.002271:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c02680, transno 17179875238 00000004:00080000:1.0:1746066811.002273:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03b80, transno 17179875239 00000004:00080000:1.0:1746066811.002276:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5826300, transno 17179875240 00000004:00080000:1.0:1746066811.002278:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760e00, transno 17179875244 00000004:00080000:1.0:1746066811.002281:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f763100, transno 17179875245 00000004:00080000:1.0:1746066811.002283:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f761880, transno 17179875246 00000004:00080000:1.0:1746066811.002285:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760000, transno 17179875247 00000004:00080000:1.0:1746066811.002287:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760700, transno 17179875248 00000004:00080000:1.0:1746066811.002289:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762d80, transno 17179875249 00000004:00080000:1.0:1746066811.002291:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd4a80, transno 17179875250 00000004:00080000:1.0:1746066811.002294:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f763b80, transno 17179875251 00000004:00080000:1.0:1746066811.002296:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762680, transno 17179875252 00000004:00080000:1.0:1746066811.002298:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213100, transno 17179875253 00000004:00080000:1.0:1746066811.002301:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e212d80, transno 17179875254 00000004:00080000:1.0:1746066811.002304:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213b80, transno 17179875255 00000004:00080000:1.0:1746066811.002307:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211c00, transno 17179875256 00000004:00080000:1.0:1746066811.002309:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e212300, transno 17179875257 00000004:00080000:1.0:1746066811.002311:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e210000, transno 17179875258 00000004:00080000:1.0:1746066811.002313:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211880, transno 17179875259 00000004:00080000:1.0:1746066811.002316:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e213480, transno 17179875260 00000004:00080000:1.0:1746066811.002318:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422d80, transno 17179875261 00000004:00080000:1.0:1746066811.002320:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54e00, transno 17179875263 00000004:00080000:1.0:1746066811.002322:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54000, transno 17179875264 00000004:00080000:1.0:1746066811.002324:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f55180, transno 17179875265 00000004:00080000:1.0:1746066811.002326:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f57800, transno 17179875266 00000004:00080000:1.0:1746066811.002328:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8b100, transno 17179875267 00000004:00080000:1.0:1746066811.002330:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f55500, transno 17179875268 00000004:00080000:1.0:1746066811.002333:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54a80, transno 17179875269 00000004:00080000:1.0:1746066811.002335:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f57100, transno 17179875270 00000004:00080000:1.0:1746066811.002337:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e2300, transno 17179875271 00000004:00080000:1.0:1746066811.002339:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54380, transno 17179875272 00000004:00080000:1.0:1746066811.002342:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7ed80, transno 17179875273 00000004:00080000:1.0:1746066811.002344:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7c700, transno 17179875274 00000004:00080000:1.0:1746066811.002347:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f56300, transno 17179875275 00000004:00080000:1.0:1746066811.002349:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7dc00, transno 17179875276 00000004:00080000:1.0:1746066811.002352:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f56d80, transno 17179875277 00000004:00080000:1.0:1746066811.002354:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f55c00, transno 17179875278 00000004:00080000:1.0:1746066811.002356:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098927800, transno 17179875279 00000004:00080000:1.0:1746066811.002359:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7c000, transno 17179875280 00000004:00080000:1.0:1746066811.002360:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d24a80, transno 17179875306 00000004:00080000:1.0:1746066811.002363:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54d880, transno 17179875307 00000004:00080000:1.0:1746066811.002365:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800380, transno 17179875308 00000004:00080000:1.0:1746066811.002367:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d24700, transno 17179875309 00000004:00080000:1.0:1746066811.002369:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54f480, transno 17179875310 00000004:00080000:1.0:1746066811.002371:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54d500, transno 17179875311 00000004:00080000:1.0:1746066811.002374:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54e300, transno 17179875312 00000004:00080000:1.0:1746066811.002376:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307b80, transno 17179875313 00000004:00080000:1.0:1746066811.002379:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801180, transno 17179875314 00000100:00100000:1.0:1746066811.002385:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a5b02a00 x1830882985075712/t17179875317(17179875317) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066827 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746066811.002394:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b02a00/2, rc 0, transno 17179875317 00000100:00100000:1.0:1746066811.002398:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985075712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066811.002411:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b02d80/2, rc 0, transno 17179875320 00000100:00100000:1.0:1746066811.002415:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.002424:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.002442:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.002467:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985077248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.002485:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077504 00000100:00100000:0.0:1746066811.002488:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077504 00000100:00100000:1.0:1746066811.002492:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.002501:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077248 00000100:00100000:1.0:1746066811.002503:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066811.002503:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077248 00000100:00100000:1.0:1746066811.002507:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.002516:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20164 00000100:00100000:1.0:1746066811.002520:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.002521:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985077504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.002529:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985077376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.002540:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.002559:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20165 00000100:00100000:1.0:1746066811.002564:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882985076736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.002589:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985077504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (210us total) trans 21474842674 rc 0/0 00000100:00100000:0.0:1746066811.002594:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20164 00000100:00100000:0.0:1746066811.002603:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20168 00000100:00100000:0.0:1746066811.002607:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882985077376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066811.002613:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066811.002615:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066810 -> 1746066810 00002000:00010000:1.0:1746066811.002617:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066810 -> 1746066810 00002000:00010000:1.0:1746066811.002619:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066810 -> 1746066810 00002000:00010000:1.0:1746066811.002621:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066811.002640:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3774:x1830882985076736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (198us total) trans 21474842676 rc 0/0 00000100:00100000:1.0:1746066811.002645:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20165 00000100:00100000:0.0:1746066811.002663:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3774:x1830882985077376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (122us total) trans 21474842679 rc 0/0 00000004:00080000:1.0:1746066811.002665:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00000/2, rc 0, transno 17179875321 00000100:00100000:0.0:1746066811.002668:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20168 00000100:00100000:1.0:1746066811.002669:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985075840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066811.002674:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01880/2, rc 0, transno 17179875322 00000100:00100000:1.0:1746066811.002677:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985076352:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066811.002690:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066811.002692:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066810 -> 1746066810 00002000:00010000:0.0:1746066811.002694:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066810 -> 1746066810 00002000:00010000:0.0:1746066811.002695:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066810 -> 1746066810 00002000:00010000:0.0:1746066811.002698:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066811.002788:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3776:x1830882985076992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (434us total) trans 21474842675 rc 0/0 00000100:00100000:0.0:1746066811.002794:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20163 00000004:00080000:1.0:1746066811.002947:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 55 done 00000100:00100000:0.0:1746066811.002962:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077120 00000100:00100000:0.0:1746066811.002965:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077120 00000100:00100000:1.0:1746066811.002967:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066811.002973:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985077760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.002978:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077632 00000100:00100000:0.0:1746066811.002980:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077632 00000100:00100000:1.0:1746066811.002990:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.002991:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20169 00000100:00100000:0.0:1746066811.002995:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985077120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.003004:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985077760 00000100:00100000:1.0:1746066811.003006:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985077760 00000100:00100000:1.0:1746066811.003019:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20170 00000100:00100000:1.0:1746066811.003023:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985077632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.003026:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20171 00000100:00100000:0.0:1746066811.003204:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882985077760:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066811.003217:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbf100/2, rc 0, transno 21474842677 00000100:00100000:1.0:1746066811.003221:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066811.003227:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1f4e00/2, rc 0, transno 21474842679 00000100:00100000:1.0:1746066811.003229:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985077376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066811.003234:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5f80/2, rc 0, transno 21474842676 00000100:00100000:1.0:1746066811.003236:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985076736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066811.003243:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1f4000/2, rc 0, transno 21474842678 00000100:00100000:1.0:1746066811.003245:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985077248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.003403:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985077760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (412us total) trans 17179875323 rc 0/0 00000100:00100000:0.0:1746066811.003409:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20171 00000004:00080000:1.0:1746066811.003516:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5826300/2, rc 0, transno 17179875323 00000100:00100000:1.0:1746066811.003520:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985077760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.003579:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882985077632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 555us (649us total) trans 21474842680 rc 0/0 00000100:00100000:1.0:1746066811.003584:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20170 00000100:00100000:1.0:1746066811.003630:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882985077120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 635us (762us total) trans 21474842681 rc 0/0 00000100:00100000:1.0:1746066811.003635:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20169 00000100:00100000:1.0:1746066811.011940:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985350272 00000100:00100000:1.0:1746066811.011949:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985350272 00000100:00100000:1.0:1746066811.012000:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17194 00000100:00100000:1.0:1746066811.012008:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3272:x1830882985350272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.012027:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.012045:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71c5 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.012105:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.012119:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.012136:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.012139:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066811.012142:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:1.0:1746066811.012157:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3272:x1830882985350272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 151us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.012162:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17194 00000100:00080000:1.0:1746066811.012194:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066811.015578:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985349888:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 22706us (23231us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066811.015590:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7557 00002000:00100000:1.0:1746066811.015603:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b00380 x1830882985349888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:216/0 lens 488/440 e 0 to 0 dl 1746066821 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.015613:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00380 with x1830882985349888 ext(2097152->4194303) 00002000:00010000:1.0:1746066811.015619:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b00380 00000100:00100000:0.0:1746066811.033752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.033875:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985350400 00000100:00100000:1.0:1746066811.033909:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985350400 00000100:00100000:1.0:1746066811.033992:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20172 00000100:00100000:1.0:1746066811.034000:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+19:3267:x1830882985350400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066811.034020:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.034269:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71cc expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.034303:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfb0b79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7139 expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.034312:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb0c52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a2 expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.034319:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.034325:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.034328:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.034332:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.034717:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.034731:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.034745:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985077888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.035174:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb0c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a2 expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.035182:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb0c52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a2 expref: 7 pid: 9592 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.035190:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985078016:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.035233:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfb0b79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7139 expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.035241:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfb0b79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7139 expref: 7 pid: 1893 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.035249:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985078144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.035265:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066811.036695:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985077888:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.037336:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985078016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.037966:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.038843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.039414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.039548:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20173 00000100:00100000:1.0:1746066811.039555:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:3272:x1830882985350656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.039570:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.039582:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71d3 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.039597:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.039599:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.039606:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 8 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.039620:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 8 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.039629:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4c00, rc 0) 00000100:00100000:1.0:1746066811.039650:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3272:x1830882985350656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.039655:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20173 00000100:00100000:0.0:1746066811.039806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066811.040179:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfb0b79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7139 expref: 8 pid: 1893 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.040277:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985078144:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.040305:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.040330:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00000100:00100000:1.0:1746066811.040351:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+20:3267:x1830882985350400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6352us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.040357:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20172 00000100:00100000:0.0:1746066811.041089:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.041115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.041151:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.041355:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985351424 00000100:00100000:1.0:1746066811.041358:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985351424 00002000:00100000:1.0:1746066811.041382:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800a5d7c700 x1830882985351424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.041391:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882985351424 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.041395:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:1.0:1746066811.041405:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985351296 00000100:00100000:1.0:1746066811.041407:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985351296 00002000:00100000:1.0:1746066811.041415:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7dc00 x1830882985351296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.041420:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830882985351296 ext(2097152->4194303) 00010000:00010000:1.0:1746066811.041425:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.041433:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 879 lvb_type: 1 00002000:00010000:1.0:1746066811.041438:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:1.0:1746066811.041448:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2174 00000100:00100000:1.0:1746066811.041453:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985351296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.041734:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7558 00000100:00100000:0.0:1746066811.041740:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985351424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066811.044137:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.044168:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.044935:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985351808 00000100:00100000:0.0:1746066811.044942:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985351808 00010000:00010000:0.0:1746066811.044969:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7400/0xf1867c21abfb0c44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7194 expref: 10 pid: 13726 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746066811.044991:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985351680 00000100:00100000:0.0:1746066811.044993:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985351680 00010000:00010000:0.0:1746066811.045003:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 10 pid: 3528 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746066811.045024:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9230 00000100:00100000:0.0:1746066811.045030:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985351680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066811.045037:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066811.045045:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 10 pid: 3528 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.045166:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 10 pid: 3528 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.045188:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfb0b72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d712b expref: 10 pid: 3528 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.045209:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066811.045228:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985351680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 199us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.045234:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9230 00000100:00100000:0.0:1746066811.047976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.048017:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.048080:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985352192 00000100:00100000:1.0:1746066811.048089:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985352192 00002000:00100000:1.0:1746066811.048293:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800a4d26680 x1830882985352192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.048302:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26680 with x1830882985352192 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.048305:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d26680 00000100:00100000:1.0:1746066811.048325:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7559 00000100:00100000:1.0:1746066811.048333:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985352320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066811.049480:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985351424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7407us (8059us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066811.049489:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7558 00002000:00100000:0.0:1746066811.049496:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800a5d7c700 x1830882985351424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.049537:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882985351424 ext(3145728->4194303) 00002000:00010000:0.0:1746066811.049643:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:0.0:1746066811.051248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.058096:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985351296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16631us (16968us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066811.058107:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2174 00002000:00100000:1.0:1746066811.058119:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7dc00 x1830882985351296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.058129:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830882985351296 ext(2097152->4194303) 00010000:00010000:1.0:1746066811.058139:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.058153:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb0c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7178 expref: 20 pid: 13726 timeout: 879 lvb_type: 1 00002000:00010000:1.0:1746066811.058159:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:1.0:1746066811.062821:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985352320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14477us (14791us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066811.062834:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7559 00002000:00100000:1.0:1746066811.062847:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800a4d24a80 x1830882985352320/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.062857:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24a80 with x1830882985352320 ext(2097152->3145727) 00002000:00010000:1.0:1746066811.062864:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d24a80 00000100:00100000:0.0:1746066811.067004:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.068397:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.068717:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.068865:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985353088 00000100:00100000:0.0:1746066811.068868:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985353088 00002000:00100000:0.0:1746066811.068924:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1957888->1961983) req@ffff88011f761880 x1830882985353088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.068934:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761880 with x1830882985353088 ext(1957888->1961983) 00002000:00010000:0.0:1746066811.068938:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f761880 00000100:00100000:0.0:1746066811.068953:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7562 00000100:00100000:0.0:1746066811.068959:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985353088:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066811.069359:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985353088:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 398us (640us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066811.069366:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7562 00002000:00100000:0.0:1746066811.069372:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1957888->1961983) req@ffff88011f761880 x1830882985353088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/4536 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.069380:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761880 with x1830882985353088 ext(1957888->1961983) 00002000:00010000:0.0:1746066811.069383:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f761880 00000100:00100000:0.0:1746066811.071988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.072037:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.072055:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985353472 00000100:00100000:1.0:1746066811.072061:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985353472 00000100:00100000:1.0:1746066811.072101:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20176 00000100:00100000:1.0:1746066811.072107:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3272:x1830882985353472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.072120:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.072135:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71e8 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.072155:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066811.072160:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e8 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.072169:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e8 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.072178:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4000, rc 0) 00000100:00100000:1.0:1746066811.072197:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3272:x1830882985353472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.072202:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20176 00000100:00100000:0.0:1746066811.077416:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.077525:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.080422:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.082810:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.082873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.083871:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9234 00000100:00100000:0.0:1746066811.083880:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985354240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066811.083906:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066811.083919:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb0c60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d719b expref: 8 pid: 9592 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.083928:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb0c60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d719b expref: 8 pid: 9592 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.083944:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb0c60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d719b expref: 8 pid: 9592 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746066811.083964:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066811.083966:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066811.083972:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066811.083979:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066811.084005:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066811.084017:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985079424:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066811.084066:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.086138:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.086235:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985354368 00000100:00100000:1.0:1746066811.086242:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985354368 00010000:00010000:1.0:1746066811.086268:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3813376->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 22 pid: 3528 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.086292:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9235 00000100:00100000:1.0:1746066811.086297:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985354368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.086308:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066811.086321:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066810 -> 1746066812 00002000:00010000:1.0:1746066811.086323:0:7232:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066810 -> 1746066812 00010000:00010000:1.0:1746066811.086327:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3813376->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 22 pid: 3528 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.086337:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3813376->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 22 pid: 3528 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.086355:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfb0c98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3813376->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71cc expref: 22 pid: 3528 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.086381:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.086383:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.086389:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.086396:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.086403:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.086405:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.086408:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e8 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.086413:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e8 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.086438:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb0cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e8 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.086449:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985079552:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066811.086526:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.086535:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985079680:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066811.086552:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.088941:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.088963:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985079552:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066811.088973:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985079680:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066811.088992:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.089029:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985354368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2731us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.089039:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9235 00000100:00100000:0.0:1746066811.089466:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.089519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.089586:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7564 00000100:00100000:1.0:1746066811.089593:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985355008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066811.096327:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985355008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6729us (6854us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066811.096337:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7564 00002000:00100000:1.0:1746066811.096344:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88006e213b80 x1830882985355008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.096352:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213b80 with x1830882985355008 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.096356:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e213b80 00000100:00100000:0.0:1746066811.099940:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.099992:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.100143:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20179 00000100:00100000:1.0:1746066811.100151:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985355392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.100168:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.100185:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfb0cc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d71fd expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.100239:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985079808:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066811.100313:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00002000:00010000:1.0:1746066811.101422:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066810 -> 1746066812 00002000:00010000:1.0:1746066811.101426:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066810 -> 1746066812 00002000:00010000:1.0:1746066811.101429:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066810 -> 1746066812 00000100:00100000:1.0:1746066811.101445:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985079808:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066811.101483:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfb0cc2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71fd expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.101494:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfb0cc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71fd expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.101523:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4e00, rc 0) 00000100:00100000:1.0:1746066811.101561:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985355392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1411us (1569us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066811.101568:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20179 00000100:00100000:0.0:1746066811.103408:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.103466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.103598:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985355776 00000100:00100000:1.0:1746066811.103606:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985355776 00002000:00100000:1.0:1746066811.103645:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4460544->4861951) req@ffff88006e213480 x1830882985355776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.103654:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213480 with x1830882985355776 ext(4460544->4861951) 00002000:00010000:1.0:1746066811.103659:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e213480 00000100:00100000:1.0:1746066811.103687:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7566 00000100:00100000:1.0:1746066811.103692:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985355776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066811.108483:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882985355776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4765us (4991us total) trans 0 rc 401408/401408 00000100:00100000:1.0:1746066811.108495:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7566 00002000:00100000:1.0:1746066811.108506:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4460544->4861951) req@ffff88006e213480 x1830882985355776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.108515:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213480 with x1830882985355776 ext(4460544->4861951) 00010000:00010000:1.0:1746066811.108524:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.108538:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00002000:00010000:1.0:1746066811.108545:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88006e213480 00000100:00100000:0.0:1746066811.111283:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.111330:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.114389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.114439:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985356288 00000100:00100000:1.0:1746066811.114446:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985356288 00010000:00010000:1.0:1746066811.114481:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.114514:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9236 00000100:00100000:1.0:1746066811.114521:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985356288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.114533:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.114543:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.114554:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.114573:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb0cbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71ef expref: 28 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.114598:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.114600:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.114607:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.114614:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.114956:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.114968:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985080448:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066811.115776:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.116044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.116277:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985080448:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066811.116294:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.116340:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985356288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1819us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.116348:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9236 00000100:00100000:0.0:1746066811.117570:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.118975:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.126163:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.226321:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.226379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.226409:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.226439:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.226501:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985357312 00000100:00100000:0.0:1746066811.226510:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985357312 00000100:00100000:1.0:1746066811.226578:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985357440 00000100:00100000:1.0:1746066811.226590:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985357440 00000100:00100000:1.0:1746066811.227146:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985357568 00000100:00100000:1.0:1746066811.227149:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985357568 00000100:00100000:1.0:1746066811.227233:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1000 00000100:00100000:0.0:1746066811.227274:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1001 00000100:00100000:1.0:1746066811.227275:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985357440:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066811.227283:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882985357312:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1746066811.227309:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985357440:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 70us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.227315:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1000 00000100:00100000:1.0:1746066811.227328:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1002 00000100:00100000:1.0:1746066811.227333:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+5:2015:x1830882985357568:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066811.227333:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882985357312:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 52us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.227339:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1001 00000100:00100000:1.0:1746066811.227355:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+5:2015:x1830882985357568:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 22us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.227360:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1002 00000100:00100000:0.0:1746066811.287378:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.290323:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.317460:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066811.317797:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066811.320112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.341157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.345929:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.348200:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.352648:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.352722:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.353797:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985359744 00000100:00100000:1.0:1746066811.353801:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985359744 00000100:00100000:1.0:1746066811.353828:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 937 00000100:00100000:1.0:1746066811.353833:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985359744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.353844:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.353856:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb0d55 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d723c expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.353868:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.353871:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.355535:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985359744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1700us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.355542:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 937 00000100:00100000:0.0:1746066811.357594:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985358848:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11417us (11711us total) trans 17179875325 rc 0/0 00000100:00100000:0.0:1746066811.357604:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2178 00002000:00100000:0.0:1746066811.357616:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1073152->1961983) req@ffff88009666d880 x1830882985358848/t17179875325(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/448 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.357625:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d880 with x1830882985358848 ext(1073152->1961983) 00010000:00010000:0.0:1746066811.357635:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfb0ca6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71da expref: 10 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.357649:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfb0ca6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71da expref: 10 pid: 13363 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746066811.357656:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009666d880 00000100:00100000:0.0:1746066811.359077:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.360599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.361107:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985360128 00000100:00100000:1.0:1746066811.361112:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985360128 00000100:00100000:1.0:1746066811.361142:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 938 00000100:00100000:1.0:1746066811.361147:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985360128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.361156:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.361177:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d78 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7243 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.361194:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.361197:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.361654:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985360128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 505us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.361659:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 938 00000100:00100000:0.0:1746066811.362120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.362179:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.362402:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985360512 00000100:00100000:1.0:1746066811.362405:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985360512 00010000:00010000:1.0:1746066811.362417:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfb0ca6 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71da expref: 12 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.362439:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9237 00000100:00100000:1.0:1746066811.362444:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985360512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.362452:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.362480:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfb0ca6 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71da expref: 12 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.362490:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfb0ca6 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71da expref: 12 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.362505:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.362507:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.362513:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb0d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7235 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.362519:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb0d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7235 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.362538:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb0d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7235 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.362545:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985081088:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066811.362576:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066811.364154:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985081088:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066811.364169:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.364202:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985360512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1757us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.364210:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9237 00000100:00100000:0.0:1746066811.368518:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985360768 00000100:00100000:0.0:1746066811.368526:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985360768 00002000:00100000:0.0:1746066811.368570:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1806336->1810431) req@ffff8801310f2d80 x1830882985360768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.368580:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2d80 with x1830882985360768 ext(1806336->1810431) 00002000:00010000:0.0:1746066811.368585:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f2d80 00000100:00100000:0.0:1746066811.368612:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7569 00000100:00100000:0.0:1746066811.368618:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985360768:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066811.368754:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985360768:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 135us (354us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066811.368760:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7569 00002000:00100000:0.0:1746066811.368765:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1806336->1810431) req@ffff8801310f2d80 x1830882985360768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/4536 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.368772:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2d80 with x1830882985360768 ext(1806336->1810431) 00002000:00010000:0.0:1746066811.368774:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f2d80 00000100:00100000:0.0:1746066811.374155:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.374194:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.374238:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.374697:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7571 00000100:00100000:1.0:1746066811.374717:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985361280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.379216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.379710:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.379787:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985361792 00000100:00100000:1.0:1746066811.379797:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985361792 00002000:00100000:1.0:1746066811.379848:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1806335) req@ffff88009586bb80 x1830882985361792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.379859:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985361792 ext(1048576->1806335) 00002000:00010000:1.0:1746066811.379865:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009586bb80 00000100:00100000:1.0:1746066811.380983:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7573 00000100:00100000:1.0:1746066811.380993:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985361792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.383337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.383638:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985361280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8927us (9440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066811.383649:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7571 00002000:00100000:1.0:1746066811.383662:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009586b480 x1830882985361280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.383671:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586b480 with x1830882985361280 ext(1048576->2097151) 00002000:00010000:1.0:1746066811.383680:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586b480 00000100:00100000:1.0:1746066811.383705:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985362304 00000100:00100000:1.0:1746066811.383711:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985362304 00002000:00100000:1.0:1746066811.384064:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095868a80 x1830882985362304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.384072:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868a80 with x1830882985362304 ext(0->1048575) 00002000:00010000:1.0:1746066811.384076:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095868a80 00000100:00100000:1.0:1746066811.384090:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7574 00000100:00100000:1.0:1746066811.384097:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985362304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.385237:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.385951:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.392449:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985362816 00000100:00100000:1.0:1746066811.392456:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985362816 00010000:00010000:1.0:1746066811.392492:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb0ce5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7219 expref: 34 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.392523:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985362944 00000100:00100000:1.0:1746066811.392526:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985362944 00010000:00010000:1.0:1746066811.392537:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 11 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.392550:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9238 00000100:00100000:1.0:1746066811.392556:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985362816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.392568:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.392588:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb0ce5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7219 expref: 34 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392598:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb0ce5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7219 expref: 34 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392619:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb0ce5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7219 expref: 34 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392635:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.392654:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985362816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.392660:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9238 00000100:00100000:1.0:1746066811.392669:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9239 00000100:00100000:1.0:1746066811.392674:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985362944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.392679:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.392686:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 11 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392694:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 11 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392705:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4000/0xf1867c21abfb0cd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7204 expref: 11 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.392713:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.392715:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.392722:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.392730:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.392757:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.392769:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985081472:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066811.392814:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.399335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.399634:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985361792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18640us (20427us total) trans 0 rc 757760/757760 00000100:00100000:1.0:1746066811.399643:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7573 00002000:00100000:1.0:1746066811.399654:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1806335) req@ffff88009586bb80 x1830882985361792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.399662:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985361792 ext(1048576->1806335) 00002000:00010000:1.0:1746066811.399667:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009586bb80 00000100:00100000:1.0:1746066811.399681:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985363200 00000100:00100000:1.0:1746066811.399686:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985363200 00002000:00100000:1.0:1746066811.399713:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2199552->2203647) req@ffff880095868380 x1830882985363200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.399720:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868380 with x1830882985363200 ext(2199552->2203647) 00002000:00010000:1.0:1746066811.399723:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095868380 00000100:00100000:1.0:1746066811.399749:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7577 00000100:00100000:1.0:1746066811.399755:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985363200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066811.399867:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985363200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 112us (541us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066811.399873:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7577 00002000:00100000:1.0:1746066811.399878:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2199552->2203647) req@ffff880095868380 x1830882985363200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/4536 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.399902:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868380 with x1830882985363200 ext(2199552->2203647) 00002000:00010000:1.0:1746066811.399905:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095868380 00000100:00100000:1.0:1746066811.401386:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985362304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17284us (18053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066811.401392:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7574 00002000:00100000:1.0:1746066811.401399:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095868a80 x1830882985362304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.401411:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868a80 with x1830882985362304 ext(0->1048575) 00002000:00010000:1.0:1746066811.401416:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095868a80 00000100:00100000:0.0:1746066811.415690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.416523:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.416583:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.418298:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.421031:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.421050:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985364096 00000100:00100000:0.0:1746066811.421055:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985364096 00002000:00100000:0.0:1746066811.421083:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1806336->2097151) req@ffff880098926d80 x1830882985364096/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.421093:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882985364096 ext(1806336->2097151) 00010000:00010000:0.0:1746066811.421099:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb0d39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7235 expref: 31 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.421108:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb0d39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7235 expref: 31 pid: 13363 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746066811.421113:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066811.421132:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2179 00000100:00100000:0.0:1746066811.421138:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985364096:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066811.424803:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.425008:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985364224 00000100:00100000:1.0:1746066811.425014:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985364224 00002000:00100000:1.0:1746066811.425047:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2203647) req@ffff880098924000 x1830882985364224/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.425056:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924000 with x1830882985364224 ext(2097152->2203647) 00010000:00010000:1.0:1746066811.425063:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 35 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.425074:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 35 pid: 12255 timeout: 879 lvb_type: 0 00002000:00010000:1.0:1746066811.425081:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098924000 00000100:00100000:1.0:1746066811.425108:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2180 00000100:00100000:1.0:1746066811.425115:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985364224:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066811.430284:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.430510:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985364224:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5393us (5716us total) trans 17179875327 rc 0/0 00000100:00100000:1.0:1746066811.430518:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2180 00002000:00100000:1.0:1746066811.430528:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2203647) req@ffff880098924000 x1830882985364224/t17179875327(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/448 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.430536:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924000 with x1830882985364224 ext(2097152->2203647) 00010000:00010000:1.0:1746066811.430544:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 35 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.430555:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfb0d94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7258 expref: 34 pid: 12255 timeout: 879 lvb_type: 0 00002000:00010000:1.0:1746066811.430562:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098924000 00000100:00100000:0.0:1746066811.435094:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.435147:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.436324:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.441177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.441298:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985365120 00000100:00100000:1.0:1746066811.441305:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985365120 00002000:00100000:1.0:1746066811.441346:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3022847) req@ffff88011f710380 x1830882985365120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.441355:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985365120 ext(3018752->3022847) 00002000:00010000:1.0:1746066811.441359:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710380 00000100:00100000:1.0:1746066811.441387:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7581 00000100:00100000:1.0:1746066811.441394:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985365120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066811.441535:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985365120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 141us (369us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066811.441541:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7581 00002000:00100000:1.0:1746066811.441546:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3022847) req@ffff88011f710380 x1830882985365120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/4536 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.441553:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985365120 ext(3018752->3022847) 00002000:00010000:1.0:1746066811.441556:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710380 00000100:00100000:0.0:1746066811.441918:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.442206:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985365376 00000100:00100000:1.0:1746066811.442210:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985365376 00002000:00100000:1.0:1746066811.442226:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f710e00 x1830882985365376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.442250:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710e00 with x1830882985365376 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.442253:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710e00 00000100:00100000:1.0:1746066811.442273:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7582 00000100:00100000:1.0:1746066811.442280:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985365376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.445749:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.446322:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985365376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4040us (4402us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066811.446337:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7582 00002000:00100000:1.0:1746066811.446346:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f710e00 x1830882985365376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.446355:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710e00 with x1830882985365376 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.446359:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710e00 00000100:00100000:0.0:1746066811.450215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.450539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.451068:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.451322:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.451388:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.451401:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985366144 00000100:00100000:0.0:1746066811.451403:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985366144 00010000:00010000:2.0:1746066811.451407:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfb0dc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7289 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066811.451414:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 9 pid: 12237 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.451419:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67e00, rc 0) 00000100:00100000:0.0:1746066811.451432:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9243 00000100:00100000:2.0:1746066811.451433:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985366016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (113us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066811.451437:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985366144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066811.451439:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20195 00010000:00010000:0.0:1746066811.451443:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066811.451454:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 9 pid: 12237 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.451474:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 9 pid: 12237 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.451486:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb0c9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71d3 expref: 9 pid: 12237 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.451501:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066811.451519:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985366144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.451525:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9243 00000100:00100000:0.0:1746066811.451861:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.451944:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985366272 00000100:00100000:2.0:1746066811.451948:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985366272 00010000:00010000:2.0:1746066811.452168:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.452278:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9244 00000100:00100000:2.0:1746066811.452283:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882985366272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066811.452290:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.452297:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.452305:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.452316:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0cad lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71e1 expref: 21 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.452323:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.452324:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.452328:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.452339:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.452363:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066811.452373:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985082624:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066811.452674:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.452791:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.452843:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985366528 00000100:00100000:1.0:1746066811.452846:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985366528 00002000:00100000:1.0:1746066811.452874:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3018751) req@ffff88009666c700 x1830882985366528/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.453734:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c700 with x1830882985366528 ext(2097152->3018751) 00000100:00100000:2.0:1746066811.453739:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985082624:192.168.204.16@tcp:105: 00002000:00010000:1.0:1746066811.453741:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c700 00010000:00010000:2.0:1746066811.453753:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066811.453779:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882985366272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1495us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.453787:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9244 00000100:00100000:1.0:1746066811.453845:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7583 00000100:00100000:1.0:1746066811.453853:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985366528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066811.454368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.459518:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.459629:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985367040 00000100:00100000:2.0:1746066811.459638:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985367040 00002000:00100000:2.0:1746066811.459682:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2994176->2998271) req@ffff88008e434e00 x1830882985367040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066811.459692:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434e00 with x1830882985367040 ext(2994176->2998271) 00002000:00010000:2.0:1746066811.459698:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434e00 00000100:00100000:1.0:1746066811.459768:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985366528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5914us (6975us total) trans 0 rc 921600/921600 00000100:00100000:1.0:1746066811.459776:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7583 00002000:00100000:1.0:1746066811.459784:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3018751) req@ffff88009666c700 x1830882985366528/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.459792:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c700 with x1830882985366528 ext(2097152->3018751) 00002000:00010000:1.0:1746066811.459796:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c700 00000100:00100000:1.0:1746066811.459815:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7585 00000100:00100000:1.0:1746066811.459822:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985367040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066811.459954:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985367040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 132us (446us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066811.459960:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7585 00002000:00100000:1.0:1746066811.459965:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2994176->2998271) req@ffff88008e434e00 x1830882985367040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/4536 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.459972:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434e00 with x1830882985367040 ext(2994176->2998271) 00002000:00010000:1.0:1746066811.459975:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434e00 00000100:00100000:0.0:1746066811.462808:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.463595:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.463662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.463849:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20197 00000100:00100000:1.0:1746066811.463856:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985367552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.463865:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.463873:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb0dd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7297 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.463940:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985082752:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066811.464418:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066811.465923:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066810 -> 1746066812 00000100:00100000:1.0:1746066811.465941:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985082752:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066811.465969:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb0dd3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7297 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.465982:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb0dd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7297 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.465997:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbae00, rc 0) 00000100:00100000:1.0:1746066811.466017:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985367552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2161us (2355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066811.466023:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20197 00000100:00100000:2.0:1746066811.467524:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.467556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.467604:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.467622:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985367936 00000100:00100000:2.0:1746066811.467627:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985367936 00000100:00100000:2.0:1746066811.467722:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985367808 00000100:00100000:2.0:1746066811.467725:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985367808 00000100:00100000:2.0:1746066811.467752:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20199 00000100:00100000:2.0:1746066811.467759:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985367680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066811.467771:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.467783:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb0de1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d729e expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.467806:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb0de1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d729e expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.467817:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb0de1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d729e expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.467829:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67400, rc 0) 00000100:00100000:1.0:1746066811.467924:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20200 00000100:00100000:1.0:1746066811.467932:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3286:x1830882985367808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.467939:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.467945:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72a5 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.467959:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.467961:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.467967:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.467980:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.467988:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba400, rc 0) 00000100:00100000:2.0:1746066811.468416:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985367680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 656us (894us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066811.468421:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20199 00000100:00100000:1.0:1746066811.468609:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3286:x1830882985367808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 677us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.468614:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20200 00000100:00100000:0.0:1746066811.472824:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.472918:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.472990:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985368320 00000100:00100000:1.0:1746066811.472998:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985368320 00002000:00100000:1.0:1746066811.473040:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88008e436300 x1830882985368320/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066811.473050:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436300 with x1830882985368320 ext(3145728->4194303) 00002000:00010000:1.0:1746066811.473055:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436300 00000100:00100000:2.0:1746066811.473120:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7588 00000100:00100000:2.0:1746066811.473128:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985368448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066811.480380:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985368448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7251us (7496us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066811.480389:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7588 00002000:00100000:2.0:1746066811.480395:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88008e435180 x1830882985368448/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/440 e 0 to 0 dl 1746066822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066811.480402:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435180 with x1830882985368448 ext(3145728->4194303) 00002000:00010000:2.0:1746066811.480408:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e435180 00000100:00100000:0.0:1746066811.483386:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.487144:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.499530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.503090:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.503154:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985369088 00000100:00100000:1.0:1746066811.503162:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985369088 00000100:00100000:1.0:1746066811.503437:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20203 00000100:00100000:1.0:1746066811.503446:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985369088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066811.503472:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.503489:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0dfd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72c1 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.503518:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0dfd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72c1 expref: 12 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.503526:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0dfd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72c1 expref: 12 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.503544:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8000, rc 0) 00000100:00100000:1.0:1746066811.503587:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985369088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (508us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066811.503593:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20203 00000100:00100000:0.0:1746066811.577704:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.580090:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.580397:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.580476:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985369728 00000100:00100000:2.0:1746066811.580484:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985369728 00000100:00100000:2.0:1746066811.580521:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6469 00000100:00100000:2.0:1746066811.580528:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3292:x1830882985369728:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066811.580709:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3292:x1830882985369728:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 181us (626us total) trans 8589937672 rc 0/0 00000100:00100000:2.0:1746066811.580716:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6469 00000100:00100000:0.0:1746066811.598144:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.598287:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985369856 00000100:00100000:1.0:1746066811.598297:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985369856 00000100:00100000:1.0:1746066811.598353:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20204 00000100:00100000:1.0:1746066811.598362:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3292:x1830882985369856:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066811.598381:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066811.598398:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72cf expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.598427:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5770000/0xf1867c21abfb0b6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d711d expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598435:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4b39200/0xf1867c21abfb0c3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7186 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598442:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfb0c0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d715c expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598448:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.598449:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.598453:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1282048->1683455] (req 1282048->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 9 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.598494:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfb0c0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d715c expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598505:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfb0c0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d715c expref: 19 pid: 12255 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.598517:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083008:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.598621:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4b39200/0xf1867c21abfb0c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7186 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598630:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4b39200/0xf1867c21abfb0c3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7186 expref: 9 pid: 9592 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.598639:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083136:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.598739:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5770000/0xf1867c21abfb0b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d711d expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.598748:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5770000/0xf1867c21abfb0b6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d711d expref: 6 pid: 1893 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.598756:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083264:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.598772:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066811.599921:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.599933:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083264:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.600294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.600426:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985083008:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.600449:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1282048->1683455] (req 1282048->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 9 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.600475:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8800, rc 0) 00000100:00100000:1.0:1746066811.600522:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3292:x1830882985369856:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2160us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.600528:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20204 00000100:00100000:0.0:1746066811.601244:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.601530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.606370:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.614457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.616370:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.616403:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.616422:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985371136 00000100:00100000:2.0:1746066811.616427:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985371136 00000100:00100000:2.0:1746066811.616456:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6470 00000100:00100000:2.0:1746066811.616477:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:314:x1830882985371136:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066811.616635:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:314:x1830882985371136:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 158us (266us total) trans 8589937674 rc 0/0 00000100:00100000:2.0:1746066811.616641:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6470 00000100:00100000:0.0:1746066811.617861:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.617971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.618057:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9249 00000100:00100000:1.0:1746066811.618069:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985371392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.618083:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.618099:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a9 expref: 18 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.618112:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a9 expref: 18 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.618130:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb0c36 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71a9 expref: 18 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.618148:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.618152:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.618160:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.618167:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.618196:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066811.618208:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618215:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066811.618224:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985371392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.618231:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9249 00000004:00200000:2.0:1746066811.618244:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066811.618246:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066811.618258:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618268:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618281:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618286:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618290:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618296:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618300:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066811.618304:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618309:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618317:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066811.618320:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066811.618323:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618327:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618336:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618340:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618344:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618348:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066811.618350:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618353:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618359:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0fb00) 00010000:00010000:2.0:1746066811.618361:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066811.618363:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618367:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.618391:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfb0e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.618401:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.618406:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.618408:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066811.618410:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:2.0:1746066811.618442:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3296:x1830882985370624:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3826us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.618447:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17200 00000100:00100000:0.0:1746066811.620846:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.620909:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.620930:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985371648 00000100:00100000:1.0:1746066811.620937:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985371648 00000100:00100000:0.0:1746066811.620941:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.620977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.620997:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985371904 00000100:00100000:1.0:1746066811.620999:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985371904 00000100:00100000:2.0:1746066811.621010:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985371776 00000100:00100000:2.0:1746066811.621021:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985371776 00000100:00100000:1.0:1746066811.621027:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20205 00000100:00100000:1.0:1746066811.621035:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985371648:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066811.621045:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20207 00010000:00010000:1.0:1746066811.621050:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066811.621054:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985371520:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066811.621064:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72e4 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.621069:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.621084:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb0e58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72dd expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.621084:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.621086:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.621095:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72e4 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.621108:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72e4 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.621117:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9e00, rc 0) 00000100:00100000:2.0:1746066811.621126:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985083904:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066811.621150:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985371648:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.621155:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20205 00000100:00100000:2.0:1746066811.621172:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066811.621215:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20208 00000100:00100000:2.0:1746066811.621220:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985371776:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.621228:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.621237:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f67e00/0xf1867c21abfb0e5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72eb expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.621258:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f67e00/0xf1867c21abfb0e5f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72eb expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.621266:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67e00/0xf1867c21abfb0e5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72eb expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.621276:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67e00, rc 0) 00000100:00100000:2.0:1746066811.621310:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985371776:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 88us (331us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066811.621315:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20208 00002000:00010000:2.0:1746066811.622456:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066810 -> 1746066812 00002000:00010000:2.0:1746066811.622474:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066810 -> 1746066812 00002000:00010000:2.0:1746066811.622477:0:12237:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066810 -> 1746066812 00000100:00100000:2.0:1746066811.622497:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985083904:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066811.622522:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb0e58 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72dd expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.622532:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb0e58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72dd expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.622541:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66a00, rc 0) 00000100:00100000:2.0:1746066811.622575:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985371520:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1524us (1633us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066811.622581:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20207 00000100:00100000:0.0:1746066811.624235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.624448:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372160 00000100:00100000:2.0:1746066811.624454:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372160 00000100:00100000:2.0:1746066811.624519:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17201 00000100:00100000:2.0:1746066811.624525:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3296:x1830882985372160:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.624538:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.624551:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfb0e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d72f9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.624627:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.624639:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.624645:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.624668:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.624678:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 8 pid: 7244 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.624686:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985084032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.624754:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066811.625743:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985084032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.625746:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066811.625757:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066811.625813:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372288 00000100:00100000:1.0:1746066811.625817:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372288 00010000:00010000:1.0:1746066811.625840:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 9 pid: 7244 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.625866:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9250 00000100:00100000:1.0:1746066811.625872:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985372288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.625881:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.625903:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 9 pid: 7244 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.625913:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 9 pid: 7244 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.625928:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0e43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72d6 expref: 9 pid: 7244 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.625942:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.625946:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.625952:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.625957:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.625970:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066811.625975:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.625982:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066811.625993:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:1.0:1746066811.626006:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985372288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.626012:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9250 00010000:00010000:2.0:1746066811.626077:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfb0e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72f9 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.626089:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72f9 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.626094:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.626096:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066811.626098:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66200, rc 0) 00000100:00100000:2.0:1746066811.626120:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3296:x1830882985372160:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1595us (1888us total) trans 8589937675 rc 0/0 00000100:00100000:2.0:1746066811.626125:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17201 00000100:00100000:0.0:1746066811.627642:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.627716:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372544 00000100:00100000:2.0:1746066811.627722:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372544 00000100:00100000:2.0:1746066811.627863:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17202 00000100:00100000:2.0:1746066811.627870:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3296:x1830882985372544:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.627904:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.627906:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066811.627920:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfb0e6d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72f9 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.627932:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.627935:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066811.627943:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e7b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7300 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.628005:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e82 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.628014:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.628021:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066811.628029:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066811.628082:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb0e7b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7300 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.628096:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e82 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7300 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.628102:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.628104:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066811.628105:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0c00, rc 0) 00000100:00100000:2.0:1746066811.628372:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3296:x1830882985372544:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 420us (650us total) trans 8589937676 rc 0/0 00000100:00100000:2.0:1746066811.628378:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17202 00000100:00100000:0.0:1746066811.629841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.629911:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372672 00000100:00100000:2.0:1746066811.629918:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372672 00000100:00100000:2.0:1746066811.629956:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17203 00000100:00100000:2.0:1746066811.629962:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3296:x1830882985372672:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.629977:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066811.629990:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfb0e90 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7307 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.630026:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfb0e90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7307 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.630035:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfb0e90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7307 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.630048:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.630051:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066811.630054:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1600, rc 0) 00000100:00100000:2.0:1746066811.630092:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3296:x1830882985372672:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 129us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.630097:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17203 00000100:00100000:0.0:1746066811.632009:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.632045:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.632069:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372800 00000100:00100000:2.0:1746066811.632074:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372800 00000100:00100000:2.0:1746066811.632101:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985372928 00000100:00100000:2.0:1746066811.632103:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985372928 00000100:00100000:2.0:1746066811.632127:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20209 00000100:00100000:2.0:1746066811.632133:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985372800:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066811.632164:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f67a00/0xf1867c21abfb0e97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632177:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632185:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d717f expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632192:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d714e expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632198:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.632200:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.632203:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67a00/0xf1867c21abfb0e97 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632228:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d714e expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632243:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfb0c05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d714e expref: 32 pid: 11630 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.632255:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985084160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.632324:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d717f expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632333:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb400/0xf1867c21abfb0c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d717f expref: 10 pid: 20361 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.632340:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985084288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.632389:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066811.632400:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632408:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 9 pid: 12237 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.632415:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985084544:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.632415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.632431:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.632436:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.632445:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985373056 00000100:00100000:2.0:1746066811.632447:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985373056 00000100:00100000:2.0:1746066811.632485:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20211 00000100:00100000:2.0:1746066811.632491:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985373056:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066811.632506:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066811.632507:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066811.632515:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632522:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632529:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0c1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7163 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632534:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.632535:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.632537:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632553:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0c1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7163 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632560:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0c1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7163 expref: 18 pid: 9592 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.632569:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985084672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.632640:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985373312 00000100:00100000:2.0:1746066811.632643:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985373440 00000100:00100000:2.0:1746066811.632647:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985373440 00000100:00100000:1.0:1746066811.632650:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985373312 00000100:00100000:2.0:1746066811.632668:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20213 00000100:00100000:2.0:1746066811.632673:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985373440:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066811.632689:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632698:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632703:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066811.632704:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066811.632706:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632720:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.632728:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 7 pid: 12255 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.632735:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985084800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.632756:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43630c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066811.632780:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066811.632788:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 7 pid: 13726 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.632796:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985085184:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.632818:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066811.632826:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20214 00010000:00010000:2.0:1746066811.632829:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 8 pid: 1893 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746066811.632833:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985373312:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746066811.632837:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985085440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.632852:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00010000:00010000:1.0:1746066811.632864:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632879:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb0da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7266 expref: 10 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632911:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f67800/0xf1867c21abfb0da9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d726d expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632918:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632924:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746066811.632925:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746066811.632928:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632952:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.632962:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 10 pid: 13726 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.632973:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085568:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.633060:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f67800/0xf1867c21abfb0da9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d726d expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.633068:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f67800/0xf1867c21abfb0da9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d726d expref: 32 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.633076:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.633101:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb0da2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7266 expref: 10 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.633108:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb0da2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3018752->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7266 expref: 10 pid: 13363 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.633115:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.633816:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.638596:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.638625:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.638650:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.638828:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9251 00000100:00100000:1.0:1746066811.638843:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985373568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.638859:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.638903:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 12 pid: 12237 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.638915:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb0b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7116 expref: 12 pid: 12237 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.638941:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.638977:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985373568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.639027:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985084416:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066811.639050:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.639555:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9251 00000100:00100000:1.0:1746066811.639599:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.640637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.640665:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.640690:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.640705:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985374336 00000100:00100000:0.0:1746066811.640709:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985374336 00002000:00100000:0.0:1746066811.640739:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2998271) req@ffff88012d803100 x1830882985374336/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/0 e 0 to 0 dl 1746066822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.640747:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985374336 ext(2097152->2998271) 00010000:00010000:0.0:1746066811.640754:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 8 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.640762:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 8 pid: 12255 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746066811.640768:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d803100 00000100:00100000:0.0:1746066811.640783:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2181 00000100:00100000:0.0:1746066811.640787:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985374336:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066811.640911:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066811.640919:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985085824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066811.640939:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066811.640991:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985373952 00000100:00100000:2.0:1746066811.640998:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985373952 00010000:00010000:2.0:1746066811.641021:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0db7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d727b expref: 32 pid: 13363 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.641040:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985374848 00000100:00100000:2.0:1746066811.641043:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985374848 00010000:00010000:2.0:1746066811.641053:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 12 pid: 13726 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746066811.641069:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9254 00000100:00100000:2.0:1746066811.641075:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985373952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066811.641080:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9255 00010000:00010000:2.0:1746066811.641084:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066811.641089:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985374848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.641097:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.641099:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0db7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d727b expref: 32 pid: 13363 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746066811.641109:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0db7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d727b expref: 32 pid: 13363 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.641110:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 12 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.641119:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 12 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746066811.641127:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0400/0xf1867c21abfb0db7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d727b expref: 32 pid: 13363 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746066811.641146:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066811.641179:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985373952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.641185:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9254 00010000:00010000:1.0:1746066811.641372:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfb0c59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d718d expref: 12 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.641398:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.641419:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985374848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 331us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.641425:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9255 00000100:00100000:1.0:1746066811.641850:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9257 00000100:00100000:1.0:1746066811.641856:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985374720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.641863:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.641872:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d725f expref: 13 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.641879:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d725f expref: 13 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.642015:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfb0d9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d725f expref: 13 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.642024:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.642043:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985374720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 187us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.642048:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9257 00000100:00100000:1.0:1746066811.642061:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9258 00000100:00100000:1.0:1746066811.642066:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985375232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.642072:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.642078:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.642085:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.642095:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dba400/0xf1867c21abfb0de8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72a5 expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.642103:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.642116:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985375232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.642121:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9258 00000100:00100000:1.0:1746066811.642130:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9259 00000100:00100000:1.0:1746066811.642134:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985374080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.642140:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.642146:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72e4 expref: 10 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642154:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72e4 expref: 10 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642164:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb0e51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72e4 expref: 10 pid: 13726 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642172:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.642173:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.642176:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642183:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642203:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.642216:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985374080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.642220:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9259 00000100:00100000:1.0:1746066811.642230:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9260 00000100:00100000:1.0:1746066811.642234:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985374592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.642240:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.642246:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 9 pid: 1893 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642258:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 9 pid: 1893 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642267:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb0b56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7124 expref: 9 pid: 1893 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746066811.642274:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.642275:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.642278:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642283:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642295:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.642307:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985374592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.642311:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9260 00010000:00010000:1.0:1746066811.642326:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642332:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642343:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642353:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642358:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642364:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135974e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066811.642367:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642374:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642382:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642387:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0eac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.642419:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985373184:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 9751us (10003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.642426:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20212 00010000:00010000:1.0:1746066811.642441:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642447:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642457:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642475:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642480:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066811.642539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066811.642755:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066811.642758:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642764:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642773:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.642778:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfb0ea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.643858:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985373056:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11362us (11469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.643865:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20211 00000100:00100000:2.0:1746066811.644960:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985374208:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4098us (4267us total) trans 21474842683 rc 0/0 00000100:00100000:2.0:1746066811.644969:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2182 00002000:00100000:2.0:1746066811.644978:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1282048->1683455) req@ffff88012d801c00 x1830882985374208/t21474842683(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/448 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066811.644986:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801c00 with x1830882985374208 ext(1282048->1683455) 00010000:00010000:2.0:1746066811.644994:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.645004:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00002000:00010000:2.0:1746066811.645010:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d801c00 00000100:00100000:1.0:1746066811.647271:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.647337:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985375360 00000100:00100000:2.0:1746066811.647345:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985375360 00010000:00010000:2.0:1746066811.647374:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.647407:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9262 00000100:00100000:2.0:1746066811.647413:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985375360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066811.647427:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.647449:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.647468:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.647487:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb0e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d72cf expref: 11 pid: 13726 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.647499:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.647500:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.647504:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.647511:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.647543:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066811.647576:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985375360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 163us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.647582:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9262 00010000:00010000:1.0:1746066811.647662:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647674:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647697:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647704:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647710:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647717:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd1e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066811.647725:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647732:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647748:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.647754:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb0e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.647824:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985372928:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 15583us (15776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.647833:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20210 00010000:00010000:1.0:1746066811.649127:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066811.650168:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985374976:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8910us (8982us total) trans 17179875328 rc 0/0 00000100:00100000:0.0:1746066811.650173:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985374336:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9383us (9504us total) trans 21474842684 rc 0/0 00000100:00100000:2.0:1746066811.650177:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2183 00000100:00100000:0.0:1746066811.650182:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2181 00002000:00100000:2.0:1746066811.650187:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3145727) req@ffff88012ea34a80 x1830882985374976/t17179875328(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/448 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.650188:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2998271) req@ffff88012d803100 x1830882985374336/t21474842684(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:217/0 lens 488/448 e 0 to 0 dl 1746066822 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066811.650196:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985374336 ext(2097152->2998271) 00002000:00100000:2.0:1746066811.650199:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea34a80 with x1830882985374976 ext(3018752->3145727) 00010000:00010000:0.0:1746066811.650205:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.650206:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb0da2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7266 expref: 10 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.650216:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb0da2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7266 expref: 10 pid: 13363 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746066811.650217:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00002000:00010000:2.0:1746066811.650222:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ea34a80 00002000:00010000:0.0:1746066811.650223:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d803100 00000100:00100000:0.0:1746066811.655337:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.655830:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.656021:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985375616 00000100:00100000:2.0:1746066811.656026:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985375616 00010000:00010000:2.0:1746066811.656042:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.656060:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9264 00000100:00100000:2.0:1746066811.656065:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985375616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066811.656072:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.656083:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.656091:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.656103:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66000/0xf1867c21abfb0db0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7274 expref: 10 pid: 12255 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.656111:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.656113:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.656115:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656121:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656135:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066811.656151:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985375616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.656157:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9264 00010000:00010000:1.0:1746066811.656214:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656227:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656252:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656259:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656263:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656266:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656270:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656274:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066811.656277:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656283:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656285:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656290:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656296:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656302:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066811.656305:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656316:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656324:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.656330:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb0eb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066811.656369:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2015:x1830882985373440:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 23695us (23862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.656376:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20213 00010000:00010000:1.0:1746066811.656667:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.656674:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8000/0xf1867c21abfb0eba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066811.656745:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985373312:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 23910us (24304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.656753:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20214 00000100:00100000:0.0:1746066811.660001:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.660056:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985375872 00000100:00100000:2.0:1746066811.660067:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985375872 00000100:00100000:2.0:1746066811.660132:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17204 00000100:00100000:2.0:1746066811.660140:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3296:x1830882985375872:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746066811.660189:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.660223:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfb0e90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7307 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660239:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.660243:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066811.660272:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.660285:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660293:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660301:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0d08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7227 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660307:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfb0d2b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d722e expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660312:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.660344:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfb0d2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d722e expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660355:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfb0d2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d722e expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.660369:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985085952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.660478:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0d08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7227 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660486:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0d08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7227 expref: 16 pid: 7244 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.660494:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.660520:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660527:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.660533:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.660550:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.660557:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.660564:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.660584:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066811.664215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.664268:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985085952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066811.664775:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.664848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066811.664950:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0d08 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7227 expref: 17 pid: 7244 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746066811.664967:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.664977:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066811.664985:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985086336:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066811.665020:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066811.665304:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9266 00000100:00100000:2.0:1746066811.665311:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985376256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066811.665319:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066811.665323:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.665330:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.665340:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb0c91 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71c5 expref: 16 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746066811.665352:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.665355:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.665360:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066811.665377:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985376256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 68us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.665382:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9266 00000100:00100000:0.0:1746066811.666115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066811.666152:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985376384 00000100:00100000:1.0:1746066811.666156:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985376384 00010000:00010000:1.0:1746066811.666171:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746066811.666186:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9268 00000100:00100000:1.0:1746066811.666191:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985376384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066811.666198:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066811.666202:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.666211:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.666222:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfb0c8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d71be expref: 33 pid: 17253 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746066811.666236:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066811.666239:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.666245:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.666250:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066811.666281:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066811.666303:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985376384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.666308:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9268 00000001:00080000:1.0:1746066811.668800:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937677 is committed 00000004:00080000:1.0:1746066811.668809:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1161 committed 00000004:00080000:1.0:1746066811.668815:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1151 committed 00000004:00080000:1.0:1746066811.668831:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1150 committed 00000004:00080000:1.0:1746066811.668833:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1149 committed 00000004:00080000:1.0:1746066811.668834:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1148 committed 00000004:00080000:1.0:1746066811.668835:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1160 committed 00000004:00080000:1.0:1746066811.668837:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1147 committed 00000004:00080000:1.0:1746066811.668838:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1159 committed 00000004:00080000:1.0:1746066811.668839:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1146 committed 00000004:00080000:1.0:1746066811.668840:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1158 committed 00000004:00080000:1.0:1746066811.668841:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1157 committed 00000004:00080000:1.0:1746066811.668843:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1156 committed 00000004:00080000:1.0:1746066811.668844:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1145 committed 00000004:00080000:1.0:1746066811.668845:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1144 committed 00000004:00080000:1.0:1746066811.668847:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1155 committed 00000004:00080000:1.0:1746066811.668849:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1154 committed 00000004:00080000:1.0:1746066811.668850:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1143 committed 00000001:00080000:1.0:1746066811.668857:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937674 is committed 00000001:00080000:1.0:1746066811.668861:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937673 is committed 00000100:00100000:1.0:1746066811.668905:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985086464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.668946:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985086848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.668963:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086592 00000100:00100000:1.0:1746066811.668965:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.668968:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086592 00000100:00100000:1.0:1746066811.668993:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985087360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.668997:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086848 00000100:00100000:0.0:1746066811.668999:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086848 00000100:00100000:2.0:1746066811.669002:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985087104 00000100:00100000:2.0:1746066811.669005:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985087104 00000100:00100000:1.0:1746066811.669010:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.669013:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20215 00000100:00100000:0.0:1746066811.669019:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3776:x1830882985086592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669022:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985087360 00000100:00100000:1.0:1746066811.669023:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985087872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669024:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985087360 00000100:00100000:2.0:1746066811.669040:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086720 00000100:00100000:2.0:1746066811.669042:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086720 00000100:00100000:1.0:1746066811.669044:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20216 00000100:00100000:1.0:1746066811.669050:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3774:x1830882985086848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669053:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20217 00000100:00100000:2.0:1746066811.669056:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3776:x1830882985087104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669128:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882985087104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (142us total) trans 17179875329 rc 0/0 00000100:00100000:0.0:1746066811.669129:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882985086592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (183us total) trans 21474842685 rc 0/0 00000100:00100000:2.0:1746066811.669134:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20217 00000100:00100000:0.0:1746066811.669137:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20215 00000100:00100000:2.0:1746066811.669145:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985088256 00000100:00100000:2.0:1746066811.669148:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985088256 00000100:00100000:0.0:1746066811.669148:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20218 00000100:00100000:0.0:1746066811.669152:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3774:x1830882985087360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669160:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20220 00000100:00100000:2.0:1746066811.669164:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882985087232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.669200:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985087360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (189us total) trans 17179875330 rc 0/0 00000100:00100000:0.0:1746066811.669205:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20218 00000100:00100000:0.0:1746066811.669213:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985087616 00000100:00100000:0.0:1746066811.669215:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985087616 00000100:00100000:2.0:1746066811.669218:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882985087232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (153us total) trans 21474842686 rc 0/0 00000100:00100000:1.0:1746066811.669221:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985086848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (256us total) trans 17179875331 rc 0/0 00000100:00100000:2.0:1746066811.669223:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20220 00000100:00100000:0.0:1746066811.669226:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20221 00000100:00100000:0.0:1746066811.669230:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882985087744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.669232:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20216 00000100:00100000:2.0:1746066811.669234:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985088128 00000100:00100000:2.0:1746066811.669236:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985088128 00000100:00100000:1.0:1746066811.669240:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20222 00000100:00100000:1.0:1746066811.669244:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882985088256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669245:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20223 00000100:00100000:2.0:1746066811.669248:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985087616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066811.669276:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882985087744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (188us total) trans 21474842687 rc 0/0 00000100:00100000:0.0:1746066811.669280:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20221 00002000:00010000:2.0:1746066811.669283:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066811.669286:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066811.669288:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066811.669290:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:0.0:1746066811.669290:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20224 00002000:00010000:2.0:1746066811.669291:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066811.669292:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882985088256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (183us total) trans 21474842688 rc 0/0 00000100:00100000:0.0:1746066811.669294:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985088128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.669297:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20222 00000100:00100000:2.0:1746066811.669305:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985087616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (101us total) trans 17179875333 rc 0/0 00000100:00100000:2.0:1746066811.669309:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20223 00000100:00100000:1.0:1746066811.669313:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.669322:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086464 00000100:00100000:2.0:1746066811.669324:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086464 00000100:00100000:2.0:1746066811.669335:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20225 00000100:00100000:2.0:1746066811.669339:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985086464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066811.669339:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985088128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (107us total) trans 17179875334 rc 0/0 00000100:00100000:0.0:1746066811.669344:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20224 00000100:00100000:1.0:1746066811.669372:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985086976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669385:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985086464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (71us total) trans 21474842689 rc 0/0 00000100:00100000:1.0:1746066811.669388:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.669390:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20225 00000100:00100000:2.0:1746066811.669396:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985086976 00000100:00100000:1.0:1746066811.669398:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985087488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669399:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985086976 00000100:00100000:2.0:1746066811.669409:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20226 00000100:00100000:2.0:1746066811.669412:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985086976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.669413:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.669419:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985088000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.669433:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066811.669446:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d800380/2, rc 0, transno 21474842689 00000100:00100000:1.0:1746066811.669449:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985086464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669455:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3775:x1830882985086976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (66us total) trans 21474842690 rc 0/0 00000004:00080000:1.0:1746066811.669472:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801500/2, rc 0, transno 21474842690 00000100:00100000:2.0:1746066811.669474:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20226 00000100:00100000:1.0:1746066811.669475:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985086976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066811.669483:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20228 00000100:00100000:2.0:1746066811.669487:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985088000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066811.669490:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.669501:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985088384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.669516:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066811.669530:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea35c00/2, rc 0, transno 17179875331 00000100:00100000:2.0:1746066811.669533:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3775:x1830882985088000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (99us total) trans 21474842692 rc 0/0 00000100:00100000:1.0:1746066811.669533:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985086848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669538:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20228 00000004:00080000:1.0:1746066811.669539:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372a00/2, rc 0, transno 17179875330 00000100:00100000:1.0:1746066811.669541:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985087360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669547:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20230 00000100:00100000:2.0:1746066811.669551:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882985088384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066811.669575:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 11 in progress, 5 in flight, 53 done 00002000:00010000:2.0:1746066811.669588:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:2.0:1746066811.669590:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066811.669592:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066811.669594:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066811.669595:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:2.0:1746066811.669616:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882985088384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (98us total) trans 17179875336 rc 0/0 00000100:00100000:2.0:1746066811.669620:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20230 00000004:00080000:2.0:1746066811.669644:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea36680/2, rc 0, transno 17179875332 00000100:00100000:2.0:1746066811.669647:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985086720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066811.669653:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0dc00/2, rc 0, transno 21474842686 00000100:00100000:2.0:1746066811.669656:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985087232:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066811.669663:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c00a80/2, rc 0, transno 21474842687 00000100:00100000:2.0:1746066811.669665:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985087744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066811.669666:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1f5500/2, rc 0, transno 17179875335 00000004:00080000:2.0:1746066811.669671:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c03100/2, rc 0, transno 21474842688 00000100:00100000:1.0:1746066811.669671:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985087872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066811.669673:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985088256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066811.669678:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ac700/2, rc 0, transno 17179875336 00000100:00100000:1.0:1746066811.669681:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985088384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.669703:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066811.669708:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985088512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066811.669727:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066811.669906:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad180/2, rc 0, transno 17179875337 00000100:00100000:1.0:1746066811.669910:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985088512:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066811.670012:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670019:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670026:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670031:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066811.670035:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670041:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670049:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066811.670051:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066811.670054:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066811.670058:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb0ec1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066811.672475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.676418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680627:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680653:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680670:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066811.680711:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066811.680780:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985376896 00000100:00100000:2.0:1746066811.680789:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985376896 00000100:00100000:2.0:1746066811.680836:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985377408 00000100:00100000:2.0:1746066811.680838:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985377408 00000100:00100000:1.0:1746066811.680904:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20232 00000100:00100000:1.0:1746066811.680913:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985376896:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746066811.680916:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20234 00000100:00100000:0.0:1746066811.680924:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985376768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066811.680930:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066811.680930:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066811.680946:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d731c expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066811.680947:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7323 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066811.680967:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd7c, atime: 0x6812dd7a, ctime: 0x6812dd7c, blocks: 0x808 00002000:00010000:0.0:1746066811.680967:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd7a, atime: 0x6812dd79, ctime: 0x6812dd7a, blocks: 0x800 00010000:00010000:1.0:1746066811.680984:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066811.680984:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.680986:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066811.680986:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066811.680994:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7323 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066811.680994:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.681008:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7323 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066811.681008:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066811.681018:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbebe00, rc 0) 00010000:00010000:0.0:1746066811.681020:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2c00, rc 0) 00000100:00100000:0.0:1746066811.681069:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985376768:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 145us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.681075:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20234 00000100:00100000:2.0:1746066811.681079:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20235 00000100:00100000:2.0:1746066811.681084:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985377024:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.681090:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066811.681090:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20237 00000100:00100000:0.0:1746066811.681096:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985377408:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066811.681097:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d732a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066811.681102:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746066811.681107:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd76, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x800 00010000:00010000:0.0:1746066811.681110:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d733f expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066811.681115:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.681116:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.681120:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746066811.681120:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd7c, atime: 0x6812dd7c, ctime: 0x6812dd7c, blocks: 0x1000 00010000:00010000:2.0:1746066811.681128:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066811.681128:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066811.681130:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066811.681134:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00010000:00010000:0.0:1746066811.681137:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066811.681147:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066811.681153:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985377024:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 70us (470us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066811.681153:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2a00, rc 0) 00000100:00100000:2.0:1746066811.681158:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20235 00000100:00100000:0.0:1746066811.681168:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985377408:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 73us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.681172:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20237 00000100:00100000:1.0:1746066811.681215:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985376896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 303us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.681220:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20232 00000100:00100000:0.0:1746066811.900156:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985088768:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.900216:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985089024:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900286:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830882985088896:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900412:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.900419:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.900452:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985088768 00000100:00100000:0.0:1746066811.900483:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3777:1830882985089280:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900487:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985088768 00000100:00100000:0.0:1746066811.900503:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.900515:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985089792:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900528:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1746066811.900529:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066811.900535:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882985088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900551:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089792 00000100:00100000:0.0:1746066811.900554:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089792 00000100:00100000:0.0:1746066811.900571:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1746066811.900576:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900580:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882985088768:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.900587:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1746066811.900600:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985089792:12345-0@lo:400:kworker.0 Request processed in 25us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.900605:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1746066811.900606:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3774:1830882985089408:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900626:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.900632:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985089792:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900638:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985089920:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900639:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985088768:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.900654:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.900664:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985088896 00000100:00100000:0.0:1746066811.900666:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985088896 00000100:00100000:1.0:1746066811.900674:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089280 00000100:00100000:1.0:1746066811.900677:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089280 00000100:00100000:0.0:1746066811.900684:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089408 00000100:00100000:0.0:1746066811.900685:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089408 00000100:00100000:1.0:1746066811.900702:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1746066811.900706:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882985088896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900713:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1746066811.900719:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3777:x1830882985089280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900744:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3777:x1830882985089280:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.900748:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1746066811.900757:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1746066811.900761:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882985089408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900787:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882985089408:12345-0@lo:400:kworker.0 Request processed in 25us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.900791:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:0.0:1746066811.900808:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746066811.900811:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066811.900826:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3777:1830882985089280:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.900851:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089920 00000100:00100000:0.0:1746066811.900853:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089920 00000100:00100000:0.0:1746066811.900870:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1746066811.900875:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3774:x1830882985089920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901002:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.901026:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3774:x1830882985089920:12345-0@lo:400:kworker.0 Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.901029:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3775:1830882985089536:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901031:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1746066811.901040:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089024 00000100:00100000:0.0:1746066811.901042:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089024 00000100:00080000:0.0:1746066811.901056:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066811.901069:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.901069:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1746066811.901073:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985089024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901083:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089536 00000100:00100000:0.0:1746066811.901086:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089536 00000100:00100000:2.0:1746066811.901093:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985090048:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901103:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1746066811.901106:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3775:x1830882985089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901112:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066811.901527:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3775:x1830882985089536:12345-0@lo:400:kworker.0 Request processed in 418us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.901531:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3775:1830882985089536:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901532:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:0.0:1746066811.901546:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066811.901551:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090048 00000100:00100000:2.0:1746066811.901554:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090048 00000100:00100000:2.0:1746066811.901572:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1746066811.901577:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882985090048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901577:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985089024:12345-0@lo:400:kworker.0 Request processed in 503us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.901582:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1746066811.901602:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882985090048:12345-0@lo:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.901608:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1746066811.901622:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.901636:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882985089664:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901652:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.901672:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882985090176:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901688:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.901709:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882985088640:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901711:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3774:1830882985089408:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901726:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985089152 00000100:00100000:0.0:1746066811.901726:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985089920:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901729:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985089152 00000100:00100000:0.0:1746066811.901744:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090176 00000100:00100000:0.0:1746066811.901747:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090176 00000100:00100000:2.0:1746066811.901748:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1746066811.901753:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985089152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901764:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1746066811.901768:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882985090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901778:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985089152:12345-0@lo:400:kworker.0 Request processed in 25us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.901782:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1746066811.901795:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882985090176:12345-0@lo:400:kworker.0 Request processed in 26us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.901800:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985089152:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.901800:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1746066811.901809:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882985089664:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.901816:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882985090176:0@lo:400:kworker.0 00000100:00100000:1.0:1746066811.902435:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882985088896:12345-0@lo:400:kworker.0 Request processed in 1726us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.902442:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1746066811.902525:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985089024:0@lo:400:kworker.0 00000100:00100000:2.0:1746066811.902539:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985090048:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.902598:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830882985088896:0@lo:400:kworker.0 00000100:00100000:0.0:1746066811.916176:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985090304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066811.916249:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066811.916336:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090304 00000100:00100000:2.0:1746066811.916345:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090304 00000100:00100000:2.0:1746066811.916900:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1746066811.916909:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985090304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746066811.916933:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 925696 granted 1194813888 pending 1757184 free 3909910528 avail 3678388224 00000100:00100000:2.0:1746066811.916973:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985090304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.916979:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1746066811.917346:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985090304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066811.933088:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090432 00000100:00100000:0.0:1746066811.933096:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090432 00000100:00100000:0.0:1746066811.933136:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090560 00000100:00100000:0.0:1746066811.933139:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090560 00000100:00100000:0.0:1746066811.933152:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1746066811.933158:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985090432:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746066811.933160:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1746066811.933169:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985090560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746066811.933192:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445543936 avail 1316081664 00000004:00000024:0.0:1746066811.933192:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746066811.933446:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985090432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 287us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066811.933465:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1746066811.933604:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985090560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 436us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066811.933610:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1746066811.949052:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985090688 00000100:00100000:1.0:1746066811.949060:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985090688 00000100:00100000:1.0:1746066811.949093:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1746066811.949099:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985090688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746066811.949118:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1294040384 pending 1802240 free 3906400256 avail 3674877952 00000100:00100000:1.0:1746066811.949157:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985090688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066811.949162:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00010000:00010000:2.0:1746066812.650571:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066812.685270:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.685314:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.685421:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.685565:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985377920 00000100:00100000:2.0:1746066812.685570:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985377920 00000100:00100000:0.0:1746066812.685574:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.685592:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378176 00000100:00100000:0.0:1746066812.685594:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378176 00000100:00100000:0.0:1746066812.685615:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985377536 00000100:00100000:0.0:1746066812.685617:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985377536 00000100:00100000:2.0:1746066812.685622:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20238 00000100:00100000:2.0:1746066812.685630:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985378176:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066812.685637:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20240 00000100:00100000:0.0:1746066812.685641:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985377664:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:2.0:1746066812.685723:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985378176:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.685723:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985377664:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.685731:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20240 00000100:00100000:2.0:1746066812.685735:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20238 00000100:00100000:2.0:1746066812.685785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.685837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.685846:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378048 00000100:00100000:2.0:1746066812.685849:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378048 00000100:00100000:0.0:1746066812.689653:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.689686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.689766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.689784:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378432 00000100:00100000:1.0:1746066812.689794:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378432 00000100:00100000:2.0:1746066812.689823:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378944 00000100:00100000:2.0:1746066812.689826:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378944 00000100:00100000:1.0:1746066812.689837:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20244 00000100:00100000:1.0:1746066812.689845:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985378432:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066812.689868:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.689904:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.689962:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985378432:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.689969:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20244 00000100:00100000:2.0:1746066812.689979:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378560 00000100:00100000:2.0:1746066812.689982:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378560 00000100:00100000:1.0:1746066812.689985:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20245 00000100:00100000:1.0:1746066812.689989:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985378944:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:2.0:1746066812.689998:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20246 00000100:00100000:2.0:1746066812.690004:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985378688:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:1.0:1746066812.690017:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985378944:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.690023:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20245 00000100:00100000:1.0:1746066812.690033:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20248 00000100:00100000:1.0:1746066812.690037:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985378304:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:2.0:1746066812.690039:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985378688:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.690044:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20246 00000100:00100000:1.0:1746066812.690063:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985378304:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.690068:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20248 00000100:00100000:0.0:1746066812.690147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.690163:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985378816 00000100:00100000:0.0:1746066812.690165:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985378816 00000100:00100000:0.0:1746066812.690187:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20249 00000100:00100000:0.0:1746066812.690192:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985378816:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066812.690246:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985378816:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.690251:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20249 00000100:00100000:0.0:1746066812.696024:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.696148:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985379200 00000100:00100000:2.0:1746066812.696157:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985379200 00000100:00100000:2.0:1746066812.696218:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7591 00000100:00100000:2.0:1746066812.696227:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985379200:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:2.0:1746066812.696265:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.696280:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.696282:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.696288:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.696302:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.698200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.699825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.699931:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985379456 00000100:00100000:0.0:1746066812.699940:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985379456 00000100:00100000:0.0:1746066812.700000:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7592 00000100:00100000:0.0:1746066812.700008:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985379456:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066812.700047:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.700062:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.700064:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.700068:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.700081:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.700704:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.702519:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.702741:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.704208:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.705795:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985380224 00000100:00100000:2.0:1746066812.705803:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985380480 00000100:00100000:1.0:1746066812.705806:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985380224 00000100:00100000:2.0:1746066812.705807:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985380480 00000100:00100000:2.0:1746066812.705858:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985380736 00000100:00100000:2.0:1746066812.705861:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985380736 00000100:00100000:1.0:1746066812.705878:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7595 00000100:00100000:2.0:1746066812.706230:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7596 00000100:00100000:2.0:1746066812.706238:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985380224:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:2.0:1746066812.706276:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097b41200/0xf1867c21abfb0f2a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.706290:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.706292:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.706297:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b41200/0xf1867c21abfb0f2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.706310:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b41200/0xf1867c21abfb0f2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066812.706357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.706368:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985380992 00000100:00100000:0.0:1746066812.706371:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985380992 00000100:00100000:0.0:1746066812.706395:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7598 00000100:00100000:0.0:1746066812.706400:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985380992:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066812.706415:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.706421:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.706423:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.706425:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.706433:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.708643:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985380480:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066812.708691:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.708704:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.708705:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.708710:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.708721:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714703:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714721:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714728:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714734:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066812.714738:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714744:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714766:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.714772:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfb0f07 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.714859:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985379200:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 18628us (18840us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.714868:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7591 00010000:00010000:2.0:1746066812.724429:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724458:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724466:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724474:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066812.724478:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724486:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724505:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.724515:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb0f0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.724644:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985379456:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 24631us (26446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.724654:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7592 00010000:00010000:2.0:1746066812.746272:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746290:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746299:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746306:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066812.746310:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746318:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746337:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.746344:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb0f31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.746497:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985380992:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 40089us (40132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.746507:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7598 00010000:00010000:1.0:1746066812.748969:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.748985:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.748993:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.749000:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c4a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066812.749004:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.749012:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.749030:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.749036:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.749128:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985380480:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 42894us (46381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066812.749139:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7595 00000100:00100000:0.0:1746066812.754050:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.754145:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985381120 00000100:00100000:1.0:1746066812.754154:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985381120 00000100:00100000:1.0:1746066812.754362:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 940 00000100:00100000:1.0:1746066812.754371:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:3296:x1830882985381120:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:1.0:1746066812.754388:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066812.754416:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb0e82 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7300 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.754837:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.754842:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066812.754930:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:3296:x1830882985381120:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 559us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.754937:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 940 00000100:00100000:0.0:1746066812.756160:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.756266:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985381376 00000100:00100000:2.0:1746066812.756273:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985381376 00000100:00100000:2.0:1746066812.756313:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6472 00000100:00100000:2.0:1746066812.756320:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+8:3296:x1830882985381376:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066812.756719:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+9:3296:x1830882985381376:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 397us (560us total) trans 8589937678 rc 0/0 00000100:00100000:2.0:1746066812.756726:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6472 00000100:00100000:0.0:1746066812.758874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.758931:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985381632 00000100:00100000:2.0:1746066812.758940:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985381632 00000100:00100000:2.0:1746066812.758995:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6473 00000100:00100000:2.0:1746066812.759004:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+9:3296:x1830882985381632:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066812.759230:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+10:3296:x1830882985381632:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 227us (362us total) trans 8589937679 rc 0/0 00000100:00100000:2.0:1746066812.759237:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6473 00000100:00100000:0.0:1746066812.772644:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.772721:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985381888 00000100:00100000:1.0:1746066812.772731:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985381888 00000100:00100000:1.0:1746066812.772785:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17207 00000100:00100000:1.0:1746066812.772791:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3305:x1830882985381888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066812.772816:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.772835:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7346 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.772939:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.772953:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.772965:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.772979:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.772986:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.772991:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.773096:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.773104:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066812.774120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066812.774260:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066812.774273:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066812.774359:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774366:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774371:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774377:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774382:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c5800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066812.774385:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774392:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774405:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066812.774408:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066812.774412:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774416:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb0f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774743:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774748:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774752:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774757:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c4a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066812.774759:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774763:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.774999:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476a00) 00010000:00010000:1.0:1746066812.775001:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066812.775003:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.775007:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4a00/0xf1867c21abfb0f4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.775041:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4600/0xf1867c21abfb0f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.775053:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.775059:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.775061:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066812.775063:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c4800, rc 0) 00000100:00100000:1.0:1746066812.775119:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3305:x1830882985381888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2327us (2485us total) trans 8589937680 rc 0/0 00000100:00100000:1.0:1746066812.775124:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17207 00000100:00100000:0.0:1746066812.776953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.777009:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985382400 00000100:00100000:2.0:1746066812.777018:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985382400 00000100:00100000:2.0:1746066812.777072:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6474 00000100:00100000:2.0:1746066812.777080:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3308:x1830882985382400:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066812.777261:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:3308:x1830882985382400:12345-192.168.204.16@tcp:35:cat.0 Request processed in 181us (314us total) trans 8589937682 rc 0/0 00000100:00100000:2.0:1746066812.777271:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6474 00000100:00100000:0.0:1746066812.778942:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.779744:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.779760:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.779785:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.779807:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.779808:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985382656 00000100:00100000:2.0:1746066812.779814:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985382656 00000100:00100000:1.0:1746066812.779829:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985382784 00000100:00100000:1.0:1746066812.779833:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985382784 00000100:00100000:0.0:1746066812.779833:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.779841:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985382912 00000100:00100000:2.0:1746066812.779843:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985382912 00000100:00100000:1.0:1746066812.779855:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383040 00000100:00100000:1.0:1746066812.779857:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383040 00000100:00100000:2.0:1746066812.779858:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383168 00000100:00100000:2.0:1746066812.779860:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383168 00000100:00100000:1.0:1746066812.779873:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20251 00000100:00100000:1.0:1746066812.779878:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985382656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.779902:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.779914:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d735b expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.779926:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.779928:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.779933:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d735b expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066812.779934:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20252 00000100:00100000:0.0:1746066812.779940:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20253 00000100:00100000:2.0:1746066812.779941:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985382784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.779943:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d735b expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.779949:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.779955:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59600, rc 0) 00010000:00010000:2.0:1746066812.779957:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7362 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.779969:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.779970:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.779975:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066812.779976:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985382656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (232us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066812.779984:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.779991:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0dc00, rc 0) 00000100:00100000:2.0:1746066812.780009:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985382784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.780041:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882985382912:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066812.780044:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20251 00000100:00100000:2.0:1746066812.780048:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20252 00010000:00010000:0.0:1746066812.780049:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066812.780054:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20255 00000100:00100000:1.0:1746066812.780058:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985383168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066812.780058:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7369 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780064:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.780069:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780071:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7377 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.780071:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780076:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7369 expref: 34 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780080:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780082:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780085:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780091:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7369 expref: 34 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780093:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780098:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b38400, rc 0) 00010000:00010000:1.0:1746066812.780099:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59c00, rc 0) 00000100:00100000:1.0:1746066812.780111:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985383168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.780116:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20255 00000100:00100000:0.0:1746066812.780116:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985382912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.780121:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20253 00000100:00100000:0.0:1746066812.780159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.780175:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383424 00000100:00100000:1.0:1746066812.780178:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383424 00000100:00100000:0.0:1746066812.780190:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.780202:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383552 00000100:00100000:0.0:1746066812.780205:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383552 00000100:00100000:1.0:1746066812.780208:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17209 00000100:00100000:1.0:1746066812.780213:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3304:x1830882985383424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066812.780223:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.780235:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb0faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d737e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066812.780245:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20256 00000100:00100000:0.0:1746066812.780249:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985383552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066812.780256:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.780263:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7385 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.780274:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780275:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780278:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780286:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780292:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0c00, rc 0) 00000100:00100000:0.0:1746066812.780307:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985383552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.780311:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20256 00010000:00010000:1.0:1746066812.780322:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.780335:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780342:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780348:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066812.780352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066812.780354:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 6/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066812.780361:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383680 00000100:00100000:0.0:1746066812.780364:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383680 00010000:00010000:1.0:1746066812.780380:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066812.780380:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20257 00000100:00100000:0.0:1746066812.780384:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985383680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066812.780390:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.780391:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 31 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.780396:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d738c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.780402:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985090816:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.780406:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780408:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780411:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d738c expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780419:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d738c expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.780425:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:0.0:1746066812.780460:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985383680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.780466:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20257 00010000:00010000:1.0:1746066812.780485:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780497:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 9 pid: 7245 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746066812.780499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.780504:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985090944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.780510:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383808 00000100:00100000:0.0:1746066812.780513:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383808 00000100:00100000:0.0:1746066812.780525:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20258 00000100:00100000:0.0:1746066812.780530:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985383808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.780531:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.780535:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.780539:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 9 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.780541:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7393 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.780546:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091072:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.780550:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780551:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.780555:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00000100:00080000:2.0:1746066812.780559:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066812.780560:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00010000:00010000:0.0:1746066812.780562:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00000100:00080000:2.0:1746066812.780563:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746066812.780568:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0e00, rc 0) 00000100:00100000:0.0:1746066812.780589:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985383808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.780593:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20258 00000100:00100000:1.0:1746066812.780603:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.780638:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985383936 00000100:00100000:2.0:1746066812.780641:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985383936 00000100:00100000:1.0:1746066812.780643:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.780653:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384064 00000100:00100000:1.0:1746066812.780655:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384064 00000100:00100000:2.0:1746066812.780676:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20259 00000100:00100000:0.0:1746066812.780679:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.780680:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20260 00000100:00100000:2.0:1746066812.780682:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985383936:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066812.780684:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985384064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066812.780690:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.780691:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066812.780697:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d739a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780697:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73a1 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.780707:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.780708:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780709:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780710:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.780712:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d739a expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780715:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a1 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.780720:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d739a expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.780727:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c200, rc 0) 00010000:00010000:1.0:1746066812.780728:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a1 expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780735:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2400, rc 0) 00000100:00100000:2.0:1746066812.780759:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985383936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.780759:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985384064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.780763:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20260 00000100:00100000:2.0:1746066812.780766:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20259 00000100:00100000:1.0:1746066812.780773:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384192 00000100:00100000:1.0:1746066812.780776:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384192 00000100:00100000:1.0:1746066812.780795:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20261 00000100:00100000:1.0:1746066812.780800:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985384192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.780805:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.780811:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73a8 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.780819:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780821:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.780824:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a8 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780832:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a8 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.780838:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2a00, rc 0) 00000100:00100000:1.0:1746066812.780852:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985384192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.780861:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20261 00000100:00100000:0.0:1746066812.783084:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.783123:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.783137:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985090816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.783147:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384320 00000100:00100000:1.0:1746066812.783148:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985090944:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066812.783149:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384576 00000100:00100000:0.0:1746066812.783152:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384320 00000100:00100000:2.0:1746066812.783154:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384576 00000100:00100000:1.0:1746066812.783155:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f761500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091072:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.783182:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.783182:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 32 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746066812.783375:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 10 pid: 7244 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746066812.783416:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9269 00000100:00100000:0.0:1746066812.783425:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882985384320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066812.783465:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9270 00000100:00100000:2.0:1746066812.783471:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985384576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066812.783485:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066812.783490:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 10 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.783499:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066812.783500:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 10 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.783505:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 32 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746066812.783522:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfb0ed6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7315 expref: 10 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.783523:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 32 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.783536:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975400/0xf1867c21abfb0f77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d734d expref: 32 pid: 7244 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746066812.783538:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.783542:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.783549:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.783555:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066812.783555:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066812.783558:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.783563:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066812.783595:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985384576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.783602:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9270 00010000:00010000:0.0:1746066812.783624:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066812.783638:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985384320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.783643:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9269 00000100:00100000:1.0:1746066812.783969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.783985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.784013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.784042:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384704 00000100:00100000:1.0:1746066812.784045:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384704 00000100:00100000:1.0:1746066812.784068:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384832 00000100:00100000:1.0:1746066812.784070:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384832 00000100:00100000:1.0:1746066812.784099:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17210 00000100:00100000:1.0:1746066812.784105:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3307:x1830882985384704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.784123:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.784133:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb0fe7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73af expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.784186:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb0fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73af expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.784196:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb0fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73af expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.784212:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.784216:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066812.784218:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2200, rc 0) 00000100:00100000:1.0:1746066812.784239:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3307:x1830882985384704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 135us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.784245:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17210 00000100:00100000:0.0:1746066812.784509:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985384448 00000100:00100000:0.0:1746066812.784515:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985384448 00010000:00010000:0.0:1746066812.784529:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 11 pid: 7245 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746066812.784546:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9271 00000100:00100000:0.0:1746066812.784551:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985384448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066812.784563:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066812.784567:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 11 pid: 7245 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.784576:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 11 pid: 7245 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.784586:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfb0f54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7346 expref: 11 pid: 7245 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746066812.784594:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066812.784598:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.784607:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.784613:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.784628:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066812.784644:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985384448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.784649:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9271 00010000:00010000:1.0:1746066812.784685:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.784692:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066812.784710:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066812.784822:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb0faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.784832:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.784838:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.784840:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066812.784843:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd15c00, rc 0) 00000100:00100000:1.0:1746066812.784869:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:3304:x1830882985383424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4655us (4709us total) trans 8589937683 rc 0/0 00000100:00100000:1.0:1746066812.784874:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17209 00000100:00100000:0.0:1746066812.797743:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.797785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.797811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.797852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.797939:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985385088 00000100:00100000:2.0:1746066812.797948:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985385088 00000100:00100000:1.0:1746066812.797974:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985385344 00000100:00100000:1.0:1746066812.797979:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985385344 00002000:00100000:2.0:1746066812.797995:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c5880 x1830882985385088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.797999:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c6680 x1830882985385344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.798004:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5880 with x1830882985385088 ext(0->1048575) 00002000:00100000:1.0:1746066812.798008:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985385344 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.798009:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5880 00002000:00010000:1.0:1746066812.798012:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:1.0:1746066812.798039:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985385600 00000100:00100000:1.0:1746066812.798041:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985385600 00002000:00100000:1.0:1746066812.798052:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c4e00 x1830882985385600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.798059:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4e00 with x1830882985385600 ext(1048576->2097151) 00002000:00010000:1.0:1746066812.798062:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c4e00 00000100:00100000:1.0:1746066812.798068:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985385856 00000100:00100000:1.0:1746066812.798071:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985385856 00002000:00100000:1.0:1746066812.798081:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a59c6300 x1830882985385856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.798087:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6300 with x1830882985385856 ext(1048576->2097151) 00002000:00010000:1.0:1746066812.798090:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c6300 00000100:00100000:1.0:1746066812.798102:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7600 00000100:00100000:1.0:1746066812.798171:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882985385344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066812.799003:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7602 00000100:00100000:1.0:1746066812.799010:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985385856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.803220:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.803307:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985386112 00000100:00100000:2.0:1746066812.803316:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985386112 00002000:00100000:2.0:1746066812.803359:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c4700 x1830882985386112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.803375:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4700 with x1830882985386112 ext(0->1048575) 00002000:00010000:2.0:1746066812.803381:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4700 00000100:00100000:2.0:1746066812.803401:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7603 00000100:00100000:2.0:1746066812.803408:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985386112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.807165:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.807205:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.807238:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.807669:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985386368 00000100:00100000:2.0:1746066812.807679:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985386368 00002000:00100000:2.0:1746066812.807727:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbca80 x1830882985386368/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.807738:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985386368 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.807744:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:2.0:1746066812.807762:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985386624 00000100:00100000:2.0:1746066812.807765:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985386624 00002000:00100000:2.0:1746066812.807775:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880098fbf100 x1830882985386624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.807782:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985386624 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.807785:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:2.0:1746066812.807792:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985386880 00000100:00100000:2.0:1746066812.807794:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985386880 00002000:00100000:2.0:1746066812.807804:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012b1f5880 x1830882985386880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.807810:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f5880 with x1830882985386880 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.807812:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f5880 00000100:00100000:2.0:1746066812.807824:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7604 00000100:00100000:2.0:1746066812.807831:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985386368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.807937:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7605 00000100:00100000:0.0:1746066812.807945:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985386624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066812.811129:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882985385344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12954us (13338us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066812.811139:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7600 00002000:00100000:1.0:1746066812.811147:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c6680 x1830882985385344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.811156:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985385344 ext(1048576->2097151) 00002000:00010000:1.0:1746066812.811162:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:1.0:1746066812.822193:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985385856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23169us (24326us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066812.822207:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7602 00002000:00100000:1.0:1746066812.822220:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a59c6300 x1830882985385856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.822229:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6300 with x1830882985385856 ext(1048576->2097151) 00002000:00010000:1.0:1746066812.822236:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c6300 00000100:00100000:2.0:1746066812.835584:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985386112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32162us (32361us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.835597:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7603 00002000:00100000:2.0:1746066812.835612:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c4700 x1830882985386112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.835622:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4700 with x1830882985386112 ext(0->1048575) 00002000:00010000:2.0:1746066812.835628:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4700 00000100:00100000:2.0:1746066812.844657:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985386368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36825us (37500us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.844665:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7604 00002000:00100000:2.0:1746066812.844670:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbca80 x1830882985386368/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.844678:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985386368 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.844681:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:0.0:1746066812.847761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.847841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.847921:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985387136 00000100:00100000:0.0:1746066812.847930:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985387136 00002000:00100000:0.0:1746066812.847976:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012b1f4e00 x1830882985387136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066812.847986:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f4e00 with x1830882985387136 ext(2097152->4194303) 00002000:00010000:0.0:1746066812.847991:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f4e00 00000100:00100000:0.0:1746066812.848009:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985387392 00000100:00100000:0.0:1746066812.848011:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985387392 00002000:00100000:0.0:1746066812.848026:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012b1f6300 x1830882985387392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066812.848032:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f6300 with x1830882985387392 ext(2097152->4194303) 00002000:00010000:0.0:1746066812.848036:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1f6300 00000100:00100000:0.0:1746066812.848047:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7607 00000100:00100000:0.0:1746066812.848054:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985387136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066812.848284:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985386624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 40338us (41076us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066812.848293:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7605 00002000:00100000:2.0:1746066812.848299:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880098fbf100 x1830882985386624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.848306:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985386624 ext(1048576->2097151) 00002000:00010000:2.0:1746066812.848310:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:2.0:1746066812.848325:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7608 00000100:00100000:2.0:1746066812.848330:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882985387392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.871971:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.872928:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.872970:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985387904 00000100:00100000:0.0:1746066812.872974:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985387904 00002000:00100000:0.0:1746066812.872993:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012c4a0000 x1830882985387904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066812.873001:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0000 with x1830882985387904 ext(2097152->4194303) 00002000:00010000:0.0:1746066812.873005:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a0000 00000100:00100000:0.0:1746066812.873018:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7610 00000100:00100000:0.0:1746066812.873024:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985387904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066812.876261:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.876830:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985387136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 28774us (29078us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066812.876841:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7607 00002000:00100000:2.0:1746066812.876854:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012b1f4e00 x1830882985387136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.876864:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f4e00 with x1830882985387136 ext(2097152->4194303) 00002000:00010000:2.0:1746066812.876869:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f4e00 00000100:00100000:1.0:1746066812.876969:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985388160 00000100:00100000:1.0:1746066812.876977:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985388160 00000100:00100000:1.0:1746066812.877017:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17212 00000100:00100000:1.0:1746066812.877029:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3305:x1830882985388160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066812.877047:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.877051:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066812.877081:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb0fe7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73af expref: 10 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877114:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.877118:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066812.877129:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfb0ffc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73bd expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877176:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.877189:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb0ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d730e expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877196:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b41200/0xf1867c21abfb0fee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73b6 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877204:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.877233:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097b41200/0xf1867c21abfb0fee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73b6 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877244:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b41200/0xf1867c21abfb0fee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73b6 expref: 31 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066812.877257:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.877332:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb0ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d730e expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.877340:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb0ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d730e expref: 8 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066812.877346:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091328:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.877365:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.887975:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.887993:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091328:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.888021:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066812.889019:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.889066:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.889100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.889285:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985387904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16258us (16355us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066812.889296:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7610 00002000:00100000:0.0:1746066812.889309:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012c4a0000 x1830882985387904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066812.889318:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0000 with x1830882985387904 ext(2097152->4194303) 00002000:00010000:0.0:1746066812.889324:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a0000 00010000:00010000:1.0:1746066812.889989:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.889996:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:1.0:1746066812.890277:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1175, 88 off110984 00000004:00080000:1.0:1746066812.890284:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101399978ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890326:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1187, 88 off111952 00000004:00080000:1.0:1746066812.890331:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101447519ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890344:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1188, 88 off112040 00000004:00080000:1.0:1746066812.890347:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101463618ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890355:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1176, 88 off111072 00000004:00080000:1.0:1746066812.890357:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101473973ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890364:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1177, 88 off111160 00000004:00080000:1.0:1746066812.890366:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101482866ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890373:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1189, 88 off112128 00000004:00080000:1.0:1746066812.890375:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101491631ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890381:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1190, 88 off112216 00000004:00080000:1.0:1746066812.890383:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101500070ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890390:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1191, 88 off112304 00000004:00080000:1.0:1746066812.890392:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101508811ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890398:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1178, 88 off111248 00000004:00080000:1.0:1746066812.890401:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101517298ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890407:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1192, 88 off112392 00000004:00080000:1.0:1746066812.890409:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101526248ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890416:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1179, 88 off111336 00000004:00080000:1.0:1746066812.890418:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101534948ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890425:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1193, 88 off112480 00000004:00080000:1.0:1746066812.890427:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101543631ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066812.890433:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1180, 88 off111424 00000004:00080000:1.0:1746066812.890446:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101562268ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890455:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1181, 88 off111512 00000004:00080000:1.0:1746066812.890457:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101574211ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890464:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1182, 88 off111600 00000004:00080000:1.0:1746066812.890467:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101583356ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890473:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1183, 88 off111688 00000004:00080000:1.0:1746066812.890475:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781101591955ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066812.890482:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1194, 88 off112568 00000004:00080000:1.0:1746066812.890484:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781101601059ns, next at 733263917711ns, rc = 0 00000100:00100000:2.0:1746066812.890781:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985388544 00000100:00100000:2.0:1746066812.890785:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985388544 00000100:00100000:2.0:1746066812.890814:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17213 00000100:00100000:2.0:1746066812.890819:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3308:x1830882985388544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066812.890837:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066812.890850:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73c4 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.890908:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.890916:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.890929:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.890938:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.890952:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.890954:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066812.890957:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.890963:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83a00, rc 0) 00000100:00100000:2.0:1746066812.891003:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3308:x1830882985388544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 183us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.891009:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17213 00000001:00080000:1.0:1746066812.895311:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937684 is committed 00000004:00080000:1.0:1746066812.895323:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1169 committed 00000004:00080000:1.0:1746066812.895370:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1160 committed 00000004:00080000:1.0:1746066812.895494:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1159 committed 00000004:00080000:1.0:1746066812.895497:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1158 committed 00000004:00080000:1.0:1746066812.895499:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1157 committed 00000004:00080000:1.0:1746066812.895500:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1168 committed 00000004:00080000:1.0:1746066812.895502:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1156 committed 00000004:00080000:1.0:1746066812.895503:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1167 committed 00000004:00080000:1.0:1746066812.895504:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1155 committed 00000004:00080000:1.0:1746066812.895506:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1166 committed 00000004:00080000:1.0:1746066812.895507:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1165 committed 00000004:00080000:1.0:1746066812.895509:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1164 committed 00000004:00080000:1.0:1746066812.895510:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1154 committed 00000004:00080000:1.0:1746066812.895512:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1153 committed 00000004:00080000:1.0:1746066812.895513:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1163 committed 00000004:00080000:1.0:1746066812.895515:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1162 committed 00000004:00080000:1.0:1746066812.895517:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1152 committed 00000001:00080000:1.0:1746066812.895523:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937683 is committed 00000001:00080000:1.0:1746066812.895535:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937679 is committed 00010000:00010000:1.0:1746066812.895609:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.895623:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.895626:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066812.895630:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.895645:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.895652:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.895676:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.895687:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091712:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066812.895806:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985091456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066812.895854:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066812.895899:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066812.895904:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985091968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066812.895920:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066812.895941:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985091456 00000100:00100000:0.0:1746066812.895946:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985091456 00000100:00100000:0.0:1746066812.895973:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985091968 00000100:00100000:0.0:1746066812.895974:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985091968 00000100:00100000:0.0:1746066812.895987:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20262 00000100:00100000:0.0:1746066812.895994:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985091456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896120:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985091584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066812.896141:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896156:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896170:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896178:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066812.896191:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896199:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985093248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066812.896212:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896223:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746066812.896226:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985091840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066812.896240:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896250:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896275:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896286:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896299:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896306:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985093376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896317:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066812.896334:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985093248 00000100:00100000:2.0:1746066812.896337:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985093248 00000100:00100000:2.0:1746066812.896348:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985091840 00000100:00100000:2.0:1746066812.896350:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985091840 00000100:00100000:2.0:1746066812.896355:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092352 00000100:00100000:2.0:1746066812.896357:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092352 00000100:00100000:2.0:1746066812.896362:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092864 00000100:00100000:2.0:1746066812.896364:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092864 00000100:00100000:2.0:1746066812.896369:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985093376 00000100:00100000:2.0:1746066812.896370:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985093376 00000100:00100000:2.0:1746066812.896379:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20265 00000100:00100000:2.0:1746066812.896383:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3774:x1830882985092096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066812.896433:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066812.896449:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066806 -> 1746066806 00002000:00010000:2.0:1746066812.896451:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:2.0:1746066812.896453:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066807 -> 1746066807 00002000:00010000:2.0:1746066812.896454:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066812.896469:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985092096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (299us total) trans 21474842693 rc 0/0 00000100:00100000:2.0:1746066812.896474:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20265 00000100:00100000:2.0:1746066812.896481:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20268 00000100:00100000:2.0:1746066812.896484:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882985091840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066812.896520:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066812.896522:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00002000:00010000:2.0:1746066812.896524:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066812 -> 1746066812 00002000:00010000:2.0:1746066812.896526:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:2.0:1746066812.896528:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066812.896544:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985091840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (303us total) trans 17179875342 rc 0/0 00000100:00100000:2.0:1746066812.896549:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20268 00000100:00100000:2.0:1746066812.896558:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20270 00000100:00100000:2.0:1746066812.896561:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985092864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896603:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985092864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (302us total) trans 21474842695 rc 0/0 00000100:00100000:2.0:1746066812.896607:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20270 00000004:00080000:2.0:1746066812.896647:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095869f80/2, rc 0, transno 17179875342 00000100:00100000:2.0:1746066812.896654:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985091840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066812.896662:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5962d80/2, rc 0, transno 21474842694 00000100:00100000:2.0:1746066812.896665:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066812.896670:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963480/2, rc 0, transno 21474842695 00000100:00100000:2.0:1746066812.896673:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066812.896678:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963b80/2, rc 0, transno 21474842696 00000100:00100000:2.0:1746066812.896681:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985093376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066812.896686:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d9b2680/2, rc 0, transno 17179875339 00000100:00100000:2.0:1746066812.896688:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985091584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066812.896694:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5962a00/2, rc 0, transno 21474842693 00000100:00100000:2.0:1746066812.896696:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066812.896702:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711180/2, rc 0, transno 17179875340 00000100:00100000:2.0:1746066812.896704:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985092736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066812.896745:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092480 00000100:00100000:2.0:1746066812.896749:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092480 00000100:00100000:2.0:1746066812.896761:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092992 00000100:00100000:2.0:1746066812.896763:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092992 00000100:00100000:2.0:1746066812.896770:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985093504 00000100:00100000:2.0:1746066812.896771:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985093504 00000100:00100000:2.0:1746066812.896780:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092224 00000100:00100000:2.0:1746066812.896781:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092224 00000100:00100000:2.0:1746066812.896786:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985092608 00000100:00100000:2.0:1746066812.896788:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985092608 00000100:00100000:2.0:1746066812.896795:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20272 00000100:00100000:2.0:1746066812.896799:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882985092480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066812.896841:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066812.896844:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066812.896846:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066812.896848:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066812.896850:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066812.896870:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3776:x1830882985092480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (185us total) trans 17179875343 rc 0/0 00000100:00100000:2.0:1746066812.896876:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20272 00000100:00100000:2.0:1746066812.896903:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20274 00000100:00100000:2.0:1746066812.896907:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985093504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.896958:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985093504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (229us total) trans 21474842697 rc 0/0 00000100:00100000:2.0:1746066812.896963:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20274 00000100:00100000:2.0:1746066812.896972:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20276 00000100:00100000:2.0:1746066812.896976:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985092608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066812.897022:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3776:x1830882985092608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (246us total) trans 21474842699 rc 0/0 00000100:00100000:2.0:1746066812.897029:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20276 00000100:00100000:1.0:1746066812.897139:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00002000:00010000:0.0:1746066812.897314:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066812.897317:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00002000:00010000:0.0:1746066812.897319:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066810 -> 1746066810 00002000:00010000:0.0:1746066812.897320:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:0.0:1746066812.897322:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066812.897340:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3777:x1830882985091456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1347us (1487us total) trans 21474842700 rc 0/0 00000100:00100000:0.0:1746066812.897346:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20262 00000004:00080000:0.0:1746066812.897496:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e437480/2, rc 0, transno 17179875338 00000100:00100000:0.0:1746066812.897500:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985091968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066812.897506:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5962680/2, rc 0, transno 21474842700 00000100:00100000:0.0:1746066812.897508:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985091456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066812.897602:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f712a00/2, rc 0, transno 17179875341 00000100:00100000:2.0:1746066812.897605:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985093248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066812.897651:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985387648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24653us (25687us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066812.897660:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7609 00002000:00100000:1.0:1746066812.897669:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012b1f4000 x1830882985387648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.897678:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1f4000 with x1830882985387648 ext(2097152->4194303) 00002000:00010000:1.0:1746066812.897682:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1f4000 00000100:00100000:1.0:1746066812.898735:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985091712:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066812.898778:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a400/0xf1867c21abfb0ffc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066812.898812:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.898840:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:0.0:1746066812.898865:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.898873:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3305:x1830882985388160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 21849us (22623us total) trans 8589937684 rc 0/0 00000100:00100000:1.0:1746066812.898879:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17212 00000100:00100000:1.0:1746066812.898925:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985388672 00000100:00100000:1.0:1746066812.898930:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985388672 00000100:00100000:1.0:1746066812.899096:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6475 00000100:00100000:1.0:1746066812.899103:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3308:x1830882985388672:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066812.899182:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3308:x1830882985388672:12345-192.168.204.16@tcp:49:cat.0 Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.899188:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6475 00000100:00100000:0.0:1746066812.913675:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.913720:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.913761:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985388928 00000100:00100000:1.0:1746066812.913770:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985388928 00000100:00100000:2.0:1746066812.913806:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985389184 00000100:00100000:2.0:1746066812.913809:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985389184 00002000:00100000:1.0:1746066812.913819:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c4a0e00 x1830882985388928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.913826:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88012c4a1500 x1830882985389184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.913828:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0e00 with x1830882985388928 ext(3145728->4194303) 00002000:00100000:2.0:1746066812.913832:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1500 with x1830882985389184 ext(3145728->4194303) 00002000:00010000:1.0:1746066812.913833:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0e00 00002000:00010000:2.0:1746066812.913835:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a1500 00000100:00100000:1.0:1746066812.913868:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7611 00000100:00100000:2.0:1746066812.913874:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7612 00000100:00100000:1.0:1746066812.913876:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985388928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066812.913877:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985389184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066812.923897:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.923924:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985389312 00000100:00100000:0.0:1746066812.923935:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985389312 00000100:00100000:0.0:1746066812.923978:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20279 00000100:00100000:0.0:1746066812.923987:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3305:x1830882985389312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066812.924006:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.924024:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73cb expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.924055:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7323 expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.924063:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d738c expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.924071:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d735b expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.924077:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.924079:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.924082:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.924125:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d735b expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.924137:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb0f8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d735b expref: 22 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.924149:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985093760:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.924245:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d738c expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.924253:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfb0fc4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d738c expref: 13 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.924261:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985093888:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.925501:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7323 expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.925518:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb0eeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7323 expref: 7 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.925526:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985094016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.925550:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066812.925911:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.925975:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985389440 00000100:00100000:0.0:1746066812.925981:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985389440 00000100:00100000:2.0:1746066812.925997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.926010:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20280 00000100:00100000:0.0:1746066812.926016:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:3304:x1830882985389440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066812.926027:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.926045:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73d2 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.926065:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9a00/0xf1867c21abfb0edd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7331 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926072:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d739a expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926078:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7369 expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926083:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.926084:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.926086:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1073152->1961983] (req 1073152->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.926102:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7369 expref: 35 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926109:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfb0f9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7369 expref: 35 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.926117:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985094144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.926118:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985388928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12243us (12452us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066812.926130:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7611 00002000:00100000:1.0:1746066812.926137:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c4a0e00 x1830882985388928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.926145:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0e00 with x1830882985388928 ext(3145728->4194303) 00002000:00010000:1.0:1746066812.926149:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0e00 00010000:00010000:0.0:1746066812.926158:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d739a expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926166:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfb0fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d739a expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.926173:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985094272:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.926197:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb9a00/0xf1867c21abfb0edd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7331 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.926205:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9a00/0xf1867c21abfb0edd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7331 expref: 9 pid: 12237 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.926213:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985094400:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.926232:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985093760:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.926232:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066812.927403:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.927448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.927672:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985389824 00000100:00100000:1.0:1746066812.927677:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985389824 00002000:00100000:1.0:1746066812.927706:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c69880 x1830882985389824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.927714:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69880 with x1830882985389824 ext(2097152->4194303) 00002000:00010000:1.0:1746066812.927718:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c69880 00000100:00100000:2.0:1746066812.927821:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.927954:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985093888:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.928175:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985390080 00000100:00100000:1.0:1746066812.928179:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985390080 00002000:00100000:1.0:1746066812.928194:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880093c69c00 x1830882985390080/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.928201:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69c00 with x1830882985390080 ext(3145728->4194303) 00002000:00010000:1.0:1746066812.928205:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69c00 00000100:00100000:1.0:1746066812.928478:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7614 00000100:00100000:1.0:1746066812.928485:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985390080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.930005:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985094016:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066812.930038:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.930052:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:0.0:1746066812.930090:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3305:x1830882985389312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6104us (6216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.930097:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20279 00000100:00100000:0.0:1746066812.931654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.931692:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.931715:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.931733:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.931756:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.931774:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985390848 00000100:00100000:0.0:1746066812.931779:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985390848 00000100:00100000:0.0:1746066812.931815:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20281 00000100:00100000:0.0:1746066812.931821:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985390848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066812.931838:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.931854:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfb101f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73d9 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.931874:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066812.931898:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfb101f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d9 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.931907:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfb101f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d9 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066812.931922:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a600, rc 0) 00000100:00100000:0.0:1746066812.931949:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985390848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (192us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066812.931954:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20281 00000100:00100000:1.0:1746066812.934786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.936419:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985390080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7933us (8983us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066812.936431:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7614 00002000:00100000:1.0:1746066812.936450:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880093c69c00 x1830882985390080/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.936459:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69c00 with x1830882985390080 ext(3145728->4194303) 00002000:00010000:1.0:1746066812.936464:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69c00 00000100:00100000:0.0:1746066812.939373:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.939730:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985391232 00000100:00100000:1.0:1746066812.939741:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985391232 00002000:00100000:1.0:1746066812.939786:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->1314815) req@ffff88012c4a3480 x1830882985391232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.939795:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3480 with x1830882985391232 ext(1310720->1314815) 00002000:00010000:1.0:1746066812.939800:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3480 00000100:00100000:2.0:1746066812.940115:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7615 00000100:00100000:2.0:1746066812.940125:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985391232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066812.940263:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985391232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 141us (905us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066812.940269:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7615 00002000:00100000:2.0:1746066812.940274:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->1314815) req@ffff88012c4a3480 x1830882985391232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:218/0 lens 488/4536 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.940287:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3480 with x1830882985391232 ext(1310720->1314815) 00002000:00010000:2.0:1746066812.940290:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3480 00000100:00100000:1.0:1746066812.941907:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.941958:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985391488 00000100:00100000:2.0:1746066812.941964:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985391488 00002000:00100000:2.0:1746066812.941990:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1073152->1077247) req@ffff88012d800a80 x1830882985391488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.941998:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800a80 with x1830882985391488 ext(1073152->1077247) 00002000:00010000:2.0:1746066812.942001:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800a80 00000100:00100000:2.0:1746066812.942014:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7616 00000100:00100000:2.0:1746066812.942024:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985391488:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066812.942116:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985391488:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 95us (210us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066812.942121:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7616 00002000:00100000:2.0:1746066812.942127:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1073152->1077247) req@ffff88012d800a80 x1830882985391488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/4536 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.942134:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800a80 with x1830882985391488 ext(1073152->1077247) 00002000:00010000:2.0:1746066812.942136:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800a80 00000100:00100000:1.0:1746066812.948919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.949296:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985391744 00000100:00100000:2.0:1746066812.949306:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985391744 00002000:00100000:2.0:1746066812.949354:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012d800e00 x1830882985391744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.949361:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800e00 with x1830882985391744 ext(4194304->4861951) 00002000:00010000:2.0:1746066812.949366:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800e00 00000100:00100000:2.0:1746066812.949390:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7617 00000100:00100000:2.0:1746066812.949396:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985391744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066812.950654:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.950686:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.950763:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.950833:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985392256 00000100:00100000:1.0:1746066812.950837:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985392256 00000100:00100000:1.0:1746066812.950875:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20284 00000100:00100000:1.0:1746066812.950895:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3305:x1830882985392256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066812.950908:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.950923:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73ee expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.950952:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 6 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.950960:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.950968:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.950975:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.950977:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066812.950980:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.951010:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.951021:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 19 pid: 3528 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066812.951034:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985094912:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.951103:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.951112:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066812.951120:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095040:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.951147:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 6 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.951159:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 6 pid: 20361 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066812.951166:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095168:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.951186:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.951248:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985392000 00000100:00100000:1.0:1746066812.951251:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985392000 00002000:00100000:1.0:1746066812.951351:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x81:0x0] (1957888->1961983) req@ffff88012c4a3800 x1830882985392000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1746066823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.951360:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3800 with x1830882985392000 ext(1957888->1961983) 00002000:00010000:1.0:1746066812.951363:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a3800 00000100:00100000:1.0:1746066812.951383:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7618 00000100:00100000:1.0:1746066812.951393:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985392000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066812.951499:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985392000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 106us (849us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066812.951506:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7618 00002000:00100000:1.0:1746066812.951511:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x81:0x0] (1957888->1961983) req@ffff88012c4a3800 x1830882985392000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/4536 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066812.951518:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3800 with x1830882985392000 ext(1957888->1961983) 00002000:00010000:1.0:1746066812.951521:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a3800 00000100:00100000:0.0:1746066812.954111:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.954142:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985094912:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.954142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.954153:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.954175:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095168:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.954191:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066812.954206:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066812.954211:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985392512 00000100:00100000:0.0:1746066812.954216:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985392512 00010000:00010000:1.0:1746066812.954222:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31c00, rc 0) 00010000:00010000:0.0:1746066812.954240:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 20 pid: 3528 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.954257:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985392384 00000100:00100000:1.0:1746066812.954259:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3305:x1830882985392256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3379us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.954259:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985392384 00000100:00100000:1.0:1746066812.954266:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20284 00010000:00010000:0.0:1746066812.954266:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 14 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.954275:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985392640 00000100:00100000:0.0:1746066812.954276:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985392640 00010000:00010000:0.0:1746066812.954283:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 7 pid: 20361 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066812.954301:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9280 00000100:00100000:0.0:1746066812.954307:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985392512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066812.954318:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066812.954334:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 20 pid: 3528 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066812.954343:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 20 pid: 3528 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066812.954363:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0dc00/0xf1867c21abfb0f93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7362 expref: 20 pid: 3528 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066812.954377:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066812.954394:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985392512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.954400:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9280 00000100:00100000:0.0:1746066812.954410:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9281 00000100:00100000:0.0:1746066812.954415:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985392384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066812.954421:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066812.954428:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066812.954451:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066812.954462:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb0fcb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7393 expref: 13 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066812.954472:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9282 00010000:00010000:0.0:1746066812.954476:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066812.954479:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985392640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066812.954489:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066812.954491:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985392384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066812.954497:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9281 00010000:00010000:2.0:1746066812.954498:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 7 pid: 20361 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066812.954507:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 7 pid: 20361 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066812.954518:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb0ef9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d732a expref: 7 pid: 20361 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066812.954531:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.954533:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066812.954539:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.954546:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.954574:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.954585:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985095424:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066812.954656:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066812.954719:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985391744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5322us (5812us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066812.954725:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7617 00002000:00100000:2.0:1746066812.954733:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012d800e00 x1830882985391744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1746066823 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066812.954741:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800e00 with x1830882985391744 ext(4194304->4861951) 00002000:00010000:2.0:1746066812.954744:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800e00 00000100:00100000:0.0:1746066812.956662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.956741:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985095424:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066812.956757:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066812.956800:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985392640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2321us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.956808:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9282 00000100:00100000:0.0:1746066812.957958:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.958000:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.958476:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20285 00000100:00100000:1.0:1746066812.958485:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985393024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.958498:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.958516:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1042 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d73f5 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.958559:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095680:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066812.959225:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066812.959724:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.959766:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.959814:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985393664 00000100:00100000:2.0:1746066812.959818:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985393664 00000100:00100000:2.0:1746066812.959862:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6476 00000100:00100000:2.0:1746066812.959869:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3305:x1830882985393664:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066812.960281:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3305:x1830882985393664:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 412us (513us total) trans 8589937685 rc 0/0 00000100:00100000:2.0:1746066812.960287:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6476 00002000:00010000:1.0:1746066812.960353:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066812 -> 1746066813 00002000:00010000:1.0:1746066812.960356:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066810 -> 1746066813 00002000:00010000:1.0:1746066812.960358:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066812 -> 1746066813 00000100:00100000:1.0:1746066812.960371:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095680:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066812.960393:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1042 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73f5 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.960409:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1042 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73f5 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.960424:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:1.0:1746066812.960467:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985393024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1984us (2509us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066812.960473:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20285 00000100:00100000:0.0:1746066812.966232:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.966266:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.966311:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985393792 00000100:00100000:1.0:1746066812.966318:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985393792 00000100:00100000:1.0:1746066812.966536:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20288 00000100:00100000:1.0:1746066812.966542:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985393792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066812.966549:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.966556:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7800/0xf1867c21abfb1050 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7403 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.966584:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095936:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066812.966903:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066812.969903:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.969968:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394048 00000100:00100000:0.0:1746066812.969977:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394048 00000100:00100000:0.0:1746066812.970020:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20289 00000100:00100000:0.0:1746066812.970028:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985394048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066812.970045:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066812.970064:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfb1057 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7411 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.970117:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985095936:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066812.970121:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985096064:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066812.970143:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7800/0xf1867c21abfb1050 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7403 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.970155:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7800/0xf1867c21abfb1050 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7403 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.970168:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7800, rc 0) 00000100:00100000:0.0:1746066812.970182:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.970193:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985393792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3650us (3961us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066812.970203:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20288 00002000:00010000:2.0:1746066812.971297:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066812 -> 1746066813 00002000:00010000:2.0:1746066812.971302:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066812 -> 1746066813 00000100:00100000:2.0:1746066812.971314:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985096064:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066812.971337:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfb1057 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7411 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.971346:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfb1057 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7411 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.971368:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589b800, rc 0) 00000100:00100000:2.0:1746066812.971404:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985394048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1376us (1526us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066812.971409:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20289 00000100:00100000:0.0:1746066812.973741:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.973833:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394176 00000100:00100000:2.0:1746066812.973844:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394176 00000100:00100000:2.0:1746066812.973977:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20290 00000100:00100000:2.0:1746066812.973985:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985394176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066812.974008:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066812.974026:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b33000/0xf1867c21abfb105e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7418 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066812.974078:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985096192:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066812.974152:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066812.975458:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985096192:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066812.975485:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b33000/0xf1867c21abfb105e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7418 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.975497:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b33000/0xf1867c21abfb105e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7418 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066812.975515:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33000, rc 0) 00000100:00100000:2.0:1746066812.975563:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985394176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1577us (1827us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066812.975570:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20290 00000100:00100000:0.0:1746066812.977195:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.977268:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394304 00000100:00100000:1.0:1746066812.977277:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394304 00000100:00100000:1.0:1746066812.977331:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17214 00000100:00100000:1.0:1746066812.977338:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+6:3312:x1830882985394304:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066812.977362:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.977381:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6000/0xf1867c21abfb1065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d741f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.977451:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977463:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977473:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977484:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977489:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977494:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977564:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977572:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.977580:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.977608:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.977617:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 28 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066812.977628:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985096320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.977709:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.979327:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985096320:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066812.979333:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066812.979346:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066812.979413:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394560 00000100:00100000:2.0:1746066812.979422:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394560 00000100:00100000:2.0:1746066812.979485:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6477 00000100:00100000:2.0:1746066812.979494:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:30848:x1830882985394560:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066812.979680:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:30848:x1830882985394560:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 186us (346us total) trans 8589937686 rc 0/0 00000100:00100000:2.0:1746066812.979687:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6477 00000100:00100000:0.0:1746066812.981873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.981980:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394688 00000100:00100000:2.0:1746066812.981986:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394688 00010000:00010000:2.0:1746066812.982020:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 30 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066812.982060:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9283 00000100:00100000:2.0:1746066812.982067:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985394688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066812.982081:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066812.982088:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 30 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.982100:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 30 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.982130:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfb0fbd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d737e expref: 30 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.982224:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.982229:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.982239:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.982245:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.982273:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066812.982333:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982343:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066812.982403:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:1.0:1746066812.982408:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066812.982427:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982448:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982459:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982465:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982470:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982476:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982482:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c6800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066812.982485:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982492:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982501:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066812.982504:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066812.982507:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982511:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb106c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066812.982767:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985394688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 698us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.982774:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9283 00010000:00010000:1.0:1746066812.982833:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982839:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982844:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982848:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c7200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066812.982851:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982855:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982863:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfd200) 00010000:00010000:1.0:1746066812.982865:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066812.982867:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982871:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7200/0xf1867c21abfb1073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.982919:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6000/0xf1867c21abfb1065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.982931:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.982937:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066812.982939:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066812.982941:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00000100:00100000:1.0:1746066812.982980:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3312:x1830882985394304:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5642us (5792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066812.982986:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17214 00000100:00100000:0.0:1746066812.985097:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.985189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066812.985227:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.985291:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985394816 00000100:00100000:1.0:1746066812.985299:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985394816 00000100:00100000:1.0:1746066812.985330:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985395072 00000100:00100000:1.0:1746066812.985333:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985395072 00000100:00100000:1.0:1746066812.985961:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20292 00000100:00100000:1.0:1746066812.985969:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985394944:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066812.985992:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.986009:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6600/0xf1867c21abfb1081 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d742d expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066812.986057:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985096448:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066812.986794:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.988580:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985096448:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066812.988606:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6600/0xf1867c21abfb1081 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d742d expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.988619:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6600/0xf1867c21abfb1081 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d742d expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066812.988629:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6600, rc 0) 00000100:00100000:1.0:1746066812.988990:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985394944:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3020us (3799us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066812.988996:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20292 00000100:00100000:0.0:1746066812.991464:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066812.991665:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985395328 00000100:00100000:1.0:1746066812.991674:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985395328 00000100:00100000:1.0:1746066812.991726:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17215 00000100:00100000:1.0:1746066812.991735:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3312:x1830882985395328:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066812.991754:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066812.991771:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb1096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d743b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.991879:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.991917:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.991924:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066812.991953:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066812.991964:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066812.991976:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985096832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066812.992142:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066812.994284:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985096832:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066812.994305:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066812.994474:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.994643:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985395456 00000100:00100000:2.0:1746066812.994651:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985395456 00010000:00010000:2.0:1746066812.994679:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066812.994723:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9284 00000100:00100000:2.0:1746066812.994731:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985395456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066812.994744:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066812.994750:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.994765:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.994786:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb107a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d741f expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066812.995013:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.995018:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.995027:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.995033:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.995118:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066812.995165:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985395456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 434us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066812.995171:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9284 00010000:00010000:0.0:1746066812.995210:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066812.995216:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066812.995233:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066812.995349:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb1096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d743b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.995364:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d743b expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066812.995370:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066812.995372:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066812.995374:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7400, rc 0) 00000100:00100000:0.0:1746066812.995394:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985395328:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3661us (3938us total) trans 8589937687 rc 0/0 00000100:00100000:0.0:1746066812.995399:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17215 00000100:00100000:0.0:1746066812.997483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066812.997619:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985395712 00000100:00100000:2.0:1746066812.997626:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985395712 00000100:00100000:2.0:1746066812.997673:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17216 00000100:00100000:2.0:1746066812.997680:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985395712:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066812.997701:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066812.997708:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066812.997729:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7400/0xf1867c21abfb109d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d743b expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.997749:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.997753:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066812.997762:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33a00/0xf1867c21abfb10ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7442 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.997852:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb10b2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.997863:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb10b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066812.997871:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb10b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066812.997880:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066812.997995:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33a00/0xf1867c21abfb10ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7442 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.998007:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb10b2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7442 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066812.998012:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066812.998014:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066812.998016:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33800, rc 0) 00000100:00100000:2.0:1746066812.998065:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3312:x1830882985395712:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 385us (590us total) trans 8589937688 rc 0/0 00000100:00100000:2.0:1746066812.998070:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17216 00000100:00100000:0.0:1746066812.999801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.000217:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985395840 00000100:00100000:2.0:1746066813.000225:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985395840 00000100:00100000:2.0:1746066813.000271:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17217 00000100:00100000:2.0:1746066813.000279:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3312:x1830882985395840:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.000300:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.000314:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb10c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7449 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.000360:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb10c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7449 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.000369:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb10c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7449 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.000384:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.000387:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066813.000391:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33000, rc 0) 00000100:00100000:2.0:1746066813.000426:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3312:x1830882985395840:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 148us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.000431:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17217 00000100:00100000:0.0:1746066813.002190:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.002920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.002939:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.002953:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.002969:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396096 00000100:00100000:1.0:1746066813.002972:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396096 00000100:00100000:1.0:1746066813.002991:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396352 00000100:00100000:1.0:1746066813.002993:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396352 00000100:00100000:1.0:1746066813.003005:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396608 00000100:00100000:1.0:1746066813.003006:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396608 00000100:00100000:0.0:1746066813.003068:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20295 00000100:00100000:0.0:1746066813.003075:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985396096:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066813.003097:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003108:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003114:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066813.003115:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066813.003117:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003133:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003141:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 11 pid: 1893 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746066813.003151:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985097216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.003168:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20296 00000100:00100000:1.0:1746066813.003174:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985396352:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:0.0:1746066813.003183:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20297 00000100:00100000:0.0:1746066813.003187:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985396608:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066813.003190:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.003199:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003199:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.003205:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066813.003206:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066813.003208:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003208:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 7 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.003215:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a8 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.003220:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.003222:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.003227:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 32 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.003228:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.003229:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.003231:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.003235:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985097472:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066813.003243:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.003251:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 18 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.003255:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.003258:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.003274:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066813.003279:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a8 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.003286:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb0fe0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a8 expref: 11 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.003293:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097728:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.003314:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066813.003314:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 7 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.003325:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 7 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.003333:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.003347:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.003545:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396224 00000100:00100000:2.0:1746066813.003549:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396224 00000100:00100000:2.0:1746066813.003567:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396480 00000100:00100000:2.0:1746066813.003569:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396480 00000100:00100000:2.0:1746066813.003582:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20298 00000100:00100000:2.0:1746066813.003587:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985396224:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066813.003605:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003614:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003621:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066813.003623:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066813.003624:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003639:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003647:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 11 pid: 9590 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.003654:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985097984:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.003679:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.003693:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20299 00000100:00100000:2.0:1746066813.003700:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985396480:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066813.003715:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3600/0xf1867c21abfb10ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003724:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003729:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a1 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003736:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003742:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.003743:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.003744:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3600/0xf1867c21abfb10ea lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.003758:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003765:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 32 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.003772:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985098112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.003797:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a1 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003805:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2400/0xf1867c21abfb0fd9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73a1 expref: 10 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.003812:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985098240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.003833:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.003840:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 11 pid: 12237 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.003852:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985098368:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.003877:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.005341:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.005371:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.005406:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396864 00000100:00100000:2.0:1746066813.005618:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396864 00010000:00010000:2.0:1746066813.005644:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.005667:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396736 00000100:00100000:2.0:1746066813.005669:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396736 00000100:00080000:2.0:1746066813.005685:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746066813.005695:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb0f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7354 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.005715:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9285 00000100:00100000:2.0:1746066813.005721:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985396864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.005731:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.005750:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.005761:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.005784:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0c00/0xf1867c21abfb0fb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7385 expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.005813:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.005845:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985396864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.005851:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9285 00000100:00100000:2.0:1746066813.005865:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9286 00000100:00100000:2.0:1746066813.005870:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985396736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.005875:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066813.006295:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.006475:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb0f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7354 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.006488:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb0f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7354 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.006495:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.006499:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb0f85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7354 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.006509:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.006528:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985396736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 658us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.006534:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9286 00000100:00100000:1.0:1746066813.006539:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985097472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.006544:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985396992 00000100:00100000:2.0:1746066813.006547:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985396992 00010000:00010000:1.0:1746066813.006554:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.006556:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.006912:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9287 00000100:00100000:2.0:1746066813.006918:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985396992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.006925:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.006933:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.006942:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.006953:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb0ee4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d731c expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.006962:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066813.006963:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097600:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.006964:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.006968:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1800/0xf1867c21abfb10c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.006975:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1800/0xf1867c21abfb10c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.006992:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.007011:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985396992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.007016:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9287 00000100:00100000:0.0:1746066813.008043:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097728:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.008431:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985097984:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.008456:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.008471:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.008489:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985397504 00000100:00100000:2.0:1746066813.008493:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985397504 00010000:00010000:2.0:1746066813.008511:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 9 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.008529:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9288 00000100:00100000:2.0:1746066813.008536:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985397504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.008544:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.008556:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 9 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.008564:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 9 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.008579:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.008599:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985397504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.008605:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9288 00010000:00010000:0.0:1746066813.008642:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb0f00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d733f expref: 8 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.008657:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985097856:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066813.008676:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.010880:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.010934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.010951:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985397376 00000100:00100000:2.0:1746066813.010957:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985397376 00010000:00010000:2.0:1746066813.011107:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 19 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.011131:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9289 00000100:00100000:2.0:1746066813.011138:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985397376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.011150:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.011165:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 19 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011176:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 19 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011193:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfb0fa8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7377 expref: 19 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011208:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.011249:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985397376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.011255:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9289 00000100:00080000:2.0:1746066813.011297:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066813.011318:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.011363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.011413:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.011421:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985397888 00000100:00100000:2.0:1746066813.011424:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985397888 00010000:00010000:2.0:1746066813.011447:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 10 pid: 12237 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.011468:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9291 00000100:00100000:2.0:1746066813.011473:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985397888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.011479:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.011491:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 10 pid: 12237 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011503:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 10 pid: 12237 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011515:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb0ef2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7338 expref: 10 pid: 12237 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011524:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.011538:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985397888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.011543:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9291 00000100:00100000:2.0:1746066813.011576:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.011584:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398016 00000100:00100000:2.0:1746066813.011587:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398016 00010000:00010000:2.0:1746066813.011595:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.011606:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9292 00000100:00100000:2.0:1746066813.011610:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985398016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.011614:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.011619:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011626:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011639:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfb0fa1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7370 expref: 33 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.011647:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.011665:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985398016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.011669:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9292 00010000:00010000:0.0:1746066813.011743:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011751:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011766:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011773:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011779:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011785:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589a200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066813.011788:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011794:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011805:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.011810:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb10dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.011936:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.012183:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985396608:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 8993us (9227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.012191:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20297 00002000:00010000:3.0:1746066813.017843:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f760e00 00000100:00100000:0.0:1746066813.018315:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985397632:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7135us (7439us total) trans 21474842701 rc 0/0 00000100:00100000:0.0:1746066813.018322:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2185 00002000:00100000:0.0:1746066813.018328:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1073151) req@ffff880093c6a300 x1830882985397632/t21474842701(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.018336:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6a300 with x1830882985397632 ext(1048576->1073151) 00010000:00010000:0.0:1746066813.018341:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.018349:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00002000:00010000:0.0:1746066813.018355:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c6a300 00000100:00100000:2.0:1746066813.019919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.020074:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398272 00000100:00100000:3.0:1746066813.020083:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398272 00010000:00010000:3.0:1746066813.020142:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.020176:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9294 00000100:00100000:3.0:1746066813.020184:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985398272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066813.020195:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.020198:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.020221:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.020232:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.020254:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfb102d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73ee expref: 15 pid: 9590 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.020268:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066813.020268:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398400 00010000:00010000:3.0:1746066813.020270:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.020275:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.020275:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398400 00010000:00010000:3.0:1746066813.020282:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020304:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.020305:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 15 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.020313:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.020322:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.020333:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9295 00000100:00100000:3.0:1746066813.020337:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985398272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (429us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066813.020338:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.020341:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985398400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.020344:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.020347:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9294 00010000:00010000:0.0:1746066813.020351:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.020353:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.020358:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066813.020361:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.020370:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 14 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.020374:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.020380:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 14 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.020385:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.020391:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb10e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.020402:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb1011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73cb expref: 14 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.020426:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.020428:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.020442:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.020447:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985396224:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 16844us (17157us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066813.020449:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.020455:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20298 00010000:00010000:2.0:1746066813.020477:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.020507:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985398400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.020513:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9295 00010000:00010000:3.0:1746066813.020706:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020714:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020726:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020731:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020737:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020742:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589ae00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066813.020745:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020751:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020760:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.020765:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589ae00/0xf1867c21abfb10ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.020818:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+5:2015:x1830882985396096:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 17744us (17898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.020824:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20295 00000100:00100000:3.0:1746066813.025605:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985397248:12345-192.168.204.16@tcp:4:cat.0 Request processed in 13990us (14233us total) trans 17179875347 rc 0/0 00000100:00100000:3.0:1746066813.025617:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2186 00002000:00100000:3.0:1746066813.025629:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1073152->1961983) req@ffff880093c6b480 x1830882985397248/t17179875347(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.025638:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b480 with x1830882985397248 ext(1073152->1961983) 00010000:00010000:3.0:1746066813.025647:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.025660:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00002000:00010000:3.0:1746066813.025666:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c6b480 00000100:00100000:0.0:1746066813.028969:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.029100:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398528 00000100:00100000:2.0:1746066813.029109:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398528 00010000:00010000:2.0:1746066813.029139:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.029175:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9296 00000100:00100000:2.0:1746066813.029182:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985398528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.029204:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.029223:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.029234:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.029258:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfb1018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73d2 expref: 33 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.029271:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.029273:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.029277:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.029284:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.029311:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066813.029332:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029341:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.029352:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985398528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 169us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066813.029356:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.029359:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9296 00010000:00010000:1.0:1746066813.029362:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029369:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029374:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c7e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066813.029378:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029384:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029396:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.029401:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7e00/0xf1867c21abfb10d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.029456:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985396352:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 26281us (26514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.029463:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20296 00000100:00100000:0.0:1746066813.031390:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.031516:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398784 00000100:00100000:2.0:1746066813.031524:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398784 00000100:00100000:2.0:1746066813.031577:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17218 00000100:00100000:2.0:1746066813.031584:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3312:x1830882985398784:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:2.0:1746066813.031620:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.031638:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb10c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7449 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.031652:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.031655:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.031674:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.031684:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.031690:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.031695:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.031716:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.031726:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 28 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.031737:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985098496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.031829:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.031837:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.031845:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985098624:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.031864:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.033765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.033862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.033865:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985398912 00000100:00100000:3.0:1746066813.033872:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985398912 00010000:00010000:3.0:1746066813.033924:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 29 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.033945:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399040 00000100:00100000:3.0:1746066813.033947:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399040 00010000:00010000:3.0:1746066813.033953:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.033969:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9297 00000100:00100000:3.0:1746066813.033974:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985398912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1746066813.033974:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746066813.033982:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.033985:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 29 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.033991:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 29 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.034003:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.034005:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.034010:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.034020:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb100a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73c4 expref: 29 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.034039:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985398912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.034044:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9297 00000100:00100000:2.0:1746066813.034044:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985098496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.034055:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9298 00000100:00100000:2.0:1746066813.034056:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985098624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.034058:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985399040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.034062:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.034065:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.034070:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.034089:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.034175:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb1003 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d73bd expref: 10 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.034184:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.034186:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.034190:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.034194:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.034272:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.034291:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985399040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 232us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.034295:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9298 00010000:00010000:2.0:1746066813.034382:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.034388:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:2.0:1746066813.034642:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1184, 88 off111776 00000004:00080000:2.0:1746066813.034650:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245765766ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034680:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1195, 88 off112656 00000004:00080000:2.0:1746066813.034685:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245801315ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034716:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1196, 88 off112744 00000004:00080000:2.0:1746066813.034720:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245836266ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034728:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1185, 88 off111864 00000004:00080000:2.0:1746066813.034731:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245847521ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034738:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1186, 88 off111952 00000004:00080000:2.0:1746066813.034740:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245856698ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034747:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1197, 88 off112832 00000004:00080000:2.0:1746066813.034749:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245865865ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034755:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1198, 88 off112920 00000004:00080000:2.0:1746066813.034758:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245874458ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034764:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1199, 88 off113008 00000004:00080000:2.0:1746066813.034767:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245883938ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034774:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1187, 88 off112040 00000004:00080000:2.0:1746066813.034778:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245894603ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034784:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1200, 88 off113096 00000004:00080000:2.0:1746066813.034787:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245903618ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034793:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1188, 88 off112128 00000004:00080000:2.0:1746066813.034795:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245912231ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034802:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1201, 88 off113184 00000004:00080000:2.0:1746066813.034804:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245920851ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.034810:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1189, 88 off112216 00000004:00080000:2.0:1746066813.034812:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245929265ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034819:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1190, 88 off112304 00000004:00080000:2.0:1746066813.034821:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245937865ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034827:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1191, 88 off112392 00000004:00080000:2.0:1746066813.034829:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245946278ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034836:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1192, 88 off112480 00000004:00080000:2.0:1746066813.034838:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781245955205ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.034864:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1202, 88 off113272 00000004:00080000:2.0:1746066813.034868:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781245985076ns, next at 733263917711ns, rc = 0 00000001:00080000:1.0:1746066813.036912:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937689 is committed 00000004:00080000:1.0:1746066813.036922:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1177 committed 00000004:00080000:1.0:1746066813.036935:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1169 committed 00000004:00080000:1.0:1746066813.036946:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1168 committed 00000004:00080000:1.0:1746066813.036948:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1167 committed 00000004:00080000:1.0:1746066813.036949:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1166 committed 00000004:00080000:1.0:1746066813.036950:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1176 committed 00000004:00080000:1.0:1746066813.036952:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1165 committed 00000004:00080000:1.0:1746066813.036954:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1175 committed 00000004:00080000:1.0:1746066813.036956:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1164 committed 00000004:00080000:1.0:1746066813.036957:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1174 committed 00000004:00080000:1.0:1746066813.036959:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1173 committed 00000004:00080000:1.0:1746066813.036961:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1172 committed 00000004:00080000:1.0:1746066813.036962:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1163 committed 00000004:00080000:1.0:1746066813.036964:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1162 committed 00000004:00080000:1.0:1746066813.036965:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1171 committed 00000004:00080000:1.0:1746066813.036967:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1170 committed 00000004:00080000:1.0:1746066813.036971:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1161 committed 00000001:00080000:1.0:1746066813.036979:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937686 is committed 00000001:00080000:1.0:1746066813.036983:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937685 is committed 00000100:00100000:3.0:1746066813.037091:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985098880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.037140:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985098752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037141:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037169:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985099392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037183:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037206:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985099904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.037220:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746066813.037221:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e420e00 reply state ffff880096567800 transno 8589937689 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066813.037236:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985100416:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066813.037239:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.037247:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:3.0:1746066813.037248:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066813.037250:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066813.037254:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746066813.037268:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985099008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.037274:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037293:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.037302:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985099264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037308:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985099648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037337:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037349:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985100032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.037357:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985099136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037369:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985100544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.037384:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037404:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985098880 00000100:00100000:3.0:1746066813.037410:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985098880 00000100:00100000:1.0:1746066813.037414:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985099520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.037448:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037455:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099392 00000100:00100000:3.0:1746066813.037458:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099392 00000100:00100000:1.0:1746066813.037463:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985100160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.037467:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099904 00000100:00100000:3.0:1746066813.037469:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099904 00000100:00100000:3.0:1746066813.037477:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100416 00000100:00100000:3.0:1746066813.037479:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100416 00000100:00100000:1.0:1746066813.037479:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037485:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985098752 00000100:00100000:1.0:1746066813.037485:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985100672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.037486:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985098752 00000100:00100000:3.0:1746066813.037492:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099008 00000100:00100000:3.0:1746066813.037494:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099008 00000100:00100000:3.0:1746066813.037498:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099648 00000100:00100000:1.0:1746066813.037498:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.037500:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099648 00000100:00100000:3.0:1746066813.037505:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100032 00000100:00100000:3.0:1746066813.037507:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100032 00000100:00100000:3.0:1746066813.037511:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099136 00000100:00100000:3.0:1746066813.037513:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099136 00000100:00100000:3.0:1746066813.037519:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099520 00000100:00100000:1.0:1746066813.037520:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100160 00000100:00100000:3.0:1746066813.037521:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099520 00000100:00100000:1.0:1746066813.037525:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100160 00000100:00100000:3.0:1746066813.037527:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100672 00000100:00100000:3.0:1746066813.037529:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100672 00000100:00100000:3.0:1746066813.037536:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20300 00000100:00100000:3.0:1746066813.037542:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882985098880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.037548:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20301 00000100:00100000:1.0:1746066813.037554:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882985099392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.037683:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985099392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (497us total) trans 21474842703 rc 0/0 00000100:00100000:1.0:1746066813.037689:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20301 00000100:00100000:1.0:1746066813.037704:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20302 00000100:00100000:1.0:1746066813.037709:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882985099904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.037783:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882985099904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (561us total) trans 17179875348 rc 0/0 00000100:00100000:1.0:1746066813.037789:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20302 00000100:00100000:1.0:1746066813.037798:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20303 00000100:00100000:1.0:1746066813.037803:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882985100416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.037842:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985098880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (700us total) trans 21474842704 rc 0/0 00000100:00100000:3.0:1746066813.037848:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20300 00000100:00100000:1.0:1746066813.037856:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882985100416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (606us total) trans 17179875349 rc 0/0 00000100:00100000:3.0:1746066813.037863:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20304 00000100:00100000:3.0:1746066813.037867:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985098752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.037907:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.037921:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985099776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.037943:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3774:x1830882985098752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (669us total) trans 21474842705 rc 0/0 00000100:00100000:2.0:1746066813.037943:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.037951:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985100288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.037977:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066813.038003:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f2680/2, rc 0, transno 21474842705 00000100:00100000:2.0:1746066813.038007:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985098752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.038054:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099264 00000100:00100000:0.0:1746066813.038057:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099264 00000100:00100000:2.0:1746066813.038132:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985099776 00000100:00100000:2.0:1746066813.038135:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985099776 00000100:00100000:1.0:1746066813.038492:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20303 00000100:00100000:1.0:1746066813.038514:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100288 00000100:00100000:1.0:1746066813.038517:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100288 00000100:00100000:1.0:1746066813.038529:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20305 00000100:00100000:1.0:1746066813.038534:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882985099008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.038606:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882985099008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1312us total) trans 21474842706 rc 0/0 00000100:00100000:1.0:1746066813.038611:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20305 00000100:00100000:1.0:1746066813.038621:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20306 00000100:00100000:1.0:1746066813.038626:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882985099648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.038673:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882985099648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1334us total) trans 21474842707 rc 0/0 00000100:00100000:1.0:1746066813.038678:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20306 00000100:00100000:1.0:1746066813.038687:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20307 00000100:00100000:1.0:1746066813.038691:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985100032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.038739:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882985100032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (1378us total) trans 17179875350 rc 0/0 00000100:00100000:1.0:1746066813.038744:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20307 00000100:00100000:1.0:1746066813.038752:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20308 00000100:00100000:1.0:1746066813.038757:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882985099136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.038806:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882985099136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (1421us total) trans 21474842708 rc 0/0 00000100:00100000:1.0:1746066813.038811:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20308 00000100:00100000:1.0:1746066813.038819:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20309 00000100:00100000:1.0:1746066813.038824:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882985099520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.038879:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3777:x1830882985099520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (1431us total) trans 17179875351 rc 0/0 00000100:00100000:1.0:1746066813.038899:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20309 00000100:00100000:1.0:1746066813.038908:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20310 00000100:00100000:1.0:1746066813.038912:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882985100672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066813.038951:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066813.038954:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.038956:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066813.038958:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.038961:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066813.038976:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3777:x1830882985100672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1477us total) trans 17179875352 rc 0/0 00000100:00100000:1.0:1746066813.038981:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20310 00000100:00100000:1.0:1746066813.038989:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20311 00000100:00100000:1.0:1746066813.038993:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882985100160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.039039:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882985100160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1559us total) trans 21474842709 rc 0/0 00000100:00100000:1.0:1746066813.039044:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20311 00000100:00100000:1.0:1746066813.039052:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20312 00000100:00100000:1.0:1746066813.039056:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882985100288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066813.039086:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:1.0:1746066813.039089:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.039090:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066813.039092:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.039095:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066813.039115:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882985100288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (1137us total) trans 17179875353 rc 0/0 00000100:00100000:1.0:1746066813.039120:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20312 00000100:00100000:1.0:1746066813.039134:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066813.039160:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1f80/2, rc 0, transno 21474842706 00000100:00100000:1.0:1746066813.039163:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985099008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039171:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493480/2, rc 0, transno 21474842707 00000100:00100000:1.0:1746066813.039174:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985099648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039182:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83480/2, rc 0, transno 17179875350 00000100:00100000:1.0:1746066813.039188:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985100032:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.039204:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81880/2, rc 0, transno 17179875349 00000100:00100000:1.0:1746066813.039207:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985100416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.039215:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0e00/2, rc 0, transno 21474842704 00000100:00100000:1.0:1746066813.039218:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985098880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039225:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491f80/2, rc 0, transno 21474842703 00000100:00100000:1.0:1746066813.039228:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985099392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039234:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d82a00/2, rc 0, transno 17179875348 00000100:00100000:1.0:1746066813.039237:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985099904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.039249:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f2a00/2, rc 0, transno 21474842708 00000100:00100000:1.0:1746066813.039251:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985099136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039257:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420380/2, rc 0, transno 17179875351 00000100:00100000:1.0:1746066813.039260:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985099520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.039267:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492d80/2, rc 0, transno 21474842709 00000100:00100000:1.0:1746066813.039270:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985100160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.039276:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802300/2, rc 0, transno 17179875352 00000100:00100000:1.0:1746066813.039278:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985100672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.039290:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100544 00000100:00100000:1.0:1746066813.039293:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100544 00000100:00100000:1.0:1746066813.039304:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20313 00000100:00100000:1.0:1746066813.039308:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882985100544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.039359:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882985100544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (224us total) trans 17179875354 rc 0/0 00000100:00100000:1.0:1746066813.039364:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20313 00000004:00080000:1.0:1746066813.039384:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800380/2, rc 0, transno 17179875354 00000100:00100000:1.0:1746066813.039387:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985100544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.039465:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20304 00000100:00100000:0.0:1746066813.039536:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20314 00000100:00100000:2.0:1746066813.039543:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20315 00000100:00100000:0.0:1746066813.039546:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3774:x1830882985099264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.039550:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882985099776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.039624:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882985099776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1680us total) trans 17179875355 rc 0/0 00000100:00100000:2.0:1746066813.039630:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20315 00000100:00100000:0.0:1746066813.039637:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882985099264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1729us total) trans 21474842710 rc 0/0 00000100:00100000:0.0:1746066813.039642:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20314 00000100:00080000:2.0:1746066813.039650:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746066813.039654:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746066813.039672:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491880/2, rc 0, transno 21474842710 00000100:00100000:2.0:1746066813.039676:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985099264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.039685:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80a80/2, rc 0, transno 17179875355 00000100:00100000:2.0:1746066813.039688:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985099776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066813.039696:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83b80/2, rc 0, transno 17179875353 00000100:00100000:2.0:1746066813.039699:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985100288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.039709:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985100800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.039730:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.039767:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100800 00000100:00100000:1.0:1746066813.039771:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100800 00000100:00100000:1.0:1746066813.039786:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20316 00000100:00100000:1.0:1746066813.039790:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882985100800:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746066813.039816:0:7245:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066813.039829:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985398784:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 8244us (8445us total) trans 8589937689 rc 0/0 00000100:00100000:2.0:1746066813.039835:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17218 00000100:00100000:1.0:1746066813.039848:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985100800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (117us total) trans 17179875356 rc 0/0 00000100:00100000:1.0:1746066813.039854:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20316 00010000:00010000:2.0:1746066813.039856:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.039865:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.039872:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00000004:00080000:1.0:1746066813.039872:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095801880/2, rc 0, transno 17179875356 00000100:00100000:1.0:1746066813.039875:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985100800:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066813.039877:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.039903:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.039910:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.039923:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.039926:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066813.039929:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.039933:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfb10f1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066813.042870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.042911:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399168 00000100:00100000:0.0:1746066813.042918:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399168 00000100:00100000:0.0:1746066813.042998:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17219 00000100:00100000:0.0:1746066813.043006:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3312:x1830882985399168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066813.043023:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.043038:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7450 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.043091:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.043103:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.043119:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066813.043121:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066813.043124:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9000, rc 0) 00000100:00100000:0.0:1746066813.043292:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985399168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 170us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.043299:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17219 00000100:00100000:0.0:1746066813.045960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.046041:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399296 00000100:00100000:3.0:1746066813.046049:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399296 00000100:00100000:3.0:1746066813.046088:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 941 00000100:00100000:3.0:1746066813.046094:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985399296:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:3.0:1746066813.046104:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.046123:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb10b2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7442 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.046151:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.046155:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.046196:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3312:x1830882985399296:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.046201:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 941 00000100:00100000:0.0:1746066813.047272:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.047336:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399552 00000100:00100000:2.0:1746066813.047340:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399552 00000100:00100000:2.0:1746066813.047376:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6478 00000100:00100000:2.0:1746066813.047382:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3312:x1830882985399552:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066813.047544:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985399552:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 161us (274us total) trans 8589937690 rc 0/0 00000100:00100000:2.0:1746066813.047550:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6478 00000100:00100000:0.0:1746066813.048271:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.048371:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399808 00000100:00100000:2.0:1746066813.048374:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399808 00000100:00100000:2.0:1746066813.048394:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6479 00000100:00100000:2.0:1746066813.048401:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3312:x1830882985399808:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066813.048486:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3312:x1830882985399808:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 87us (215us total) trans 8589937691 rc 0/0 00000100:00100000:2.0:1746066813.048489:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6479 00000100:00100000:2.0:1746066813.148359:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985100928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746066813.148443:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.148589:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985100928 00000100:00100000:0.0:1746066813.148598:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985100928 00000100:00080000:2.0:1746066813.148653:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066813.148670:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1746066813.148677:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985100928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746066813.148706:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 811008 granted 1194813888 pending 2617344 free 3909910528 avail 3678388224 00000100:00100000:0.0:1746066813.148744:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985100928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.148754:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1746066813.148793:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985100928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066813.163631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.163712:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985399936 00000100:00100000:2.0:1746066813.163722:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985399936 00000100:00100000:2.0:1746066813.163788:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17220 00000100:00100000:2.0:1746066813.163797:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3316:x1830882985399936:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.163822:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.163842:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfb10ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7457 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.164078:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164096:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164286:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164301:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164307:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164312:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164385:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164392:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164397:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066813.164464:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066813.164469:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066813.164485:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164493:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164501:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164509:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164515:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164520:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164525:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.164529:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164534:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164542:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066813.164543:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.164546:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164549:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164570:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164574:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164578:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164581:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.164584:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164589:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164594:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e317300) 00010000:00010000:2.0:1746066813.164596:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.164598:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164602:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb110d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.164626:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfb10ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.164638:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.164644:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.164646:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066813.164648:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3e00, rc 0) 00000100:00100000:2.0:1746066813.164710:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3316:x1830882985399936:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 915us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.164717:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17220 00000100:00100000:0.0:1746066813.168705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.168782:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400064 00000100:00100000:2.0:1746066813.168791:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400064 00000100:00100000:0.0:1746066813.168805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.169397:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400192 00000100:00100000:2.0:1746066813.169401:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400192 00000100:00100000:2.0:1746066813.169546:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20317 00000100:00100000:2.0:1746066813.169555:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985400064:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066813.169555:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20318 00000100:00100000:1.0:1746066813.169563:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985400192:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.169572:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.169575:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.169590:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d745e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.169591:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7465 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066813.169612:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd7a, atime: 0x6812dd79, ctime: 0x6812dd7a, blocks: 0x800 00002000:00010000:1.0:1746066813.169612:0:13726:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd7d, atime: 0x6812dd7a, ctime: 0x6812dd7d, blocks: 0x808 00010000:00010000:2.0:1746066813.169630:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.169630:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.169632:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.169632:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.169640:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.169640:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 6 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.169654:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.169655:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 6 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.169664:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2800, rc 0) 00010000:00010000:1.0:1746066813.169664:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7e00, rc 0) 00000100:00100000:2.0:1746066813.169724:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985400064:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 170us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.169730:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20317 00000100:00100000:1.0:1746066813.170066:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985400192:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 503us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.170072:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20318 00000100:00100000:0.0:1746066813.170121:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.170155:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.170178:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.170205:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.170216:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400320 00000100:00100000:0.0:1746066813.170219:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400320 00000100:00100000:0.0:1746066813.170235:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400448 00000100:00100000:0.0:1746066813.170237:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400448 00000100:00100000:0.0:1746066813.170248:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400576 00000100:00100000:0.0:1746066813.170249:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400576 00000100:00100000:0.0:1746066813.170258:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400704 00000100:00100000:0.0:1746066813.170260:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400704 00000100:00100000:0.0:1746066813.170272:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20319 00000100:00100000:0.0:1746066813.170277:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985400320:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066813.170285:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.170294:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d746c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066813.170306:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd7d, atime: 0x6812dd76, ctime: 0x6812dd7d, blocks: 0x800 00010000:00010000:0.0:1746066813.170313:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.170315:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.170319:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.170326:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20320 00000100:00100000:2.0:1746066813.170332:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985400448:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066813.170332:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.170339:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.170339:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82200, rc 0) 00010000:00010000:2.0:1746066813.170346:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7473 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.170357:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985400320:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 81us (237us total) trans 0 rc 0/0 00002000:00010000:2.0:1746066813.170358:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd7d, atime: 0x6812dd7d, ctime: 0x6812dd7d, blocks: 0x800 00000100:00100000:0.0:1746066813.170362:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20319 00010000:00010000:2.0:1746066813.170367:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.170369:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066813.170372:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20321 00010000:00010000:2.0:1746066813.170373:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066813.170376:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20322 00000100:00100000:3.0:1746066813.170379:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985400576:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.170381:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066813.170381:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985400704:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066813.170386:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.170387:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.170388:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3a00, rc 0) 00010000:00010000:0.0:1746066813.170392:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7481 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.170396:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d747a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066813.170401:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd7c, atime: 0x6812dd7c, ctime: 0x6812dd7c, blocks: 0x1000 00000100:00100000:2.0:1746066813.170404:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985400448:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 72us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066813.170408:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746066813.170409:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 4860352, mtime: 0x6812dd7c, atime: 0x6812dd7c, ctime: 0x6812dd7c, blocks: 0x1518 00000100:00100000:2.0:1746066813.170410:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20320 00010000:00010000:0.0:1746066813.170410:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.170413:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.170418:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.170420:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.170421:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.170424:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.170427:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83000, rc 0) 00010000:00010000:3.0:1746066813.170447:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.170455:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf200, rc 0) 00000100:00100000:0.0:1746066813.170623:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985400704:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 241us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.170628:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985400576:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 248us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.170632:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20322 00000100:00100000:3.0:1746066813.170635:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20321 00000100:00100000:0.0:1746066813.173104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.173311:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985400960 00000100:00100000:2.0:1746066813.173320:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985400960 00000100:00100000:2.0:1746066813.173370:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17221 00000100:00100000:2.0:1746066813.173378:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3316:x1830882985400960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.173398:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.173416:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3c00/0xf1867c21abfb1145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7488 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.173534:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.173548:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.173555:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.173585:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.173597:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 11 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.173609:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985101056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.173671:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.173756:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985401216 00000100:00100000:3.0:1746066813.173761:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985401216 00000100:00100000:2.0:1746066813.173790:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.173855:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17222 00000100:00100000:3.0:1746066813.173861:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:3318:x1830882985401216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.173871:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.173878:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfb1153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d748f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.173931:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.173940:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174053:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174071:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174076:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174081:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174167:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174173:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174179:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066813.174187:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.174262:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174268:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174272:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174277:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174282:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ece400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.174287:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174292:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174303:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066813.174306:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.174309:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174314:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece400/0xf1867c21abfb115a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174340:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174346:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174350:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174353:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ecfe00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.174355:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174359:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174365:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cd9900) 00010000:00010000:3.0:1746066813.174622:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.174627:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174636:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfe00/0xf1867c21abfb1161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.174674:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfb1153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.174684:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.174690:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.174692:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066813.174694:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecfa00, rc 0) 00000100:00100000:3.0:1746066813.174738:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3318:x1830882985401216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 876us (1066us total) trans 8589937692 rc 0/0 00000100:00100000:3.0:1746066813.174745:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17222 00000100:00100000:2.0:1746066813.175316:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985101056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.175321:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.175334:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066813.175368:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985401344 00000100:00100000:3.0:1746066813.175373:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985401344 00010000:00010000:3.0:1746066813.175392:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 12 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.175424:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9299 00000100:00100000:3.0:1746066813.175439:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985401344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.175449:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.175454:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 12 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.175463:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 12 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.175477:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1114 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7457 expref: 12 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.175485:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.175489:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.175496:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.175501:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.175527:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.175558:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985401344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.175578:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9299 00010000:00010000:2.0:1746066813.175712:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.175718:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066813.175731:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066813.175802:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3c00/0xf1867c21abfb1145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7488 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.175875:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7488 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.175902:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.175904:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066813.175906:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2200, rc 0) 00000100:00100000:2.0:1746066813.175927:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3316:x1830882985400960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2550us (2832us total) trans 8589937693 rc 0/0 00000100:00100000:2.0:1746066813.175933:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17221 00000100:00100000:0.0:1746066813.179796:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.180072:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985401600 00000100:00100000:2.0:1746066813.180082:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985401600 00000100:00100000:2.0:1746066813.180141:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17223 00000100:00100000:2.0:1746066813.180149:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3320:x1830882985401600:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.180172:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.180189:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfb117d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7496 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.180273:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180286:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180297:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180311:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180316:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180321:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180415:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcc4e00/0xf1867c21abfb1192 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180424:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcc4e00/0xf1867c21abfb1192 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180441:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcc4e00/0xf1867c21abfb1192 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066813.180453:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066813.180834:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180841:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.180846:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181372:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181378:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.181381:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181387:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181397:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066813.181400:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.181405:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181409:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfb1184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181419:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181423:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181443:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181447:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.181449:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181454:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181459:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855000) 00010000:00010000:2.0:1746066813.181461:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.181463:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181467:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb118b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181503:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfb117d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7496 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181510:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcc4e00/0xf1867c21abfb1192 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7496 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181515:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.181516:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066813.181517:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dcc4e00, rc 0) 00000100:00100000:2.0:1746066813.181579:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3320:x1830882985401600:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1430us (1793us total) trans 8589937694 rc 0/0 00000100:00100000:2.0:1746066813.181585:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17223 00000100:00100000:0.0:1746066813.181670:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.181750:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985401856 00000100:00100000:2.0:1746066813.181755:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985401856 00000100:00100000:2.0:1746066813.181786:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17224 00000100:00100000:2.0:1746066813.181791:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3316:x1830882985401856:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.181803:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.181805:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066813.181816:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2200/0xf1867c21abfb114c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7488 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181824:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.181827:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.181833:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb11a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d749d expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181903:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181912:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181919:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181927:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181931:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181935:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181940:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d07200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.181942:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181945:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181948:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.181949:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066813.181950:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181953:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abfb11a7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.181965:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb11a0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d749d expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181969:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb11a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d749d expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.181973:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06a00, rc 0) 00000100:00100000:2.0:1746066813.181995:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3316:x1830882985401856:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 204us (326us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066813.182000:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17224 00000100:00100000:1.0:1746066813.188109:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.188210:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985402112 00000100:00100000:2.0:1746066813.188219:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985402112 00000100:00100000:2.0:1746066813.188264:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6480 00000100:00100000:2.0:1746066813.188272:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3316:x1830882985402112:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066813.188496:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+11:3316:x1830882985402112:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 224us (399us total) trans 8589937695 rc 0/0 00000100:00100000:2.0:1746066813.188503:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6480 00000100:00100000:0.0:1746066813.196573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.196666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.196737:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985402368 00000100:00100000:2.0:1746066813.196746:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985402368 00000100:00100000:3.0:1746066813.196779:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985402624 00000100:00100000:2.0:1746066813.196788:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17225 00000100:00100000:3.0:1746066813.196790:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985402624 00000100:00100000:2.0:1746066813.196795:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:3324:x1830882985402368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.196815:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.196831:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb11ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74a4 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.196918:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.196930:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.196939:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.196949:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.196965:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.196973:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197348:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197361:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197367:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066813.197375:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066813.197446:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197452:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197457:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197811:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197816:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d06e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.197820:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197826:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197839:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066813.197842:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.197846:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.197850:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb11b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066813.197937:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17226 00000100:00100000:0.0:1746066813.197946:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3327:x1830882985402624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.197957:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.197964:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfb11d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74ab expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.197992:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.197998:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.198051:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198056:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198060:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198064:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d06600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.198066:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198069:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198075:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855200) 00010000:00010000:2.0:1746066813.198077:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.198079:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.198083:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb11bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066813.198121:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198131:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198137:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198141:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198184:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb11e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198190:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb11e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198195:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb11e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066813.198200:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066813.198226:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198231:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198235:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198238:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198242:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e83a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066813.198244:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198248:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198254:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066813.198256:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066813.198258:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.198265:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83a00/0xf1867c21abfb11d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.198927:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb11ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.198939:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.198944:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.198947:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066813.198949:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06200, rc 0) 00010000:00010000:0.0:1746066813.199501:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199513:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199518:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199523:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097bc9800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066813.199526:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199532:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199545:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0fc00) 00010000:00010000:0.0:1746066813.199547:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066813.199550:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199555:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb11df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066813.199604:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfb11d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ab expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.199616:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb11e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ab expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.199627:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066813.199629:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066813.199631:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7600, rc 0) 00000100:00100000:2.0:1746066813.199908:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3324:x1830882985402368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3110us (3339us total) trans 8589937696 rc 0/0 00000100:00100000:2.0:1746066813.199915:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17225 00000100:00100000:0.0:1746066813.200132:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3327:x1830882985402624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2184us (3463us total) trans 8589937697 rc 0/0 00000100:00100000:0.0:1746066813.200140:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17226 00000100:00100000:0.0:1746066813.204117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.204159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.204253:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403008 00000100:00100000:2.0:1746066813.204266:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403008 00000100:00100000:2.0:1746066813.204314:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403136 00000100:00100000:2.0:1746066813.204316:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403136 00000100:00100000:2.0:1746066813.204341:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6481 00000100:00100000:2.0:1746066813.204348:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3327:x1830882985403008:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066813.204532:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3327:x1830882985403008:12345-192.168.204.16@tcp:35:cat.0 Request processed in 183us (424us total) trans 8589937698 rc 0/0 00000100:00100000:2.0:1746066813.204538:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6481 00000100:00100000:2.0:1746066813.204559:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6482 00000100:00100000:2.0:1746066813.204564:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:3324:x1830882985403136:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066813.204632:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3324:x1830882985403136:12345-192.168.204.16@tcp:35:cat.0 Request processed in 68us (472us total) trans 8589937699 rc 0/0 00000100:00100000:2.0:1746066813.204637:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6482 00000100:00100000:0.0:1746066813.207599:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.207813:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403392 00000100:00100000:3.0:1746066813.207824:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403392 00000100:00100000:1.0:1746066813.207922:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20323 00000100:00100000:1.0:1746066813.207933:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985403392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.207958:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.207977:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74b9 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.208004:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.208006:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.208015:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 33 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066813.208015:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.208036:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 33 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066813.208040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.208048:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3000, rc 0) 00000100:00100000:0.0:1746066813.208061:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403264 00000100:00100000:0.0:1746066813.208065:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403264 00000100:00100000:0.0:1746066813.208093:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403776 00000100:00100000:0.0:1746066813.208096:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403776 00000100:00100000:1.0:1746066813.208097:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985403392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 166us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.208104:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20323 00000100:00100000:1.0:1746066813.208123:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20324 00000100:00100000:1.0:1746066813.208129:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985403264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.208136:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.208142:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74b2 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.208143:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20325 00000100:00100000:0.0:1746066813.208151:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985403776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.208155:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.208157:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.208160:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.208162:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.208169:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.208173:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74ce expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.208176:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2400, rc 0) 00010000:00010000:0.0:1746066813.208188:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.208190:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066813.208192:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985403264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066813.208196:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066813.208197:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20324 00010000:00010000:0.0:1746066813.208208:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.208217:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82e00, rc 0) 00000100:00100000:0.0:1746066813.208759:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985403776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 605us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.208765:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20325 00000100:00100000:3.0:1746066813.208943:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.209010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.209565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.210039:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.210156:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403904 00000100:00100000:0.0:1746066813.210162:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403904 00000100:00100000:0.0:1746066813.210200:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404288 00000100:00100000:0.0:1746066813.210204:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404288 00000100:00100000:0.0:1746066813.210223:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404416 00000100:00100000:0.0:1746066813.210226:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404416 00000100:00100000:0.0:1746066813.210250:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20326 00000100:00100000:0.0:1746066813.210257:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985403904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.210271:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.210285:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74d5 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.210304:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.210306:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.210314:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.210326:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.210335:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945c00, rc 0) 00000100:00100000:0.0:1746066813.210369:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985403904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.210375:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20326 00000100:00100000:0.0:1746066813.210392:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20327 00000100:00100000:0.0:1746066813.210398:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985404288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.210406:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.210416:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74ea expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.210419:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20328 00000100:00100000:1.0:1746066813.210427:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985404416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.210439:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.210442:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.210445:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.210448:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.210451:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74f1 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.210459:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.210462:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.210463:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.210468:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.210478:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.210478:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944e00, rc 0) 00010000:00010000:1.0:1746066813.210484:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2c00, rc 0) 00000100:00100000:1.0:1746066813.210502:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985404416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.210502:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985404288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 104us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.210507:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20328 00000100:00100000:0.0:1746066813.210510:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20327 00000100:00100000:3.0:1746066813.211107:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.211151:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403648 00000100:00100000:3.0:1746066813.211154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.211155:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403648 00000100:00100000:1.0:1746066813.211172:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985403520 00000100:00100000:1.0:1746066813.211173:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985403520 00000100:00100000:1.0:1746066813.211183:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404160 00000100:00100000:1.0:1746066813.211184:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404160 00000100:00100000:1.0:1746066813.211194:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20329 00000100:00100000:1.0:1746066813.211198:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985403648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.211205:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.211212:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74c7 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.211213:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.211224:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.211226:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066813.211227:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.211230:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211238:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211245:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b41200, rc 0) 00000100:00100000:1.0:1746066813.211259:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985403648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 61us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.211264:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20329 00000100:00100000:1.0:1746066813.211273:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404032 00000100:00100000:1.0:1746066813.211274:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404032 00000100:00100000:1.0:1746066813.211283:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404672 00000100:00100000:1.0:1746066813.211285:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404672 00000100:00100000:3.0:1746066813.211289:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.211292:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404544 00000100:00100000:1.0:1746066813.211294:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404544 00000100:00100000:1.0:1746066813.211300:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20330 00000100:00100000:1.0:1746066813.211303:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985403520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.211309:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.211313:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74c0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.211320:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.211322:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.211324:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211332:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211337:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32a00, rc 0) 00000100:00100000:3.0:1746066813.211343:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20331 00000100:00100000:3.0:1746066813.211350:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985404160:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066813.211350:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985403520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.211354:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20330 00010000:00010000:3.0:1746066813.211357:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066813.211360:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20332 00000100:00100000:1.0:1746066813.211364:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985404032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.211365:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74e3 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.211367:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.211372:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74dc expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.211375:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.211377:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.211381:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.211561:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20333 00000100:00100000:2.0:1746066813.211570:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985404672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.211578:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.211585:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74ff expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.211599:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.211601:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.211607:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.211616:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.211623:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07a00, rc 0) 00000100:00100000:2.0:1746066813.211641:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985404672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.211645:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20333 00000100:00100000:2.0:1746066813.211658:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20334 00000100:00100000:2.0:1746066813.211663:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985404544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.211668:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.211673:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d74f8 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.211683:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.211684:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.211688:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.211696:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.211702:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07600, rc 0) 00000100:00100000:2.0:1746066813.211716:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985404544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.211724:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20334 00010000:00010000:1.0:1746066813.211820:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.211823:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.211828:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 35 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211839:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 35 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.211841:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.211846:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3e00, rc 0) 00010000:00010000:3.0:1746066813.211850:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ece400, rc 0) 00000100:00100000:1.0:1746066813.211863:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985404032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 498us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.211869:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985404160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 519us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.211869:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20332 00000100:00100000:3.0:1746066813.211874:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20331 00000100:00100000:0.0:1746066813.226352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.226419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.226479:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.227425:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985404928 00000100:00100000:1.0:1746066813.227443:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985404928 00002000:00100000:1.0:1746066813.227493:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009d89d180 x1830882985404928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066813.227518:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985405184 00000100:00100000:2.0:1746066813.227522:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985405184 00002000:00100000:2.0:1746066813.227541:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89d500 x1830882985405184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.227550:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d500 with x1830882985405184 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.227556:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d500 00000100:00100000:2.0:1746066813.227574:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985405440 00000100:00100000:2.0:1746066813.227576:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985405440 00002000:00100000:2.0:1746066813.227586:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89d880 x1830882985405440/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.227592:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985405440 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.227594:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:2.0:1746066813.227607:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7621 00000100:00100000:2.0:1746066813.227614:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985405184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.227650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.227678:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985405696 00000100:00100000:0.0:1746066813.227683:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985405696 00002000:00100000:0.0:1746066813.227708:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89dc00 x1830882985405696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.227722:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89dc00 with x1830882985405696 ext(1048576->2097151) 00002000:00010000:0.0:1746066813.227726:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89dc00 00000100:00100000:0.0:1746066813.227746:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7622 00000100:00100000:0.0:1746066813.227754:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985405440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.228341:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7623 00000100:00100000:2.0:1746066813.228348:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985405696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.228753:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.228782:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985405952 00000100:00100000:3.0:1746066813.228787:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985405952 00002000:00100000:3.0:1746066813.228814:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88011f710700 x1830882985405952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.228835:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710700 with x1830882985405952 ext(0->1048575) 00002000:00010000:3.0:1746066813.228840:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710700 00000100:00100000:3.0:1746066813.228878:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7624 00000100:00100000:3.0:1746066813.228913:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985405952:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066813.228998:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985404928 ext(0->1048575) 00002000:00010000:1.0:1746066813.229002:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89d180 00000100:00100000:1.0:1746066813.229019:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7625 00000100:00100000:1.0:1746066813.229024:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985404928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.231299:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.231339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.231365:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985406208 00000100:00100000:0.0:1746066813.231366:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.231371:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985406208 00000100:00100000:0.0:1746066813.231389:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985406464 00000100:00100000:0.0:1746066813.231392:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985406464 00002000:00100000:2.0:1746066813.231402:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89df80 x1830882985406208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.231409:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89e300 x1830882985406464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.231412:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89df80 with x1830882985406208 ext(1048576->2097151) 00002000:00100000:0.0:1746066813.231416:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e300 with x1830882985406464 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.231417:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89df80 00002000:00010000:0.0:1746066813.231420:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89e300 00000100:00100000:2.0:1746066813.231442:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985406720 00000100:00100000:2.0:1746066813.231445:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985406720 00000100:00100000:0.0:1746066813.231454:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7626 00002000:00100000:2.0:1746066813.231458:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89e680 x1830882985406720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066813.231460:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985406208:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066813.231464:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e680 with x1830882985406720 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.231467:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89e680 00000100:00100000:2.0:1746066813.231474:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7627 00000100:00100000:2.0:1746066813.231479:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985406464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.232082:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7628 00000100:00100000:2.0:1746066813.232088:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985406720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.242410:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985405184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14780us (15976us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.242422:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7621 00002000:00100000:2.0:1746066813.242444:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89d500 x1830882985405184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.242453:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d500 with x1830882985405184 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.242459:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d500 00000100:00100000:2.0:1746066813.251273:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985405696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22913us (23813us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.251286:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7623 00002000:00100000:2.0:1746066813.251299:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89dc00 x1830882985405696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.251309:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89dc00 with x1830882985405696 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.251314:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89dc00 00000100:00100000:1.0:1746066813.257297:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985404928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 28261us (30947us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066813.257309:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7625 00002000:00100000:1.0:1746066813.257323:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009d89d180 x1830882985404928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.257333:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985404928 ext(0->1048575) 00002000:00010000:1.0:1746066813.257338:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89d180 00000100:00100000:0.0:1746066813.259805:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985405440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32036us (33311us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066813.259820:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7622 00002000:00100000:0.0:1746066813.259837:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89d880 x1830882985405440/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.259847:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985405440 ext(1048576->2097151) 00002000:00010000:0.0:1746066813.259853:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:2.0:1746066813.266728:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985406464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 35236us (35375us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.266743:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7627 00002000:00100000:2.0:1746066813.266755:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89e300 x1830882985406464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.266765:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e300 with x1830882985406464 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.266771:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89e300 00000100:00100000:2.0:1746066813.278319:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985406208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 46845us (47012us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066813.278327:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.278333:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7626 00002000:00100000:2.0:1746066813.278347:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89df80 x1830882985406208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.278356:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89df80 with x1830882985406208 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.278362:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89df80 00000100:00100000:2.0:1746066813.278387:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985406976 00000100:00100000:0.0:1746066813.278390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.278393:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985406976 00002000:00100000:2.0:1746066813.278425:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89ea00 x1830882985406976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.278446:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985406976 ext(2097152->4194303) 00000100:00100000:1.0:1746066813.278449:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985407232 00002000:00010000:2.0:1746066813.278450:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00000100:00100000:1.0:1746066813.278453:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985407232 00002000:00100000:1.0:1746066813.278475:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89ed80 x1830882985407232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066813.278481:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7629 00002000:00100000:1.0:1746066813.278482:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ed80 with x1830882985407232 ext(2097152->4194303) 00002000:00010000:1.0:1746066813.278485:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89ed80 00000100:00100000:2.0:1746066813.278488:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985406976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.278500:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7630 00000100:00100000:1.0:1746066813.278506:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985407232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.286458:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985406720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 54357us (55077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.286477:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7628 00002000:00100000:2.0:1746066813.286488:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89e680 x1830882985406720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.286497:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e680 with x1830882985406720 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.286504:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89e680 00000100:00100000:3.0:1746066813.294121:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985405952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 65203us (65362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.294134:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7624 00002000:00100000:3.0:1746066813.294144:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88011f710700 x1830882985405952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.294152:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710700 with x1830882985405952 ext(0->1048575) 00002000:00010000:3.0:1746066813.294158:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710700 00000100:00100000:1.0:1746066813.303343:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985407232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24822us (24938us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066813.303359:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7630 00002000:00100000:1.0:1746066813.303372:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89ed80 x1830882985407232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.303381:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ed80 with x1830882985407232 ext(2097152->4194303) 00002000:00010000:1.0:1746066813.303387:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89ed80 00000100:00100000:3.0:1746066813.305099:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985406976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26603us (26765us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066813.305109:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7629 00002000:00100000:3.0:1746066813.305118:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89ea00 x1830882985406976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.305126:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985406976 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.305131:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00000100:00100000:0.0:1746066813.316051:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.316104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.316184:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985407488 00000100:00100000:1.0:1746066813.316193:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985407488 00002000:00100000:1.0:1746066813.316239:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89f100 x1830882985407488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.316249:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f100 with x1830882985407488 ext(2097152->4194303) 00002000:00010000:1.0:1746066813.316254:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f100 00000100:00100000:1.0:1746066813.316266:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985407744 00000100:00100000:1.0:1746066813.316268:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985407744 00000100:00100000:3.0:1746066813.316273:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7631 00002000:00100000:1.0:1746066813.316280:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89f480 x1830882985407744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066813.316284:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985407488:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066813.316287:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985407744 ext(2097152->4194303) 00002000:00010000:1.0:1746066813.316289:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:1.0:1746066813.316316:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7632 00000100:00100000:1.0:1746066813.316321:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985407744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.317943:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.317965:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408000 00000100:00100000:2.0:1746066813.317971:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408000 00002000:00100000:2.0:1746066813.318005:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009d89f800 x1830882985408000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.318013:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f800 with x1830882985408000 ext(4194304->4861951) 00002000:00010000:2.0:1746066813.318019:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f800 00000100:00100000:2.0:1746066813.318046:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7633 00000100:00100000:2.0:1746066813.318053:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985408000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.327208:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.327989:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408256 00000100:00100000:1.0:1746066813.327998:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408256 00000100:00100000:1.0:1746066813.328046:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17227 00000100:00100000:1.0:1746066813.328053:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3320:x1830882985408256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066813.328080:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.328084:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746066813.328112:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfb11e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ab expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328152:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dcc4e00/0xf1867c21abfb1192 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7496 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328162:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066813.328166:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066813.328177:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb1248 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7506 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328228:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066813.328240:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328248:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328252:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328257:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 6/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066813.328285:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328295:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 31 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.328306:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.328618:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328627:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 31 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.328635:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.328661:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.328669:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 10 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.328676:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.328694:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.329009:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.329043:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408512 00000100:00100000:2.0:1746066813.329048:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408512 00000100:00100000:2.0:1746066813.329082:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17228 00000100:00100000:2.0:1746066813.329088:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:3318:x1830882985408512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.329099:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.329101:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746066813.329108:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 32 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.329121:0:7245:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 32 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.329134:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.329137:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.329144:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.329149:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.329155:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfb1256 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d750d expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.329177:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.329184:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.329188:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.329198:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066813.329207:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066813.330280:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985407744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13954us (14171us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066813.330292:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7632 00002000:00100000:1.0:1746066813.330303:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89f480 x1830882985407744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.330312:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985407744 ext(2097152->4194303) 00002000:00010000:1.0:1746066813.330317:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:0.0:1746066813.330851:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.330935:0:10125:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from blocking AST (req@ffff8800a5884700 x1830882985101184) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 33 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.330943:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408640 00000100:00100000:3.0:1746066813.330950:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408640 00010000:00010000:1.0:1746066813.330952:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb11c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74a4 expref: 33 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.330964:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.330974:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 11 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.330974:0:10125:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from blocking AST (req@ffff8800a5885f80 x1830882985101312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 32 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.330982:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb1168 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d748f expref: 32 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.330994:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.330996:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9300 00000100:00100000:3.0:1746066813.331002:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985408640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066813.331004:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985101440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.331014:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.331018:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 11 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.331026:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 11 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.331033:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066813.331038:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066813.331045:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066813.331061:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb10f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7450 expref: 11 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.331061:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066813.331083:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.331086:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066813.331093:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066813.331099:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066813.331106:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.331110:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.331128:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066813.331138:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066813.331143:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066813.331157:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985408640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 155us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.331163:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9300 00000040:00080000:1.0:1746066813.331387:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1193, 88 off112568 00000004:00080000:1.0:1746066813.331393:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542508630ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331495:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1203, 88 off113360 00000004:00080000:1.0:1746066813.331499:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542616210ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331520:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1204, 88 off113448 00000004:00080000:1.0:1746066813.331523:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542640143ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331530:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1194, 88 off112656 00000004:00080000:1.0:1746066813.331533:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542649738ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331540:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1195, 88 off112744 00000004:00080000:1.0:1746066813.331543:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542659980ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331552:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1205, 88 off113536 00000004:00080000:1.0:1746066813.331555:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542671431ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331562:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1206, 88 off113624 00000004:00080000:1.0:1746066813.331564:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542681126ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331570:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1207, 88 off113712 00000004:00080000:1.0:1746066813.331573:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542689436ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331579:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1196, 88 off112832 00000004:00080000:1.0:1746066813.331581:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542697461ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331588:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1208, 88 off113800 00000004:00080000:1.0:1746066813.331591:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542707560ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331598:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1197, 88 off112920 00000004:00080000:1.0:1746066813.331600:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542716450ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331607:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1209, 88 off113888 00000004:00080000:1.0:1746066813.331610:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542726625ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066813.331616:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1198, 88 off113008 00000004:00080000:1.0:1746066813.331618:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542735285ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331626:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1199, 88 off113096 00000004:00080000:1.0:1746066813.331629:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542745555ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331642:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1200, 88 off113184 00000004:00080000:1.0:1746066813.331645:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542761451ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331652:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1201, 88 off113272 00000004:00080000:1.0:1746066813.331654:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781542771201ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066813.331667:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1210, 88 off113976 00000004:00080000:1.0:1746066813.331669:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781542785728ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066813.334545:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937700 is committed 00000004:00080000:0.0:1746066813.334556:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1185 committed 00000004:00080000:0.0:1746066813.334754:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1178 committed 00000004:00080000:0.0:1746066813.334762:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1177 committed 00000004:00080000:0.0:1746066813.334764:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1176 committed 00000004:00080000:0.0:1746066813.334765:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1175 committed 00000004:00080000:0.0:1746066813.334767:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1184 committed 00000004:00080000:0.0:1746066813.334769:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1174 committed 00000004:00080000:0.0:1746066813.334770:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1183 committed 00000004:00080000:0.0:1746066813.334772:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1173 committed 00000004:00080000:0.0:1746066813.334774:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1182 committed 00000004:00080000:0.0:1746066813.334775:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1181 committed 00000004:00080000:0.0:1746066813.334777:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1180 committed 00000004:00080000:0.0:1746066813.334778:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1172 committed 00000004:00080000:0.0:1746066813.334780:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1171 committed 00000004:00080000:0.0:1746066813.334781:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1179 committed 00000004:00080000:0.0:1746066813.334783:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1178 committed 00000004:00080000:0.0:1746066813.334785:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1170 committed 00000001:00080000:0.0:1746066813.334790:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937699 is committed 00000001:00080000:0.0:1746066813.334800:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937695 is committed 00000100:00100000:3.0:1746066813.334970:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985101952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335017:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.335040:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335066:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.335082:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066813.335087:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985101824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335100:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.335109:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335123:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.335142:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985101952 00000100:00100000:3.0:1746066813.335148:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985101952 00000100:00100000:3.0:1746066813.335178:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102464 00000100:00100000:3.0:1746066813.335180:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102464 00000100:00100000:3.0:1746066813.335189:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985101824 00000100:00100000:3.0:1746066813.335190:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985101824 00000100:00100000:3.0:1746066813.335198:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102336 00000100:00100000:3.0:1746066813.335200:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102336 00000100:00100000:3.0:1746066813.335210:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20335 00000100:00100000:3.0:1746066813.335217:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985101952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066813.335338:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066813.335341:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.335343:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.335345:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.335347:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066813.335372:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882985101952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (355us total) trans 21474842711 rc 0/0 00000100:00100000:3.0:1746066813.335378:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20335 00000100:00100000:3.0:1746066813.335392:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20336 00000100:00100000:3.0:1746066813.335396:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985102464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335454:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882985102464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (387us total) trans 21474842712 rc 0/0 00000100:00100000:3.0:1746066813.335463:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20336 00000100:00100000:3.0:1746066813.335472:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20337 00000100:00100000:3.0:1746066813.335476:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985101824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066813.335507:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066813.335510:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.335512:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:3.0:1746066813.335514:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.335516:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066813.335530:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882985101824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (428us total) trans 21474842713 rc 0/0 00000100:00100000:3.0:1746066813.335535:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20337 00000100:00100000:3.0:1746066813.335543:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20338 00000100:00100000:3.0:1746066813.335547:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985102336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.335587:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882985102336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (463us total) trans 21474842714 rc 0/0 00000100:00100000:3.0:1746066813.335591:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20338 00000100:00100000:0.0:1746066813.335602:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985102848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.335615:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.335629:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.335681:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985101568:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066813.336541:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.336553:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.336557:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746066813.336560:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.336568:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.336574:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.336600:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.336611:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 10 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.336622:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985103616:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.336681:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.337101:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985101696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337124:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985103360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.337128:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.337144:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985102208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.337146:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.337160:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.337170:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985102720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337174:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102848 00000100:00100000:0.0:1746066813.337180:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102848 00000100:00100000:3.0:1746066813.337181:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.337189:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985103232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337200:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985101696 00000100:00100000:0.0:1746066813.337202:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985101696 00000100:00100000:3.0:1746066813.337203:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.337218:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103360 00000100:00100000:0.0:1746066813.337219:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103360 00000100:00100000:0.0:1746066813.337228:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102208 00000100:00100000:0.0:1746066813.337230:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102208 00000100:00100000:3.0:1746066813.337231:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102720 00000100:00100000:3.0:1746066813.337234:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102720 00000100:00100000:3.0:1746066813.337248:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103232 00000100:00100000:3.0:1746066813.337250:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103232 00000100:00100000:0.0:1746066813.337252:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20339 00000100:00100000:3.0:1746066813.337258:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20340 00000100:00100000:0.0:1746066813.337259:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3774:x1830882985102848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.337263:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882985101696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337328:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20341 00000100:00100000:0.0:1746066813.337333:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882985103360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066813.337343:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066813.337345:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066810 -> 1746066810 00002000:00010000:3.0:1746066813.337347:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066809 -> 1746066809 00002000:00010000:3.0:1746066813.337350:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066810 -> 1746066810 00002000:00010000:3.0:1746066813.337352:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066813.337374:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882985101696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (245us total) trans 17179875357 rc 0/0 00000100:00100000:3.0:1746066813.337379:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20340 00000100:00100000:3.0:1746066813.337389:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20342 00000100:00100000:0.0:1746066813.337389:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882985103360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (241us total) trans 17179875359 rc 0/0 00000100:00100000:3.0:1746066813.337393:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985102720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337399:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20341 00000100:00100000:0.0:1746066813.337409:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20343 00000100:00100000:0.0:1746066813.337413:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3777:x1830882985102208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066813.337438:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066813.337441:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.337442:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.337444:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.337446:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066813.337462:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985102720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (280us total) trans 17179875360 rc 0/0 00000100:00100000:3.0:1746066813.337467:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20342 00000100:00100000:3.0:1746066813.337477:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20344 00000100:00100000:0.0:1746066813.337477:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882985102208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (316us total) trans 21474842715 rc 0/0 00000100:00100000:3.0:1746066813.337481:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3777:x1830882985103232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.337482:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20343 00002000:00010000:0.0:1746066813.337505:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066813.337508:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00002000:00010000:0.0:1746066813.337510:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066812 -> 1746066812 00002000:00010000:0.0:1746066813.337511:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:0.0:1746066813.337513:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:3.0:1746066813.337526:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985103232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (322us total) trans 17179875361 rc 0/0 00000100:00100000:0.0:1746066813.337529:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882985102848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 272us (1900us total) trans 17179875358 rc 0/0 00000100:00100000:3.0:1746066813.337532:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20344 00000100:00100000:0.0:1746066813.337535:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20339 00000004:00080000:3.0:1746066813.337564:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095868700/2, rc 0, transno 17179875357 00000004:00080000:0.0:1746066813.337564:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4fb80/2, rc 0, transno 17179875358 00000100:00100000:0.0:1746066813.337572:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985102848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066813.337579:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924380/2, rc 0, transno 17179875359 00000100:00100000:2.0:1746066813.337785:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985408000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19731us (19846us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066813.337798:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7633 00002000:00100000:2.0:1746066813.337806:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009d89f800 x1830882985408000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.337814:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f800 with x1830882985408000 ext(4194304->4861951) 00002000:00010000:2.0:1746066813.337819:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f800 00000100:00100000:2.0:1746066813.337840:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.337857:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985102080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.337874:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.337901:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985102592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.337923:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.337933:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985103104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.337945:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.337964:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985101568 00000100:00100000:2.0:1746066813.337967:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985101568 00000100:00100000:2.0:1746066813.337979:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102080 00000100:00100000:2.0:1746066813.337980:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102080 00000100:00100000:2.0:1746066813.337988:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102592 00000100:00100000:2.0:1746066813.337989:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102592 00000100:00100000:2.0:1746066813.337996:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103104 00000100:00100000:2.0:1746066813.337997:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103104 00000100:00100000:2.0:1746066813.338014:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20345 00000100:00100000:2.0:1746066813.338018:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985101568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066813.338299:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066813.338302:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00002000:00010000:2.0:1746066813.338305:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066810 -> 1746066810 00002000:00010000:2.0:1746066813.338306:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00002000:00010000:2.0:1746066813.338308:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066813.338331:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882985101568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 312us (490us total) trans 21474842716 rc 0/0 00000100:00100000:2.0:1746066813.338336:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20345 00000100:00100000:2.0:1746066813.338346:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20346 00000100:00100000:2.0:1746066813.338350:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985102080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.338398:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882985102080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (523us total) trans 21474842717 rc 0/0 00000100:00100000:2.0:1746066813.338403:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20346 00000100:00100000:2.0:1746066813.338411:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20347 00000100:00100000:2.0:1746066813.338415:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985102592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.338475:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882985102592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (550us total) trans 21474842718 rc 0/0 00000100:00100000:2.0:1746066813.338480:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20347 00000100:00100000:2.0:1746066813.338488:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20348 00000100:00100000:2.0:1746066813.338491:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882985103104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066813.338532:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066813.338534:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.338536:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066813.338537:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.338539:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066813.338554:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3776:x1830882985103104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (608us total) trans 17179875362 rc 0/0 00000100:00100000:2.0:1746066813.338558:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20348 00000004:00080000:2.0:1746066813.338580:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f712d80/2, rc 0, transno 21474842716 00000100:00100000:2.0:1746066813.338584:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985101568:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.338590:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f712680/2, rc 0, transno 21474842717 00000100:00100000:2.0:1746066813.338593:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985102080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.338599:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1500/2, rc 0, transno 21474842718 00000100:00100000:2.0:1746066813.338602:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985102592:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.338609:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d26300/2, rc 0, transno 17179875362 00000100:00100000:1.0:1746066813.338847:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.338863:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985103488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.338896:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066813.338913:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710a80/2, rc 0, transno 21474842713 00000100:00100000:1.0:1746066813.338917:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985101824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.338925:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713100/2, rc 0, transno 21474842714 00000100:00100000:1.0:1746066813.338927:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.338934:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711f80/2, rc 0, transno 21474842711 00000100:00100000:1.0:1746066813.338937:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985101952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.338944:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3800/2, rc 0, transno 21474842712 00000100:00100000:1.0:1746066813.338947:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.338960:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985102976 00000100:00100000:1.0:1746066813.338963:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985102976 00000100:00100000:1.0:1746066813.338978:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103488 00000100:00100000:1.0:1746066813.338979:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103488 00000100:00100000:1.0:1746066813.338988:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20349 00000100:00100000:1.0:1746066813.338991:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3775:x1830882985102976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.339050:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3775:x1830882985102976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (203us total) trans 17179875363 rc 0/0 00000100:00100000:1.0:1746066813.339056:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20349 00000100:00100000:1.0:1746066813.339174:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20350 00000100:00100000:1.0:1746066813.339179:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3775:x1830882985103488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066813.339217:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066813.339219:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.339221:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066813.339222:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.339224:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066813.339242:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3775:x1830882985103488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (359us total) trans 17179875364 rc 0/0 00000100:00100000:1.0:1746066813.339247:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20350 00000004:00080000:1.0:1746066813.339267:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4d500/2, rc 0, transno 17179875363 00000100:00100000:1.0:1746066813.339270:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985102976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.339277:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098925180/2, rc 0, transno 17179875364 00000100:00100000:1.0:1746066813.339280:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985103488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.339614:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985103360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.339685:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985103104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.339693:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985103744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.339714:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.339822:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985407488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23540us (23780us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066813.339829:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7631 00002000:00100000:2.0:1746066813.339837:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89f100 x1830882985407488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.339846:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f100 with x1830882985407488 ext(2097152->4194303) 00002000:00010000:2.0:1746066813.339851:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f100 00000100:00100000:0.0:1746066813.339919:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103744 00000100:00100000:0.0:1746066813.339922:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103744 00000100:00100000:0.0:1746066813.339940:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20351 00000100:00100000:0.0:1746066813.339944:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3776:x1830882985103744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.340006:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3776:x1830882985103744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (291us total) trans 17179875365 rc 0/0 00000100:00100000:0.0:1746066813.340011:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20351 00000100:00100000:3.0:1746066813.340071:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985101696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.340086:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711c00/2, rc 0, transno 21474842715 00000100:00100000:3.0:1746066813.340089:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985102208:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066813.340097:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009586a300/2, rc 0, transno 17179875360 00000100:00100000:3.0:1746066813.340100:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009586a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985102720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.340106:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e436a00/2, rc 0, transno 17179875361 00000100:00100000:3.0:1746066813.340109:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985103232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.340228:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985103616:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.340266:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb1248 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 10 pid: 10125 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066813.340285:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.340298:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.340330:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44e00, rc 0) 00000100:00100000:3.0:1746066813.340359:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985408256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12306us (13161us total) trans 8589937700 rc 0/0 00000100:00100000:3.0:1746066813.340365:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17227 00000004:00080000:2.0:1746066813.340604:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5887b80/2, rc 0, transno 17179875365 00000100:00100000:2.0:1746066813.340608:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985103744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.343872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.343970:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.344012:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408896 00000100:00100000:3.0:1746066813.344021:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408896 00000100:00100000:3.0:1746066813.344087:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17229 00000100:00100000:3.0:1746066813.344096:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3324:x1830882985408896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.344114:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.344132:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7514 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.344188:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.344197:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.344214:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.344228:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.344240:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.344242:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066813.344245:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066813.344280:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985408768 00000100:00100000:2.0:1746066813.344284:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985408768 00010000:00010000:2.0:1746066813.344303:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.344333:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9301 00000100:00100000:2.0:1746066813.344338:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985408768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.344346:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.344350:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.344808:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a400, rc 0) 00010000:00010000:2.0:1746066813.344872:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746066813.344908:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.344912:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb124f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7506 expref: 9 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.344927:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409024 00000100:00100000:1.0:1746066813.344932:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409024 00010000:00010000:2.0:1746066813.344935:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.344938:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.344945:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.344953:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066813.344955:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17230 00010000:00010000:2.0:1746066813.344960:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.344960:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985409024:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066813.344971:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.344978:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d751b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.344984:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.345001:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985408768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 663us (1030us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066813.345004:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.345008:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9301 00010000:00010000:1.0:1746066813.345016:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.345024:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066813.345026:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066813.345029:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.345035:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77e00, rc 0) 00000100:00100000:1.0:1746066813.345053:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985409024:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 93us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.345057:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3324:x1830882985408896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 962us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.345059:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17230 00000100:00100000:3.0:1746066813.345062:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17229 00010000:00010000:2.0:1746066813.345107:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.345114:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000040:00080000:2.0:1746066813.345353:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1202, 88 off113360 00000004:00080000:2.0:1746066813.345358:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781556473980ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.345388:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1211, 88 off114064 00000004:00080000:2.0:1746066813.345390:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781556507133ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.345408:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1212, 88 off114152 00000004:00080000:2.0:1746066813.345410:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781556526766ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.345417:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1203, 88 off113448 00000004:00080000:2.0:1746066813.346455:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557571043ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346497:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1204, 88 off113536 00000004:00080000:2.0:1746066813.346501:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557617390ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346519:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1213, 88 off114240 00000004:00080000:2.0:1746066813.346522:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781557638810ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.346540:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1214, 88 off114328 00000004:00080000:2.0:1746066813.346542:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781557659270ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.346549:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1215, 88 off114416 00000004:00080000:2.0:1746066813.346551:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781557668003ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.346559:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1205, 88 off113624 00000004:00080000:2.0:1746066813.346562:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557678478ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346581:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1216, 88 off114504 00000004:00080000:2.0:1746066813.346584:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781557701161ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.346591:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1206, 88 off113712 00000004:00080000:2.0:1746066813.346594:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557710538ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346602:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1217, 88 off114592 00000004:00080000:2.0:1746066813.346605:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781557721408ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066813.346611:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1207, 88 off113800 00000004:00080000:2.0:1746066813.346619:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557735355ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346628:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1208, 88 off113888 00000004:00080000:2.0:1746066813.346631:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557747570ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346640:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1209, 88 off113976 00000004:00080000:2.0:1746066813.346642:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557758996ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.346650:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1210, 88 off114064 00000004:00080000:2.0:1746066813.346653:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781557769363ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066813.347665:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1219, 88 off114776 00000004:00080000:2.0:1746066813.347674:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781558790875ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066813.354093:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937701 is committed 00000004:00080000:0.0:1746066813.354108:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1193 committed 00000004:00080000:0.0:1746066813.354129:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1187 committed 00000004:00080000:0.0:1746066813.354144:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1186 committed 00000004:00080000:0.0:1746066813.354145:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1185 committed 00000004:00080000:0.0:1746066813.354147:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1184 committed 00000004:00080000:0.0:1746066813.354148:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1192 committed 00000004:00080000:0.0:1746066813.354150:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1183 committed 00000004:00080000:0.0:1746066813.354153:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1191 committed 00000004:00080000:0.0:1746066813.354154:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1182 committed 00000004:00080000:0.0:1746066813.354156:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1190 committed 00000004:00080000:0.0:1746066813.354158:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1189 committed 00000004:00080000:0.0:1746066813.354160:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1188 committed 00000004:00080000:0.0:1746066813.354162:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1181 committed 00000004:00080000:0.0:1746066813.354163:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1180 committed 00000004:00080000:0.0:1746066813.354164:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1187 committed 00000004:00080000:0.0:1746066813.354166:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1186 committed 00000004:00080000:0.0:1746066813.354167:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1179 committed 00000100:00100000:0.0:1746066813.354877:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985103872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.354967:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.355001:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066813.355006:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985104128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.355020:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355131:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355156:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355176:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.355180:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985104640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.355187:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985103872 00000100:00100000:2.0:1746066813.355191:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.355194:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985103872 00000100:00100000:2.0:1746066813.355202:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1746066813.355203:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355206:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.355218:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.355220:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.355225:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104128 00000100:00100000:0.0:1746066813.355227:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104128 00000100:00100000:2.0:1746066813.355231:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.355232:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.355237:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104256 00000100:00100000:0.0:1746066813.355239:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104256 00000100:00100000:2.0:1746066813.355244:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.355245:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066813.355249:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985104512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.355255:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104768 00000100:00100000:2.0:1746066813.355256:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.355257:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104768 00000100:00100000:1.0:1746066813.355262:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.355268:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104640 00000100:00100000:0.0:1746066813.355269:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104640 00000100:00100000:0.0:1746066813.355274:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104000 00000100:00100000:2.0:1746066813.355275:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105152 00000100:00100000:0.0:1746066813.355276:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104000 00000100:00100000:1.0:1746066813.355277:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.355278:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105152 00000100:00100000:0.0:1746066813.355281:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104384 00000100:00100000:0.0:1746066813.355282:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104384 00000100:00100000:0.0:1746066813.355288:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104512 00000100:00100000:0.0:1746066813.355289:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104512 00000100:00100000:1.0:1746066813.355291:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355294:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105024 00000100:00100000:2.0:1746066813.355296:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105024 00000100:00100000:0.0:1746066813.355300:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20352 00000100:00100000:0.0:1746066813.355307:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985103872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.355308:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20353 00000100:00100000:1.0:1746066813.355314:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985104128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355318:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20354 00000100:00100000:2.0:1746066813.355323:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985104256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355417:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20355 00000100:00100000:2.0:1746066813.355422:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985104768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.355464:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20356 00000100:00100000:3.0:1746066813.355471:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3775:x1830882985104640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066813.355499:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066813.355503:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.355505:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066813.355507:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.355509:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066813.355539:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882985104768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (347us total) trans 17179875366 rc 0/0 00000100:00100000:3.0:1746066813.355540:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3775:x1830882985104640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (336us total) trans 17179875367 rc 0/0 00000100:00100000:2.0:1746066813.355546:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20355 00000100:00100000:3.0:1746066813.355558:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20356 00000100:00100000:2.0:1746066813.355561:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20357 00000100:00100000:2.0:1746066813.355566:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985104000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.355570:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20358 00000100:00100000:3.0:1746066813.355574:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985104384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066813.355600:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066813.355602:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066810 -> 1746066810 00002000:00010000:2.0:1746066813.355604:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066809 -> 1746066809 00002000:00010000:2.0:1746066813.355606:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066810 -> 1746066810 00002000:00010000:2.0:1746066813.355608:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1746066813.355616:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066813.355618:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.355620:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066813 -> 1746066813 00002000:00010000:3.0:1746066813.355622:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00000100:00100000:2.0:1746066813.355623:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882985104000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (403us total) trans 17179875368 rc 0/0 00002000:00010000:3.0:1746066813.355624:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066813.355627:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20357 00000100:00100000:2.0:1746066813.355635:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20359 00000100:00100000:2.0:1746066813.355639:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985105152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.355642:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3776:x1830882985104384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (397us total) trans 17179875369 rc 0/0 00000100:00100000:3.0:1746066813.355648:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20358 00000100:00100000:3.0:1746066813.355659:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20360 00000100:00100000:3.0:1746066813.355663:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985104512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066813.355670:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:2.0:1746066813.355672:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.355674:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066813.355675:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066813.355677:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:2.0:1746066813.355692:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3775:x1830882985105152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (460us total) trans 17179875370 rc 0/0 00000100:00100000:2.0:1746066813.355697:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20359 00002000:00010000:3.0:1746066813.355698:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:3.0:1746066813.355700:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.355702:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.355705:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:3.0:1746066813.355706:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:2.0:1746066813.355706:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20361 00000100:00100000:2.0:1746066813.355709:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985105024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.355721:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985104512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (459us total) trans 17179875371 rc 0/0 00000100:00100000:3.0:1746066813.355726:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20360 00000100:00100000:3.0:1746066813.355741:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355750:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985105024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (458us total) trans 17179875372 rc 0/0 00000100:00100000:2.0:1746066813.355755:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20361 00000100:00100000:3.0:1746066813.355758:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355765:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105664 00000100:00100000:2.0:1746066813.355767:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105664 00000100:00100000:2.0:1746066813.355775:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20362 00000100:00100000:2.0:1746066813.355779:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882985105664:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066813.355783:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5884380/2, rc 0, transno 17179875371 00000100:00100000:3.0:1746066813.355790:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985104512:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.355796:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d89ce00/2, rc 0, transno 17179875372 00000100:00100000:3.0:1746066813.355799:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.355804:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5885500/2, rc 0, transno 17179875367 00000100:00100000:3.0:1746066813.355807:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985104640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.355812:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764e00/2, rc 0, transno 17179875370 00000100:00100000:3.0:1746066813.355814:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.355820:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066813.355823:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355828:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882985105664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (69us total) trans 21474842721 rc 0/0 00000100:00100000:2.0:1746066813.355833:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20362 00000100:00100000:3.0:1746066813.355838:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746066813.355852:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746066813.355854:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677d180/2, rc 0, transno 21474842721 00002000:00010000:2.0:1746066813.355855:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066812 -> 1746066812 00000100:00100000:3.0:1746066813.355857:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105664:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066813.355857:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066812 -> 1746066812 00002000:00010000:2.0:1746066813.355859:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066812 -> 1746066812 00002000:00010000:2.0:1746066813.355860:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066813.355866:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105536 00000100:00100000:3.0:1746066813.355868:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105536 00000100:00100000:2.0:1746066813.355874:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985104256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 552us (718us total) trans 21474842720 rc 0/0 00000100:00100000:2.0:1746066813.355878:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20354 00000100:00100000:3.0:1746066813.355895:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20363 00000100:00100000:3.0:1746066813.355900:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882985105536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355906:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066813.355924:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d89c700/2, rc 0, transno 17179875366 00000100:00100000:2.0:1746066813.355928:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d89c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066813.355935:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c01880/2, rc 0, transno 21474842720 00000100:00100000:2.0:1746066813.355938:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355944:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.355949:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882985105536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (110us total) trans 21474842722 rc 0/0 00000100:00100000:3.0:1746066813.355955:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20363 00000100:00100000:2.0:1746066813.355962:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.355973:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.355987:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066813.356009:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066813.356012:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00002000:00010000:1.0:1746066813.356015:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066806 -> 1746066806 00002000:00010000:1.0:1746066813.356017:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00002000:00010000:1.0:1746066813.356018:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066813.356038:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3774:x1830882985104128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 725us (1016us total) trans 21474842719 rc 0/0 00000100:00100000:1.0:1746066813.356044:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20353 00000100:00100000:3.0:1746066813.356917:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985104896 00000100:00100000:3.0:1746066813.356922:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985104896 00000100:00100000:3.0:1746066813.356940:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105280 00000100:00100000:3.0:1746066813.356941:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105280 00000100:00100000:3.0:1746066813.356950:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20364 00000100:00100000:3.0:1746066813.356954:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3776:x1830882985104896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.357031:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882985104896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1123us total) trans 17179875373 rc 0/0 00000100:00100000:3.0:1746066813.357036:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20364 00000100:00100000:3.0:1746066813.357045:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105792 00000100:00100000:3.0:1746066813.357047:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105792 00000100:00100000:1.0:1746066813.357050:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20365 00000100:00100000:3.0:1746066813.357056:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20366 00000100:00100000:1.0:1746066813.357058:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985105280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.357060:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882985105792:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.357063:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5884700/2, rc 0, transno 17179875368 00000100:00100000:2.0:1746066813.357068:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066813.357077:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5884a80/2, rc 0, transno 17179875369 00000004:00080000:3.0:1746066813.357080:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c00380/2, rc 0, transno 21474842722 00000100:00100000:2.0:1746066813.357080:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104384:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066813.357082:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066813.357083:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985105536:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066813.357084:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066813 -> 1746066813 00000004:00080000:2.0:1746066813.357087:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d89ca80/2, rc 0, transno 17179875373 00002000:00010000:0.0:1746066813.357087:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066810 -> 1746066810 00000100:00100000:2.0:1746066813.357089:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985104896:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066813.357089:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066813 -> 1746066813 00002000:00010000:0.0:1746066813.357091:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066813.357096:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746066813.357101:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.357115:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882985103872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1808us (2148us total) trans 21474842723 rc 0/0 00000100:00100000:0.0:1746066813.357120:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20352 00000100:00100000:2.0:1746066813.357121:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.357131:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105408 00000100:00100000:0.0:1746066813.357134:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105408 00000100:00100000:0.0:1746066813.357150:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20367 00000100:00100000:0.0:1746066813.357154:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3776:x1830882985105408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.357162:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3776:x1830882985105792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (1174us total) trans 21474842725 rc 0/0 00000100:00100000:3.0:1746066813.357168:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20366 00000004:00080000:2.0:1746066813.357168:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677ed80/2, rc 0, transno 21474842725 00000100:00100000:2.0:1746066813.357172:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.357208:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3776:x1830882985105280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (1245us total) trans 21474842724 rc 0/0 00000100:00100000:3.0:1746066813.357213:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20365 00000100:00100000:0.0:1746066813.357213:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3776:x1830882985105408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (91us total) trans 21474842726 rc 0/0 00000100:00100000:0.0:1746066813.357218:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20367 00010000:00010000:2.0:1746066813.357231:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.357243:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.357246:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:0.0:1746066813.357249:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c02d80/2, rc 0, transno 21474842719 00000100:00100000:3.0:1746066813.357250:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985105920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066813.357250:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.357253:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985104128:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066813.357261:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746066813.357261:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c02680/2, rc 0, transno 21474842723 00000100:00100000:0.0:1746066813.357263:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985103872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.357266:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066813.357268:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.357275:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.357282:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.357288:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746066813.357305:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c01500/2, rc 0, transno 21474842726 00000100:00100000:2.0:1746066813.357308:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.357314:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097c03b80/2, rc 0, transno 21474842724 00000100:00100000:2.0:1746066813.357316:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985105280:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066813.357342:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.357352:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985106048:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.357424:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.357443:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985106176:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.357460:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066813.357909:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985105920 00000100:00100000:1.0:1746066813.357913:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985105920 00000100:00100000:1.0:1746066813.357930:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20368 00000100:00100000:1.0:1746066813.357934:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882985105920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.358011:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3777:x1830882985105920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (743us total) trans 17179875374 rc 0/0 00000100:00100000:1.0:1746066813.358017:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20368 00000004:00080000:3.0:1746066813.358066:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a9180/2, rc 0, transno 17179875374 00000100:00100000:3.0:1746066813.358070:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985105920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.359298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.359351:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409152 00000100:00100000:3.0:1746066813.359355:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409152 00000100:00100000:3.0:1746066813.359384:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17231 00000100:00100000:3.0:1746066813.359389:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3327:x1830882985409152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.359403:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.359417:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb1272 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7522 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.359475:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb1272 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7522 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.359486:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb1272 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7522 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.359502:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.359504:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066813.359507:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0000, rc 0) 00000100:00100000:3.0:1746066813.359533:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3327:x1830882985409152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.359538:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17231 00000100:00100000:2.0:1746066813.359625:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985106048:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.359633:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985106176:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.359661:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfb1256 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 30 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746066813.359682:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.359695:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46c00, rc 0) 00000100:00100000:2.0:1746066813.359714:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:3318:x1830882985408512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 30627us (30706us total) trans 8589937701 rc 0/0 00000100:00100000:2.0:1746066813.359720:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17228 00000100:00100000:0.0:1746066813.359854:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.359875:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409280 00000100:00100000:0.0:1746066813.359878:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409280 00000100:00100000:0.0:1746066813.359928:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6483 00000100:00100000:0.0:1746066813.359933:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3324:x1830882985409280:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:0.0:1746066813.359998:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3324:x1830882985409280:12345-192.168.204.16@tcp:49:cat.0 Request processed in 65us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.360003:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6483 00000100:00100000:0.0:1746066813.365476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.365636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.365662:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409408 00000100:00100000:2.0:1746066813.365679:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409408 00000100:00100000:1.0:1746066813.365693:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409536 00000100:00100000:0.0:1746066813.365694:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.365700:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409536 00000100:00100000:1.0:1746066813.365739:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6484 00000100:00100000:1.0:1746066813.365747:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3327:x1830882985409536:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066813.365868:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3327:x1830882985409536:12345-192.168.204.16@tcp:49:cat.0 Request processed in 121us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.365874:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6484 00000100:00100000:3.0:1746066813.365969:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409664 00000100:00100000:3.0:1746066813.365973:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409664 00000100:00100000:3.0:1746066813.366016:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 942 00000100:00100000:3.0:1746066813.366023:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985409664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.366034:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.366055:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfb1272 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7522 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.366079:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.366083:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.366124:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985409664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.366129:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 942 00000100:00100000:2.0:1746066813.366320:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6485 00000100:00100000:2.0:1746066813.366327:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985409408:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:2.0:1746066813.366399:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985409408:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 72us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.366404:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6485 00000100:00100000:0.0:1746066813.380527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.380642:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409792 00000100:00100000:2.0:1746066813.380651:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409792 00000100:00100000:2.0:1746066813.380713:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20369 00000100:00100000:2.0:1746066813.380722:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3320:x1830882985409792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.380742:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.380760:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7529 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.380792:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.380806:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.380813:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.380819:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.380821:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.380824:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1130496->2035711] (req 1130496->2035711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.380854:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.380865:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.380878:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106304:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.381755:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.381764:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 20 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.381773:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.381798:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.381804:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 7 pid: 13726 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.381810:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106560:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.381821:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.386855:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.387580:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985409920 00000100:00100000:1.0:1746066813.387589:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985409920 00000100:00100000:1.0:1746066813.387625:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20370 00000100:00100000:1.0:1746066813.387633:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:3318:x1830882985409920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066813.387655:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.387672:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7530 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.387702:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 9 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387710:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387716:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387721:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.387722:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.387725:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.387754:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387763:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.387774:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.387849:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387857:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 11 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.387864:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.387902:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 9 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.387909:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 9 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.387917:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106944:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.387944:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.388117:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.388126:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.388132:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985106560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.388154:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1130496->2035711] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.388164:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:2.0:1746066813.388187:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3320:x1830882985409792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7467us (7674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.388193:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20369 00000100:00100000:2.0:1746066813.388666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.389026:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410048 00000100:00100000:0.0:1746066813.389032:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410048 00010000:00010000:0.0:1746066813.389053:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.389081:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9302 00000100:00100000:0.0:1746066813.389087:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985410048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.389097:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.389115:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.389124:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.389143:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b41200/0xf1867c21abfb121e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c7 expref: 17 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.389166:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.389190:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985410048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 104us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.389196:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9302 00000100:00100000:1.0:1746066813.390050:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.390059:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106816:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.390065:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985106944:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.390086:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.390098:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45200, rc 0) 00000100:00100000:1.0:1746066813.390290:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:3318:x1830882985409920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2657us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.390296:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20370 00000100:00100000:0.0:1746066813.390590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.390613:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.390637:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.390948:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410176 00000100:00100000:2.0:1746066813.390954:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410176 00000100:00100000:3.0:1746066813.390971:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410304 00010000:00010000:2.0:1746066813.390976:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.390982:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410304 00000100:00100000:2.0:1746066813.390995:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410432 00000100:00100000:2.0:1746066813.390998:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410432 00010000:00010000:2.0:1746066813.391006:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.391017:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 8 pid: 13726 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.391018:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9303 00000100:00100000:2.0:1746066813.391024:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985410176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.391034:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.391048:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.391055:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9304 00010000:00010000:2.0:1746066813.391057:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.391063:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985410432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.391074:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32a00/0xf1867c21abfb1225 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74c0 expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.391075:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.391089:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.391092:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.391102:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.391107:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985410176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.391113:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9303 00010000:00010000:3.0:1746066813.391121:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944e00/0xf1867c21abfb1210 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ea expref: 36 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.391124:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9305 00000100:00100000:2.0:1746066813.391128:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985410304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.391135:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.391140:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 8 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.391145:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.391153:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 8 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.391164:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb1122 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7465 expref: 8 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.391171:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.391174:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.391180:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.391183:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985410432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (545us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066813.391188:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.391192:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9304 00010000:00010000:2.0:1746066813.391211:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.391222:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985107072:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066813.391417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.391441:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410560 00000100:00100000:0.0:1746066813.391444:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410560 00010000:00010000:0.0:1746066813.391457:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.391471:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9306 00000100:00100000:0.0:1746066813.391475:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985410560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.391481:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.391489:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.391497:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.391508:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf200/0xf1867c21abfb113e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d747a expref: 10 pid: 9591 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.391517:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.391529:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985410560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.391534:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9306 00000100:00100000:0.0:1746066813.391562:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.391719:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985410944 00000100:00100000:3.0:1746066813.391724:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985410944 00002000:00100000:3.0:1746066813.391749:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012b165500 x1830882985410944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.391757:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985410944 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.391761:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165500 00000100:00100000:3.0:1746066813.391775:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7634 00000100:00100000:3.0:1746066813.391780:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985410944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.392835:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.398193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.398925:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.399035:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985107072:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066813.399044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.399055:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.399107:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985410304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7976us (8491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.399116:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9305 00000100:00100000:1.0:1746066813.399310:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411072 00000100:00100000:1.0:1746066813.399319:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411072 00002000:00100000:1.0:1746066813.399359:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012b164e00 x1830882985411072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.399370:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164e00 with x1830882985411072 ext(3145728->4194303) 00010000:00010000:1.0:1746066813.399379:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.399392:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00002000:00010000:1.0:1746066813.399399:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b164e00 00000100:00100000:1.0:1746066813.399424:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411456 00000100:00100000:1.0:1746066813.399436:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411456 00002000:00100000:1.0:1746066813.399467:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->1134591) req@ffff88012b167480 x1830882985411456/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.399474:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167480 with x1830882985411456 ext(1130496->1134591) 00002000:00010000:1.0:1746066813.399477:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167480 00000100:00100000:1.0:1746066813.399488:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2187 00000100:00100000:1.0:1746066813.399494:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985411072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.399623:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7635 00000100:00100000:0.0:1746066813.399631:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985411456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.400215:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985411456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 585us (1171us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066813.400222:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7635 00000100:00100000:1.0:1746066813.400225:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411200 00000100:00100000:1.0:1746066813.400228:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411200 00002000:00100000:0.0:1746066813.400228:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->1134591) req@ffff88012b167480 x1830882985411456/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066813.400251:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20371 00000100:00100000:1.0:1746066813.400256:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:3324:x1830882985411200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.400265:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.400279:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7537 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.400299:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.400301:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.400307:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066813.400319:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167480 with x1830882985411456 ext(1130496->1134591) 00010000:00010000:1.0:1746066813.400321:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066813.400323:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167480 00010000:00010000:1.0:1746066813.400331:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:1.0:1746066813.400349:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:3324:x1830882985411200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 93us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.400354:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20371 00000100:00100000:0.0:1746066813.407125:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.407154:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.407221:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411584 00000100:00100000:2.0:1746066813.407232:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411584 00000100:00100000:2.0:1746066813.407272:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411712 00000100:00100000:2.0:1746066813.407274:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411712 00000100:00100000:2.0:1746066813.407298:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20372 00000100:00100000:2.0:1746066813.407305:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985411584:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066813.407322:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20373 00010000:00010000:2.0:1746066813.407323:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066813.407333:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985411712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.407340:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb128e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d753e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.407348:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.407363:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb1295 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7545 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.407380:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066813.407389:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107200:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066813.407390:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb1295 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7545 expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.407405:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb1295 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7545 expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.407417:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9400, rc 0) 00000100:00100000:3.0:1746066813.407459:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985411712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (303us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.407464:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20373 00000100:00100000:2.0:1746066813.407472:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.407494:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985410944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15713us (15930us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066813.407501:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7634 00002000:00100000:3.0:1746066813.407509:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012b165500 x1830882985410944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.407517:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985410944 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.407927:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165500 00002000:00010000:2.0:1746066813.410599:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066813 -> 1746066814 00002000:00010000:2.0:1746066813.410604:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066810 -> 1746066814 00002000:00010000:2.0:1746066813.410607:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066813 -> 1746066814 00000100:00100000:2.0:1746066813.410623:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107200:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066813.410649:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb128e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d753e expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.410661:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb128e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d753e expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.410681:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb600, rc 0) 00000100:00100000:2.0:1746066813.410716:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985411584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3411us (3596us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066813.410722:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20372 00000100:00100000:1.0:1746066813.410744:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985411072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11250us (12561us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066813.410751:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2187 00002000:00100000:1.0:1746066813.410758:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012b164e00 x1830882985411072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.410765:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164e00 with x1830882985411072 ext(3145728->4194303) 00010000:00010000:1.0:1746066813.410772:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.410781:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00002000:00010000:1.0:1746066813.410787:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b164e00 00000100:00100000:0.0:1746066813.413164:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.413217:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985411968 00000100:00100000:1.0:1746066813.413225:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985411968 00002000:00100000:1.0:1746066813.413259:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff8800966e1c00 x1830882985411968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.413268:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985411968 ext(4857856->4861951) 00002000:00010000:1.0:1746066813.413272:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:1.0:1746066813.413339:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7636 00000100:00100000:1.0:1746066813.413346:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985411968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.413457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.413468:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985411968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 122us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066813.413473:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7636 00002000:00100000:1.0:1746066813.413478:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff8800966e1c00 x1830882985411968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.413484:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985411968 ext(4857856->4861951) 00002000:00010000:1.0:1746066813.413487:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:2.0:1746066813.413789:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985412096 00000100:00100000:2.0:1746066813.413793:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985412096 00000100:00100000:2.0:1746066813.413821:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20374 00000100:00100000:2.0:1746066813.413826:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3327:x1830882985412096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.413835:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.413847:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d754c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.413867:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.413869:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.413875:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.413917:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.413927:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb800, rc 0) 00000100:00100000:2.0:1746066813.413950:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3327:x1830882985412096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 124us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.413955:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20374 00000100:00100000:0.0:1746066813.414846:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.415192:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985412224 00000100:00100000:3.0:1746066813.415197:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985412224 00010000:00010000:3.0:1746066813.415217:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 13 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.415236:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9307 00000100:00100000:3.0:1746066813.415241:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985412224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.415251:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.415263:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 13 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.415277:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 13 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.415291:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfb1217 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f1 expref: 13 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.415316:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.415318:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.415323:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.415331:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.415353:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.415363:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985107328:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066813.415414:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.417307:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985107328:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066813.417320:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.417325:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.417366:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985412224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2124us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.417373:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9307 00000100:00100000:0.0:1746066813.417392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.417419:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985412480 00000100:00100000:1.0:1746066813.417437:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985412480 00000100:00100000:2.0:1746066813.417457:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985412736 00000100:00100000:2.0:1746066813.417460:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985412736 00002000:00100000:1.0:1746066813.417466:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3022847) req@ffff8800966e3480 x1830882985412480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.417473:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e0000 x1830882985412736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.417474:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985412480 ext(3018752->3022847) 00002000:00100000:2.0:1746066813.417478:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0000 with x1830882985412736 ext(3145728->4194303) 00002000:00010000:1.0:1746066813.417478:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00002000:00010000:2.0:1746066813.417481:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0000 00000100:00100000:1.0:1746066813.417491:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7637 00000100:00100000:1.0:1746066813.417496:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985412480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.417588:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985412480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 91us (268us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066813.417594:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7637 00002000:00100000:1.0:1746066813.417598:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3022847) req@ffff8800966e3480 x1830882985412480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.417604:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985412480 ext(3018752->3022847) 00002000:00010000:1.0:1746066813.417607:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:1.0:1746066813.417617:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7638 00000100:00100000:1.0:1746066813.417621:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985412736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.420783:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.420828:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.420949:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985412992 00000100:00100000:2.0:1746066813.420958:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985412992 00002000:00100000:2.0:1746066813.420992:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (2031616->2035711) req@ffff8800966e2300 x1830882985412992/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.421001:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985412992 ext(2031616->2035711) 00002000:00010000:2.0:1746066813.421005:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:2.0:1746066813.421033:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7639 00000100:00100000:2.0:1746066813.421040:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985412992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.421250:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413120 00000100:00100000:3.0:1746066813.421254:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413120 00000100:00100000:3.0:1746066813.421287:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20375 00000100:00100000:3.0:1746066813.421293:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:3318:x1830882985413120:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.421301:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.421313:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7553 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.421335:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 6 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421341:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421347:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421353:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.421355:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.421358:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2998271] (req 2097152->2998271) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.421382:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421392:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.421402:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107456:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.421445:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985412992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 404us (669us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066813.421451:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7639 00002000:00100000:2.0:1746066813.421457:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (2031616->2035711) req@ffff8800966e2300 x1830882985412992/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.421463:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985412992 ext(2031616->2035711) 00002000:00010000:2.0:1746066813.421466:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00010000:00010000:3.0:1746066813.421472:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421479:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.421490:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107584:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.421517:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 6 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.421523:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 6 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.421530:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107712:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.421545:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.424158:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.424159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.424168:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107584:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.424175:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.424184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.424201:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2998271] (req 2097152->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.424204:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413248 00000100:00100000:0.0:1746066813.424209:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413248 00010000:00010000:3.0:1746066813.424215:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9c00, rc 0) 00010000:00010000:0.0:1746066813.424229:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 22 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.424248:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:3318:x1830882985413120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2955us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.424253:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413376 00000100:00100000:0.0:1746066813.424255:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413376 00000100:00100000:3.0:1746066813.424258:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20375 00010000:00010000:0.0:1746066813.424262:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 7 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.424273:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9308 00000100:00100000:0.0:1746066813.424278:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985413248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066813.424284:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985412736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6660us (6890us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.424285:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9309 00010000:00010000:0.0:1746066813.424288:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066813.424290:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985413376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066813.424292:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7638 00010000:00010000:3.0:1746066813.424298:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746066813.424299:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e0000 x1830882985412736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746066813.424301:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.424307:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 7 pid: 9592 timeout: 881 lvb_type: 1 00002000:00100000:1.0:1746066813.424307:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0000 with x1830882985412736 ext(3145728->4194303) 00010000:00010000:0.0:1746066813.424309:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 881 lvb_type: 1 00002000:00010000:1.0:1746066813.424311:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0000 00010000:00010000:3.0:1746066813.424317:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 7 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.424332:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb1241 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74f8 expref: 21 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.424373:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.424375:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb1137 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7481 expref: 7 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.424387:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.424387:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985413248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.424392:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9308 00000100:00100000:3.0:1746066813.424404:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985413376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 114us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.424410:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9309 00000100:00100000:0.0:1746066813.426313:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.426594:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413504 00000100:00100000:2.0:1746066813.426602:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413504 00010000:00010000:2.0:1746066813.426629:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.426663:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9310 00000100:00100000:2.0:1746066813.426673:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985413504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.426682:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.426697:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.426708:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.426724:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfb123a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ff expref: 16 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.426757:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.426759:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.426765:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.426772:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.426799:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.426809:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985107840:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066813.428160:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.428205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.428238:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.428303:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413760 00000100:00100000:3.0:1746066813.428308:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413760 00000100:00100000:3.0:1746066813.428336:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6486 00000100:00100000:3.0:1746066813.428341:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3320:x1830882985413760:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066813.428577:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3320:x1830882985413760:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 235us (424us total) trans 8589937702 rc 0/0 00000100:00100000:3.0:1746066813.428582:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6486 00000100:00100000:3.0:1746066813.428602:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985413888 00000100:00100000:3.0:1746066813.428605:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985413888 00000100:00100000:3.0:1746066813.428626:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20376 00000100:00100000:3.0:1746066813.428630:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3327:x1830882985413888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.428637:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.428647:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d755a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.429093:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.429101:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066813.429102:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066813.429105:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 17 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.429126:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.429136:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.429145:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107968:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.429402:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.429869:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985107840:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.429900:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.429923:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985413504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3254us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.429930:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9310 00000100:00100000:3.0:1746066813.433525:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985107968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.433554:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.433574:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8000, rc 0) 00000100:00100000:3.0:1746066813.433627:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3327:x1830882985413888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4994us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.433634:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20376 00000100:00100000:0.0:1746066813.435175:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.435234:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985414144 00000100:00100000:1.0:1746066813.435241:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985414144 00002000:00100000:1.0:1746066813.435273:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2994176->2998271) req@ffff88012b167800 x1830882985414144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.435279:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167800 with x1830882985414144 ext(2994176->2998271) 00010000:00010000:1.0:1746066813.435285:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.435294:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746066813.435299:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b167800 00000100:00100000:1.0:1746066813.435322:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2188 00000100:00100000:1.0:1746066813.435328:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882985414144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.435461:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882985414144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 132us (295us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066813.435467:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2188 00002000:00100000:1.0:1746066813.435472:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2994176->2998271) req@ffff88012b167800 x1830882985414144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.435483:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167800 with x1830882985414144 ext(2994176->2998271) 00010000:00010000:1.0:1746066813.435487:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.435496:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746066813.435501:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b167800 00000100:00100000:0.0:1746066813.439380:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.439454:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.439559:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985414528 00000100:00100000:1.0:1746066813.439571:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985414528 00002000:00100000:1.0:1746066813.439612:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2998271) req@ffff88009c774700 x1830882985414528/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.439621:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985414528 ext(2097152->2998271) 00010000:00010000:1.0:1746066813.439629:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.439645:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 20 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746066813.439651:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c774700 00000100:00100000:1.0:1746066813.439692:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2189 00000100:00100000:1.0:1746066813.439699:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985414528:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066813.440014:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985414656 00000100:00100000:2.0:1746066813.440018:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985414656 00000100:00100000:2.0:1746066813.440051:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6487 00000100:00100000:2.0:1746066813.440057:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3318:x1830882985414656:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066813.440202:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3318:x1830882985414656:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 145us (834us total) trans 8589937703 rc 0/0 00000100:00100000:2.0:1746066813.440211:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6487 00000100:00100000:1.0:1746066813.446731:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985414528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7023us (7268us total) trans 21474842727 rc 0/0 00000100:00100000:1.0:1746066813.446743:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2189 00002000:00100000:1.0:1746066813.446752:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2998271) req@ffff88009c774700 x1830882985414528/t21474842727(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.446761:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985414528 ext(2097152->2998271) 00010000:00010000:1.0:1746066813.446769:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.446783:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746066813.446790:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c774700 00000100:00100000:0.0:1746066813.451040:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.451128:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985414784 00000100:00100000:2.0:1746066813.451136:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985414784 00010000:00010000:2.0:1746066813.451167:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.451201:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9311 00000100:00100000:2.0:1746066813.451207:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985414784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.451217:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066813.451230:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066812 -> 1746066814 00002000:00010000:2.0:1746066813.451233:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066812 -> 1746066814 00010000:00010000:2.0:1746066813.451237:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.451247:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.451264:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb12a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2998271) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7553 expref: 22 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.451287:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.451289:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.451294:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.451301:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.451326:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.451336:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985108096:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.451400:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.453978:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985108096:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.454005:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.454352:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985414784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3141us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.454363:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9311 00000100:00100000:0.0:1746066813.456782:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.456922:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415040 00000100:00100000:1.0:1746066813.456932:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415040 00002000:00100000:1.0:1746066813.456983:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009d9b0700 x1830882985415040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.456994:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882985415040 ext(3145728->4194303) 00002000:00010000:1.0:1746066813.457000:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:1.0:1746066813.457020:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7640 00000100:00100000:1.0:1746066813.457028:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985415040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.462760:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985415040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5719us (5974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066813.462772:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7640 00002000:00100000:1.0:1746066813.462788:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009d9b0700 x1830882985415040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.462796:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882985415040 ext(3145728->4194303) 00002000:00010000:1.0:1746066813.462803:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:0.0:1746066813.466601:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.466725:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415168 00000100:00100000:3.0:1746066813.466739:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415168 00000100:00100000:3.0:1746066813.466808:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20377 00000100:00100000:3.0:1746066813.466816:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985415168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.466831:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.466846:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb12b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7561 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.466876:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb12b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7561 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.466916:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb12b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7561 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.466931:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8a00, rc 0) 00000100:00100000:3.0:1746066813.466989:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985415168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 174us (399us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.466995:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20377 00000100:00100000:0.0:1746066813.470369:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.470469:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415424 00000100:00100000:1.0:1746066813.470481:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415424 00002000:00100000:1.0:1746066813.470530:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a59c5500 x1830882985415424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.470540:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5500 with x1830882985415424 ext(4194304->4861951) 00002000:00010000:1.0:1746066813.470545:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5500 00000100:00100000:1.0:1746066813.470834:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7641 00000100:00100000:1.0:1746066813.470843:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985415424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.475178:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985415424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4323us (4802us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066813.475190:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7641 00002000:00100000:1.0:1746066813.475201:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a59c5500 x1830882985415424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.475215:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5500 with x1830882985415424 ext(4194304->4861951) 00002000:00010000:1.0:1746066813.475222:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5500 00000100:00100000:0.0:1746066813.479280:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.479824:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415552 00000100:00100000:3.0:1746066813.479833:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415552 00000100:00100000:3.0:1746066813.479909:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20378 00000100:00100000:3.0:1746066813.479918:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985415552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.479936:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.479952:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb12b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7568 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.479984:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb12b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7568 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.479994:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb12b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7568 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.480168:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9400, rc 0) 00000100:00100000:3.0:1746066813.480221:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985415552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 304us (951us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.480226:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20378 00000100:00100000:0.0:1746066813.482186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.482277:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415680 00000100:00100000:3.0:1746066813.482285:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415680 00000100:00100000:3.0:1746066813.482391:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20379 00000100:00100000:3.0:1746066813.482399:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985415680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.482417:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.482444:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d756f expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.482475:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12bf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d756f expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.482484:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d756f expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.482497:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8e00, rc 0) 00000100:00100000:3.0:1746066813.483065:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985415680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 665us (885us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.483071:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20379 00000100:00100000:0.0:1746066813.501851:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.501931:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415808 00000100:00100000:2.0:1746066813.501940:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415808 00000100:00100000:2.0:1746066813.501999:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17232 00000100:00100000:2.0:1746066813.502007:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+6:3332:x1830882985415808:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.502032:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.502051:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb12c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7576 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.502342:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502356:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502367:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502384:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502389:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502395:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502634:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502643:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502649:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066813.502687:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066813.502692:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066813.502713:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502722:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502731:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502736:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502741:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502751:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502756:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbebc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.502760:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502766:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502777:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066813.502780:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.502784:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502789:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb12cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502818:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502823:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502828:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502832:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbeb400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.502835:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502840:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502850:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855a00) 00010000:00010000:2.0:1746066813.502852:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.502854:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502858:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.502906:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb12c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.502920:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.502925:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.502927:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066813.502930:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeae00, rc 0) 00000100:00100000:2.0:1746066813.502990:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3332:x1830882985415808:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 983us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.502996:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17232 00000100:00100000:0.0:1746066813.505676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.505744:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985415936 00000100:00100000:3.0:1746066813.505754:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985415936 00000100:00100000:3.0:1746066813.505807:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20380 00000100:00100000:3.0:1746066813.505815:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2013:x1830882985415936:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066813.505877:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.505933:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb12e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d757d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.505986:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985108224:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066813.506080:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.506295:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.506329:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.506388:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416064 00000100:00100000:1.0:1746066813.506393:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416064 00000100:00100000:1.0:1746066813.506455:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416192 00000100:00100000:1.0:1746066813.506457:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416192 00000100:00100000:1.0:1746066813.506532:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20381 00000100:00100000:3.0:1746066813.506551:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20382 00000100:00100000:3.0:1746066813.506557:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985416192:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066813.506563:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.506572:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d758b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.506599:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985416064:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066813.506609:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.506618:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfb12f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7584 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.506636:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfb12f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7584 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.506645:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfb12f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7584 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.506667:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:1.0:1746066813.506697:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985416064:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 159us (402us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066813.506706:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20381 00010000:00010000:3.0:1746066813.506742:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.506744:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.506757:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.506775:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.506783:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8e00, rc 0) 00000100:00100000:3.0:1746066813.506800:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985416192:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 245us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.506805:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20382 00000100:00100000:3.0:1746066813.507669:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985108224:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066813.507702:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb12e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d757d expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.507714:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb12e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d757d expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.507751:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8200, rc 0) 00000100:00100000:3.0:1746066813.507813:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985415936:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1998us (2147us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.507821:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20380 00000100:00100000:1.0:1746066813.509777:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.509844:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416448 00000100:00100000:2.0:1746066813.509855:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416448 00000100:00100000:2.0:1746066813.509936:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17233 00000100:00100000:2.0:1746066813.509945:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3332:x1830882985416448:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.509962:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.509980:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb12f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7592 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.510089:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.510103:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.510111:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.510140:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.510152:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.510163:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985108352:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.510251:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.511848:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985108352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.511867:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066813.512608:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.512652:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416576 00000100:00100000:2.0:1746066813.512657:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416576 00010000:00010000:2.0:1746066813.512683:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.512713:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9312 00000100:00100000:2.0:1746066813.512720:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985416576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.512733:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.512741:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.512751:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.512770:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb12db lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7576 expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.512799:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.512804:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.512812:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.512818:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066813.512840:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.512878:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985416576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.512903:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9312 00010000:00010000:3.0:1746066813.513070:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.513083:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066813.513104:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.513223:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb12f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7592 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.513258:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7592 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.513847:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.513850:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066813.513852:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb400, rc 0) 00000100:00100000:3.0:1746066813.513951:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3332:x1830882985416448:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4005us (4179us total) trans 8589937704 rc 0/0 00000100:00100000:3.0:1746066813.513959:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17233 00000100:00100000:0.0:1746066813.516871:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.516975:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416832 00000100:00100000:3.0:1746066813.516987:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416832 00000100:00100000:3.0:1746066813.517045:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17234 00000100:00100000:3.0:1746066813.517053:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3332:x1830882985416832:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066813.517074:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.517077:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066813.517099:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb12fe lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7592 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.517114:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.517118:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.517127:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb130c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7599 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.517211:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.517222:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.517230:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066813.517239:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.517316:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb130c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.517328:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.517334:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.517335:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066813.517338:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9400, rc 0) 00000100:00100000:3.0:1746066813.517395:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3332:x1830882985416832:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 342us (534us total) trans 8589937705 rc 0/0 00000100:00100000:3.0:1746066813.517401:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17234 00000100:00100000:0.0:1746066813.521329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.521493:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985416960 00000100:00100000:3.0:1746066813.521502:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985416960 00000100:00100000:3.0:1746066813.521557:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17235 00000100:00100000:3.0:1746066813.521565:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3332:x1830882985416960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066813.521594:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.521613:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb1321 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75a0 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.521670:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb1321 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75a0 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.521681:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb1321 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75a0 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.521697:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.521700:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066813.521703:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9c00, rc 0) 00000100:00100000:3.0:1746066813.521758:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3332:x1830882985416960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 193us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.521763:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17235 00000100:00100000:2.0:1746066813.525800:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.525993:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417088 00000100:00100000:0.0:1746066813.526002:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417088 00000100:00100000:2.0:1746066813.526089:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.526196:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417216 00000100:00100000:0.0:1746066813.526199:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417216 00000100:00100000:2.0:1746066813.526212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.526353:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417472 00000100:00100000:3.0:1746066813.526357:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417472 00000100:00100000:2.0:1746066813.526368:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20383 00000100:00100000:2.0:1746066813.526376:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985417088:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746066813.526381:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20384 00000100:00100000:3.0:1746066813.526385:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985417216:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066813.526421:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.526421:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.526452:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.526452:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.526459:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066813.526460:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.526461:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066813.526464:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.526467:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 35 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.526471:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.526472:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.526474:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.526493:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.526493:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 35 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.526505:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 15 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.526505:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 35 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.526520:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985108480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.526520:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.526649:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20385 00000100:00100000:1.0:1746066813.526657:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985417472:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066813.526680:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.526691:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.526697:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 35 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.526704:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.526710:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.526711:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.526713:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.526730:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.526737:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 11 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.526745:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985108736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.526806:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.526807:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.526819:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 11 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.526826:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.526849:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.526856:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 10 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.526863:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.526879:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.526904:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.526917:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417728 00000100:00100000:2.0:1746066813.526920:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417728 00000100:00100000:2.0:1746066813.526937:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417344 00000100:00100000:2.0:1746066813.526938:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417344 00000100:00100000:2.0:1746066813.526950:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20386 00000100:00100000:2.0:1746066813.526954:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985417728:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066813.526969:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.526974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.526978:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.526985:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.526991:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.526992:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.526994:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 5/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.527003:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417600 00000100:00100000:0.0:1746066813.527006:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417600 00010000:00010000:2.0:1746066813.527009:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.527017:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 9 pid: 13726 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.527024:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985109120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.527025:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20387 00000100:00100000:0.0:1746066813.527030:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985417344:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066813.527044:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.527053:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.527054:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.527060:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.527061:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.527068:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985109248:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066813.527068:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.527072:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.527073:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.527075:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.527080:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00010000:00010000:0.0:1746066813.527089:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.527094:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20388 00010000:00010000:0.0:1746066813.527097:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 20 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.527098:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985417600:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:0.0:1746066813.527105:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.527112:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.527126:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.527127:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.527133:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 15 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.527134:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.527140:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.527140:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.527145:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746066813.527146:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746066813.527148:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.527156:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.527161:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.527162:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 9 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.527168:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746066813.527169:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.527174:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985109760:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.527180:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066813.527193:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.527199:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.527211:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985109888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.527229:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.527235:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.527241:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985110016:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.527249:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.527503:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066813.527591:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 35 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.527612:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 35 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.527621:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985110144:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.527643:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.527650:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 11 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.527657:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985110272:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.527684:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.536470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.536502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.536533:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.536561:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417856 00000100:00100000:3.0:1746066813.536562:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985417984 00000100:00100000:3.0:1746066813.536568:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417984 00000100:00100000:0.0:1746066813.536568:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985417856 00010000:00010000:3.0:1746066813.536607:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 12 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.536627:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418112 00000100:00100000:3.0:1746066813.536631:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9313 00000100:00100000:1.0:1746066813.536631:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418112 00000100:00100000:3.0:1746066813.536638:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985417984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.536654:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.536675:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 12 pid: 9590 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.536687:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 12 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.536711:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f761500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.536714:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.536722:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.536732:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2800/0xf1867c21abfb111b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d745e expref: 12 pid: 9590 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746066813.536756:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985417984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.536760:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985108992:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.536762:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9313 00010000:00010000:2.0:1746066813.536784:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.536842:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 36 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.536871:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9314 00000100:00100000:0.0:1746066813.536876:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985417856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.536902:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.536909:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 36 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.536919:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 36 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.536930:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3000/0xf1867c21abfb11f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b9 expref: 36 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.536942:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066813.536979:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.536995:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9315 00000100:00100000:1.0:1746066813.537001:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985418112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066813.537007:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066813.537015:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537023:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537035:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfb11fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74b2 expref: 12 pid: 13363 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537053:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.537054:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.537059:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.537067:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.537083:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066813.537138:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537146:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537167:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537174:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537181:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537187:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbebc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066813.537191:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537198:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537208:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.537214:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbebc00/0xf1867c21abfb1328 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.537229:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985417856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 352us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.537235:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9314 00000100:00100000:1.0:1746066813.537251:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985418112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 251us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.537256:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9315 00000100:00100000:2.0:1746066813.537258:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985417088:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 10883us (11470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.537266:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20383 00000100:00100000:2.0:1746066813.537298:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985109248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.537330:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985109120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.537342:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.537370:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.537788:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.537809:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.537816:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.537817:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985109632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.537829:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066813.537835:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.537850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.537862:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418368 00000100:00100000:2.0:1746066813.537866:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418368 00000100:00100000:1.0:1746066813.537897:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418624 00010000:00010000:2.0:1746066813.537899:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 10 pid: 13726 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.537900:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418624 00010000:00010000:1.0:1746066813.537911:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 11 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.537915:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418240 00000100:00100000:2.0:1746066813.537917:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418240 00000100:00100000:1.0:1746066813.537925:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418496 00000100:00100000:1.0:1746066813.537927:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418496 00010000:00010000:2.0:1746066813.537928:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.537937:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9316 00010000:00010000:1.0:1746066813.537938:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 16 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.537942:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985418368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066813.537948:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9317 00010000:00010000:2.0:1746066813.537949:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066813.537953:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985418624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066813.537959:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.537961:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 11 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537967:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 11 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.537969:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 11 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537975:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 11 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.537986:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb12e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d758b expref: 11 pid: 13726 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.537986:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82200/0xf1867c21abfb1129 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d746c expref: 11 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.537995:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066813.537995:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.538015:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985418368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.538015:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985418624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.538021:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9317 00000100:00100000:2.0:1746066813.538341:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9316 00000100:00100000:1.0:1746066813.538354:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9318 00000100:00100000:3.0:1746066813.538360:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9319 00000100:00100000:1.0:1746066813.538361:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985418240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066813.538366:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985418496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.538371:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.538380:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 16 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.538388:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 16 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.538400:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b945c00/0xf1867c21abfb1209 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74d5 expref: 16 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746066813.538413:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.538437:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985418496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.538443:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9319 00000100:00100000:3.0:1746066813.538479:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985109760:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.538488:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985109888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.538506:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066813.538514:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746066813.538523:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.538531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.538533:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82e00/0xf1867c21abfb1202 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74ce expref: 21 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.538546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.538546:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.538547:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.538550:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.538556:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.538557:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.538570:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.538571:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.538585:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985418240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 225us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.538589:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985110016:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.538589:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.538591:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9318 00000100:00100000:1.0:1746066813.538599:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418880 00000100:00100000:1.0:1746066813.538602:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418880 00010000:00010000:3.0:1746066813.538606:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.538611:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.538618:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985418752 00000100:00100000:3.0:1746066813.538620:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985418752 00010000:00010000:3.0:1746066813.538629:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.538629:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419136 00000100:00100000:1.0:1746066813.538631:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419136 00000100:00100000:2.0:1746066813.538638:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9320 00010000:00010000:1.0:1746066813.538638:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.538644:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985418880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.538653:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.538664:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.538672:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.538672:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.538678:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.538683:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb1287 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7537 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.538691:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.538692:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066813.538697:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.538702:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.538707:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985418880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066813.538712:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066813.538715:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.538725:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.538736:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.538741:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfb1344 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.538776:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985417344:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11745us (11894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.538784:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20387 00000100:00100000:3.0:1746066813.538834:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9321 00000100:00100000:3.0:1746066813.538840:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985418752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.538847:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066813.538851:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9320 00010000:00010000:3.0:1746066813.538855:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.538863:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.538873:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb12aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d755a expref: 15 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.538880:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066813.538881:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.538897:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.538899:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.538906:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.538908:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419392 00000100:00100000:0.0:1746066813.538911:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419392 00000100:00100000:2.0:1746066813.538913:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066813.538920:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066813.538922:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 12 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.538923:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419520 00000100:00100000:2.0:1746066813.538925:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419520 00000100:00100000:0.0:1746066813.538933:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9322 00000100:00100000:3.0:1746066813.538934:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985418752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (375us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066813.538936:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 34 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.538937:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985419392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066813.538939:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9321 00010000:00010000:0.0:1746066813.538943:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066813.538947:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9323 00010000:00010000:0.0:1746066813.538951:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 12 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.538952:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985419520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.538959:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 12 pid: 1893 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.538960:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066813.538964:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985108480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.538966:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 34 pid: 9592 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746066813.538970:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.538973:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.538974:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 34 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746066813.538982:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985419392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (101us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066813.538985:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.538987:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419008 00000100:00100000:0.0:1746066813.538987:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9322 00000100:00100000:3.0:1746066813.538989:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419008 00000100:00100000:2.0:1746066813.538999:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985419520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.539004:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9323 00002000:00100000:3.0:1746066813.539012:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->2035711) req@ffff88011f762300 x1830882985419008/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066813.539020:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066813.539021:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762300 with x1830882985419008 ext(1130496->2035711) 00010000:00010000:3.0:1746066813.539026:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 14 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.539026:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.539035:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 14 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.539039:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066813.539041:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f762300 00000100:00100000:1.0:1746066813.539043:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9324 00010000:00010000:2.0:1746066813.539045:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.539047:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985419136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066813.539051:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419264 00010000:00010000:2.0:1746066813.539051:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.539053:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419264 00010000:00010000:1.0:1746066813.539054:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.539057:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ecfa00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066813.539059:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539060:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 881 lvb_type: 0 00002000:00100000:3.0:1746066813.539062:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3145727) req@ffff880094372300 x1830882985419264/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066813.539065:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066813.539069:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372300 with x1830882985419264 ext(3018752->3145727) 00010000:00010000:1.0:1746066813.539069:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.539073:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 34 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.539074:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.539079:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 34 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.539079:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfb129c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d754c expref: 11 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.539080:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfb133d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066813.539085:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094372300 00010000:00010000:1.0:1746066813.539087:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.539095:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2190 00000100:00100000:3.0:1746066813.539099:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985419008:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066813.539100:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985419136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.539104:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9324 00000100:00100000:2.0:1746066813.539107:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985417728:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12152us (12300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.539112:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20386 00010000:00010000:1.0:1746066813.539133:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ece400/0xf1867c21abfb122c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74e3 expref: 9 pid: 1893 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.539141:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985108736:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.539147:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfb1233 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d74dc expref: 34 pid: 9592 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.539154:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985110144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.539161:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985110272:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.539163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.539171:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.539177:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419648 00000100:00100000:2.0:1746066813.539179:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419648 00000100:00100000:1.0:1746066813.539189:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2191 00010000:00010000:2.0:1746066813.539191:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.539193:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985419264:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066813.539208:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9325 00000100:00100000:2.0:1746066813.539213:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985419648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.539219:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.539226:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.539234:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.539245:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3a00/0xf1867c21abfb1130 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7473 expref: 10 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.539254:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.539255:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.539257:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.539263:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.539287:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.539302:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985419648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.539310:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9325 00010000:00010000:1.0:1746066813.539368:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539375:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539387:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539393:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539398:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539404:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066813.539406:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539412:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539421:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.539437:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb1336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.539477:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985417472:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12822us (13264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.539483:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20385 00000100:00100000:3.0:1746066813.547921:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985419008:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8812us (9381us total) trans 21474842728 rc 0/0 00000100:00100000:3.0:1746066813.547933:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2190 00002000:00100000:3.0:1746066813.547945:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->2035711) req@ffff88011f762300 x1830882985419008/t21474842728(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.547953:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762300 with x1830882985419008 ext(1130496->2035711) 00010000:00010000:3.0:1746066813.547963:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.547977:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00002000:00010000:3.0:1746066813.547983:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f762300 00000100:00100000:0.0:1746066813.550579:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.550635:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419776 00000100:00100000:2.0:1746066813.550647:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419776 00010000:00010000:2.0:1746066813.550687:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.550726:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9326 00000100:00100000:2.0:1746066813.550733:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985419776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.550748:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.550768:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.550779:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.550804:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1279 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7529 expref: 16 pid: 12233 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.550835:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.550837:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.550842:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.550850:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.550902:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.550947:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985419776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 214us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.550953:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9326 00010000:00010000:3.0:1746066813.551210:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551220:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551234:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551240:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551246:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551252:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066813.551256:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551263:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551273:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.551277:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8200/0xf1867c21abfb132f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.551315:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+5:2015:x1830882985417216:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 24929us (25226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.551322:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20384 00000100:00100000:1.0:1746066813.551652:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985419264:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12457us (13061us total) trans 17179875375 rc 0/0 00000100:00100000:1.0:1746066813.551661:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2191 00002000:00100000:1.0:1746066813.551670:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3018752->3145727) req@ffff880094372300 x1830882985419264/t17179875375(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.551678:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372300 with x1830882985419264 ext(3018752->3145727) 00010000:00010000:1.0:1746066813.551685:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.551698:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746066813.551703:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094372300 00000100:00100000:0.0:1746066813.554168:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.554467:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985419904 00000100:00100000:2.0:1746066813.554476:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985419904 00010000:00010000:2.0:1746066813.554512:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.554580:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9327 00000100:00100000:2.0:1746066813.554589:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985419904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.554602:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066813.554618:0:11928:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066812 -> 1746066814 00002000:00010000:2.0:1746066813.554621:0:11928:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066812 -> 1746066814 00010000:00010000:2.0:1746066813.554626:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.554637:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.554661:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfb1280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7530 expref: 35 pid: 1893 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.554676:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.554677:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.554682:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.554690:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.554726:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.554781:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.554790:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.554806:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.554849:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985419904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 258us (685us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066813.554954:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.554957:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9327 00010000:00010000:3.0:1746066813.554962:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.554973:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03cd200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066813.554977:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.554984:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.554995:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.555001:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb134b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.555045:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985417600:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 27946us (28070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.555052:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20388 00000100:00100000:0.0:1746066813.557371:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.557450:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420160 00000100:00100000:3.0:1746066813.557458:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420160 00000100:00100000:3.0:1746066813.557492:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17236 00000100:00100000:3.0:1746066813.557499:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3332:x1830882985420160:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746066813.557545:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.557568:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfb1321 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75a0 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.557583:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.557588:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.557612:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.557623:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.557630:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.557636:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.557641:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.557667:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.557677:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 9 pid: 7243 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.557690:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110400:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.558080:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.558095:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 29 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.558108:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110528:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.558156:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.558164:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 29 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.558171:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.558188:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.559985:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.560015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.560057:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420416 00000100:00100000:2.0:1746066813.560064:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420416 00000100:00100000:1.0:1746066813.560080:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420288 00000100:00100000:1.0:1746066813.560084:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420288 00010000:00010000:2.0:1746066813.560089:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 30 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746066813.560091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066813.560100:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.560110:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420544 00000100:00100000:2.0:1746066813.560112:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420544 00010000:00010000:2.0:1746066813.560118:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 31 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746066813.560119:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9328 00000100:00100000:0.0:1746066813.560125:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9329 00000100:00100000:1.0:1746066813.560126:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985420416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066813.560136:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066813.560141:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 31 pid: 10125 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.560142:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9330 00000100:00100000:2.0:1746066813.560147:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985420544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066813.560150:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 31 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.560154:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.560158:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 31 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.560166:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 31 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746066813.560176:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066813.560180:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066813.560188:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.560191:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.560192:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.560195:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.560201:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a400/0xf1867c21abfb1264 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7514 expref: 31 pid: 10125 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.560201:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.560214:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.560217:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985420544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.560218:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882985420416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (237us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066813.560222:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb125d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d750d expref: 30 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.560223:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9330 00000100:00100000:1.0:1746066813.560226:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9328 00000100:00100000:3.0:1746066813.560230:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985110656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.560254:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066813.560413:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985420288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.560421:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.560439:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.560448:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.560460:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb126b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d751b expref: 10 pid: 7243 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.560484:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066813.560488:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066813.560494:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066813.560500:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066813.560612:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.560632:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985420288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 500us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.560637:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9329 00000100:00100000:1.0:1746066813.560663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.560690:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420800 00000100:00100000:0.0:1746066813.560693:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420800 00010000:00010000:3.0:1746066813.560720:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.560726:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:3.0:1746066813.560949:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1211, 88 off114152 00000004:00080000:3.0:1746066813.560953:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772069840ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561030:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1220, 88 off114864 00000004:00080000:3.0:1746066813.561034:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772150981ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561065:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1221, 88 off114952 00000004:00080000:3.0:1746066813.561068:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772184520ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561080:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1212, 88 off114240 00000004:00080000:3.0:1746066813.561083:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772200023ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561091:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1213, 88 off114328 00000004:00080000:3.0:1746066813.561093:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772210285ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561101:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1222, 88 off115040 00000004:00080000:3.0:1746066813.561103:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772219605ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561114:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1223, 88 off115128 00000004:00080000:3.0:1746066813.561117:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772233481ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561128:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1224, 88 off115216 00000004:00080000:3.0:1746066813.561130:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772246938ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561141:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1214, 88 off114416 00000004:00080000:3.0:1746066813.561144:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772260428ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561151:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1225, 88 off115304 00000004:00080000:3.0:1746066813.561153:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772270271ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561163:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1215, 88 off114504 00000004:00080000:3.0:1746066813.561166:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772282728ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561173:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1226, 88 off115392 00000004:00080000:3.0:1746066813.561176:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772292673ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.561186:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1216, 88 off114592 00000004:00080000:3.0:1746066813.561189:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772305411ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561297:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1218, 88 off114776 00000004:00080000:3.0:1746066813.561301:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772417768ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561311:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1219, 88 off114864 00000004:00080000:3.0:1746066813.561314:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772430873ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561321:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1220, 88 off114952 00000004:00080000:3.0:1746066813.561324:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781772440598ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.561332:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1227, 88 off115480 00000004:00080000:3.0:1746066813.561335:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781772451705ns, next at 733263917711ns, rc = 0 00000100:00100000:0.0:1746066813.561479:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17237 00000100:00100000:0.0:1746066813.561485:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:3334:x1830882985420800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066813.561499:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.561509:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfb1359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75a7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.561556:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.561563:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.561569:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.561579:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.561586:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.561590:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000001:00080000:1.0:1746066813.562809:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937706 is committed 00000004:00080000:1.0:1746066813.562816:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1201 committed 00000004:00080000:1.0:1746066813.562835:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1196 committed 00000004:00080000:1.0:1746066813.562848:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1195 committed 00000004:00080000:1.0:1746066813.562850:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1194 committed 00000004:00080000:1.0:1746066813.562852:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1193 committed 00000004:00080000:1.0:1746066813.562853:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1200 committed 00000004:00080000:1.0:1746066813.562855:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1192 committed 00000004:00080000:1.0:1746066813.562856:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1199 committed 00000004:00080000:1.0:1746066813.562857:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1191 committed 00000004:00080000:1.0:1746066813.562859:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1198 committed 00000004:00080000:1.0:1746066813.562860:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1197 committed 00000004:00080000:1.0:1746066813.562861:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1196 committed 00000004:00080000:1.0:1746066813.562862:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1190 committed 00000004:00080000:1.0:1746066813.562863:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1189 committed 00000004:00080000:1.0:1746066813.562865:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1195 committed 00000004:00080000:1.0:1746066813.562867:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1194 committed 00000004:00080000:1.0:1746066813.562868:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1188 committed 00000001:00080000:1.0:1746066813.562876:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937703 is committed 00000001:00080000:1.0:1746066813.562881:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937702 is committed 00000100:00100000:2.0:1746066813.562985:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985110912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.563013:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985111168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.563029:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.563042:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985110912 00000100:00100000:3.0:1746066813.563047:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985110912 00000100:00100000:2.0:1746066813.563055:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985111424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.563068:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.563117:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985110784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.563118:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111424 00000100:00100000:3.0:1746066813.563121:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111424 00000100:00100000:3.0:1746066813.563137:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20389 00000100:00100000:0.0:1746066813.563137:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.563143:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3775:x1830882985110912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.563150:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.563161:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.563171:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.563183:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.563192:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985112320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.563207:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.563219:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066813.563223:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.563235:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563252:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985110784 00000100:00100000:1.0:1746066813.563256:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985110784 00000100:00100000:1.0:1746066813.563278:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111296 00000100:00100000:1.0:1746066813.563280:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111296 00000100:00100000:1.0:1746066813.563289:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111808 00000100:00100000:1.0:1746066813.563291:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111808 00000100:00100000:1.0:1746066813.563298:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112320 00000100:00100000:1.0:1746066813.563300:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112320 00000100:00100000:1.0:1746066813.563307:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111936 00000100:00100000:1.0:1746066813.563312:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111936 00000100:00100000:1.0:1746066813.563319:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20390 00000100:00100000:1.0:1746066813.563324:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3775:x1830882985111424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.563360:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3775:x1830882985110912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (331us total) trans 17179875376 rc 0/0 00000100:00100000:3.0:1746066813.563366:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20389 00000100:00100000:3.0:1746066813.563380:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20391 00000100:00100000:3.0:1746066813.563384:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985110784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563397:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3775:x1830882985111424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (327us total) trans 17179875377 rc 0/0 00000100:00100000:1.0:1746066813.563402:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20390 00000100:00100000:1.0:1746066813.563410:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20392 00000100:00100000:1.0:1746066813.563413:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985111296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.563458:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3774:x1830882985110784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (320us total) trans 17179875378 rc 0/0 00000100:00100000:3.0:1746066813.563463:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20391 00002000:00010000:1.0:1746066813.563463:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:1.0:1746066813.563465:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.563467:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066813.563469:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066813.563470:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:3.0:1746066813.563472:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20393 00000004:00080000:2.0:1746066813.563472:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094371500/2, rc 0, transno 17179875376 00000100:00100000:3.0:1746066813.563476:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985111808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.563480:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985110912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563486:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985111296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (324us total) trans 17179875379 rc 0/0 00000004:00080000:2.0:1746066813.563489:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094371f80/2, rc 0, transno 17179875377 00000100:00100000:2.0:1746066813.563492:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985111424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563494:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20392 00000100:00100000:1.0:1746066813.563502:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20394 00000100:00100000:2.0:1746066813.563504:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985111040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563506:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3774:x1830882985112320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066813.563511:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:3.0:1746066813.563513:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066813.563514:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066813.563516:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066813.563518:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:2.0:1746066813.563520:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.563530:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985111552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563535:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985111808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (351us total) trans 17179875380 rc 0/0 00000100:00100000:3.0:1746066813.563540:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20393 00000100:00100000:2.0:1746066813.563542:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.563547:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111040 00000100:00100000:3.0:1746066813.563549:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111040 00000100:00100000:2.0:1746066813.563549:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985112064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563556:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111552 00000100:00100000:3.0:1746066813.563558:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111552 00000100:00100000:3.0:1746066813.563564:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20395 00000100:00100000:2.0:1746066813.563565:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563566:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882985112320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (358us total) trans 21474842729 rc 0/0 00000100:00100000:3.0:1746066813.563568:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882985111936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.563571:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985112576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.563571:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20394 00000100:00100000:1.0:1746066813.563577:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112064 00000100:00100000:1.0:1746066813.563579:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112064 00000100:00100000:2.0:1746066813.563583:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563586:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112576 00000100:00100000:1.0:1746066813.563587:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112576 00000100:00100000:1.0:1746066813.563593:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20396 00000100:00100000:1.0:1746066813.563596:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3776:x1830882985111040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.563603:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20397 00000100:00100000:2.0:1746066813.563610:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882985111552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563624:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882985111936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (388us total) trans 21474842730 rc 0/0 00000100:00100000:3.0:1746066813.563629:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20395 00000100:00100000:3.0:1746066813.563638:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20398 00000100:00100000:1.0:1746066813.563639:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3776:x1830882985111040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (118us total) trans 17179875381 rc 0/0 00000100:00100000:3.0:1746066813.563641:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3776:x1830882985112064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.563643:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20396 00000100:00100000:1.0:1746066813.563650:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20399 00000100:00100000:1.0:1746066813.563653:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882985112576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.563672:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882985111552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (128us total) trans 21474842731 rc 0/0 00000100:00100000:2.0:1746066813.563677:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20397 00000100:00100000:3.0:1746066813.563691:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882985112064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (125us total) trans 21474842732 rc 0/0 00000100:00100000:3.0:1746066813.563696:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20398 00000100:00100000:1.0:1746066813.563698:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882985112576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (115us total) trans 21474842733 rc 0/0 00000100:00100000:1.0:1746066813.563702:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20399 00000100:00100000:0.0:1746066813.563706:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985112448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563716:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563723:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111168 00000100:00100000:1.0:1746066813.563725:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111168 00000100:00100000:0.0:1746066813.563731:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.563734:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985111680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563736:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112448 00000100:00100000:1.0:1746066813.563738:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112448 00000100:00100000:1.0:1746066813.563746:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20400 00000004:00080000:0.0:1746066813.563749:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372d80/2, rc 0, transno 17179875378 00000100:00100000:3.0:1746066813.563750:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563750:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3777:x1830882985111168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.563752:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985110784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066813.563758:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094373800/2, rc 0, transno 17179875379 00000100:00100000:3.0:1746066813.563759:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985112192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.563761:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066813.563767:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d802680/2, rc 0, transno 17179875380 00000100:00100000:0.0:1746066813.563769:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.563772:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066813.563776:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c68380/2, rc 0, transno 21474842729 00000100:00100000:0.0:1746066813.563779:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985112320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563781:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985112704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066813.563786:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cd180/2, rc 0, transno 21474842730 00000100:00100000:0.0:1746066813.563789:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985111936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.563794:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.563796:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3777:x1830882985111168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (80us total) trans 17179875382 rc 0/0 00000100:00100000:1.0:1746066813.563801:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20400 00000100:00100000:0.0:1746066813.563801:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985111680 00000100:00100000:0.0:1746066813.563803:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985111680 00000100:00100000:1.0:1746066813.563807:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112192 00000100:00100000:1.0:1746066813.563810:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112192 00000100:00100000:0.0:1746066813.563818:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112704 00000100:00100000:0.0:1746066813.563819:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112704 00000100:00100000:1.0:1746066813.563821:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20401 00000100:00100000:1.0:1746066813.563825:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3774:x1830882985112448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.563828:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20402 00000100:00100000:0.0:1746066813.563832:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3777:x1830882985111680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.563876:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3774:x1830882985112448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (144us total) trans 21474842734 rc 0/0 00000100:00100000:1.0:1746066813.563880:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20401 00000100:00100000:0.0:1746066813.563902:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3777:x1830882985111680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (150us total) trans 17179875383 rc 0/0 00000100:00100000:1.0:1746066813.563904:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20403 00000100:00100000:1.0:1746066813.563908:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3777:x1830882985112192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.563908:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20402 00000100:00100000:0.0:1746066813.563919:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20404 00000100:00100000:0.0:1746066813.563923:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3777:x1830882985112704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.563956:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3777:x1830882985112192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (182us total) trans 21474842735 rc 0/0 00000100:00100000:1.0:1746066813.563961:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20403 00000100:00100000:0.0:1746066813.563974:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3777:x1830882985112704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (179us total) trans 21474842736 rc 0/0 00000100:00100000:0.0:1746066813.563978:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20404 00000004:00080000:0.0:1746066813.563995:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c68700/2, rc 0, transno 21474842734 00000004:00080000:3.0:1746066813.564033:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094373480/2, rc 0, transno 17179875382 00000100:00100000:3.0:1746066813.564037:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985111168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.564043:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094370700/2, rc 0, transno 17179875383 00000100:00100000:3.0:1746066813.564045:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985111680:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.564051:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c68000/2, rc 0, transno 21474842735 00000100:00100000:3.0:1746066813.564054:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985112192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066813.564059:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c69f80/2, rc 0, transno 21474842736 00000004:00080000:2.0:1746066813.564059:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094372680/2, rc 0, transno 17179875381 00000100:00100000:3.0:1746066813.564061:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985112704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.564063:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985111040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066813.564070:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea36300/2, rc 0, transno 21474842731 00000100:00100000:2.0:1746066813.564073:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985111552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.564079:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800986cca80/2, rc 0, transno 21474842732 00000100:00100000:2.0:1746066813.564082:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985112064:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.564087:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c68e00/2, rc 0, transno 21474842733 00000100:00100000:2.0:1746066813.564090:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985112576:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746066813.564091:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011d854380 reply state ffff8800a7cfec00 transno 8589937706 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564104:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564111:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.564113:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066813.564116:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066813.564158:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.564168:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.564174:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.564192:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.564201:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.564213:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985112832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066813.564249:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985112448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.564250:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebc00 going to sleep for 11 seconds 00010000:00080000:3.0:1746066813.564263:0:7245:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066813.564271:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3332:x1830882985420160:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 6773us (6908us total) trans 8589937706 rc 0/0 00000100:00100000:3.0:1746066813.564277:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17236 00010000:00010000:3.0:1746066813.564294:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564299:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564304:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564308:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa1600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.564312:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564318:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066813.564319:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1746066813.564325:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:2.0:1746066813.564325:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985112960:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066813.564327:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066813.564329:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066813.564334:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfb1352 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066813.564343:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.564359:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985112960 00000100:00100000:2.0:1746066813.564361:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985112960 00000100:00100000:2.0:1746066813.564617:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20405 00000100:00100000:2.0:1746066813.564631:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3775:x1830882985112960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.564793:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985112960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (449us total) trans 17179875384 rc 0/0 00000100:00100000:2.0:1746066813.564802:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20405 00000004:00080000:0.0:1746066813.564923:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a2a00/2, rc 0, transno 17179875384 00000100:00100000:0.0:1746066813.564929:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985112960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.565773:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.565866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.565954:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985112832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.565972:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066813.565999:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985421056 00000100:00100000:2.0:1746066813.566006:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985421056 00000100:00100000:2.0:1746066813.566039:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17238 00000100:00100000:2.0:1746066813.566045:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3332:x1830882985421056:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066813.566063:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.566076:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75ae expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.566119:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985420928 00000100:00100000:1.0:1746066813.566124:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985420928 00010000:00010000:2.0:1746066813.566129:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.566141:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.566143:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.566158:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.566160:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066813.566163:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:0.0:1746066813.566198:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9331 00000100:00100000:2.0:1746066813.566201:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3332:x1830882985421056:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.566206:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17238 00000100:00100000:0.0:1746066813.566207:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985420928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066813.566217:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066813.566223:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.566233:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.566248:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1313 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7599 expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746066813.566262:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066813.566266:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.566273:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.566278:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066813.566301:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.566322:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985420928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.566328:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9331 00010000:00010000:3.0:1746066813.566336:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566342:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066813.566354:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.566419:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566456:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566461:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566465:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cb4400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.566468:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566473:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566483:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.566485:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066813.566488:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566491:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4400/0xf1867c21abfb136e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566507:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566512:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566517:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566521:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566524:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357b400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.566526:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566530:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566535:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066813.566536:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.566538:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566542:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfb1360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566548:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566551:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566555:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566559:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.566561:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566565:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566570:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9200) 00010000:00010000:3.0:1746066813.566572:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.566573:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566577:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfb1367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.566614:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfb1359 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75a7 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.566621:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfb1359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75a7 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.566628:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:3.0:1746066813.566676:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:3334:x1830882985420800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5189us (6012us total) trans 8589937707 rc 301/301 00000100:00100000:3.0:1746066813.566682:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17237 00000100:00100000:0.0:1746066813.569466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.569550:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985421312 00000100:00100000:2.0:1746066813.569561:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985421312 00000100:00100000:2.0:1746066813.569621:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6488 00000100:00100000:2.0:1746066813.569630:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3332:x1830882985421312:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066813.570049:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373a7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3332:x1830882985421312:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 419us (588us total) trans 8589937708 rc 0/0 00000100:00100000:2.0:1746066813.570056:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6488 00000100:00100000:0.0:1746066813.571838:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.571927:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985421568 00000100:00100000:2.0:1746066813.571935:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985421568 00000100:00100000:2.0:1746066813.571985:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6489 00000100:00100000:2.0:1746066813.571992:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3332:x1830882985421568:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066813.572158:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3332:x1830882985421568:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 166us (329us total) trans 8589937709 rc 0/0 00000100:00100000:2.0:1746066813.572169:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6489 00000100:00100000:0.0:1746066813.585091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.585193:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985421696 00000100:00100000:3.0:1746066813.585207:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985421696 00000100:00100000:3.0:1746066813.585280:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17239 00000100:00100000:3.0:1746066813.585289:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:3334:x1830882985421696:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.585319:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.585339:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb1383 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75b5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.585415:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb1383 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75b5 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.585440:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb1383 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75b5 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.585459:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.585462:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066813.585466:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1800, rc 0) 00000100:00100000:3.0:1746066813.585529:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3334:x1830882985421696:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 240us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.585535:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17239 00000100:00100000:0.0:1746066813.587976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.588056:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985421952 00000100:00100000:3.0:1746066813.588069:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985421952 00000100:00100000:3.0:1746066813.588126:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17240 00000100:00100000:3.0:1746066813.588135:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3334:x1830882985421952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.588157:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.588161:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066813.588190:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb1383 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75b5 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.588226:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.588231:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.588244:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b41200/0xf1867c21abfb138a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75bc expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.588291:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.588308:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.588315:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.588350:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.588361:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 8 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.588374:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985113088:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.588477:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.589532:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985113088:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.589557:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066813.589826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.589935:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985422080 00000100:00100000:2.0:1746066813.589940:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985422080 00010000:00010000:2.0:1746066813.589969:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.590005:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9332 00000100:00100000:2.0:1746066813.590012:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985422080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.590029:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.590034:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.590043:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.590061:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb1375 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ae expref: 9 pid: 7245 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.590083:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.590086:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.590093:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.590099:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.590272:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.590279:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:3.0:1746066813.590481:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1221, 88 off115040 00000004:00080000:3.0:1746066813.590486:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801602738ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590519:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1228, 88 off115568 00000004:00080000:3.0:1746066813.590523:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801639148ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.590556:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1229, 88 off115656 00000004:00080000:3.0:1746066813.590560:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801676538ns, next at 733263917711ns, rc = 0 00010000:00010000:2.0:1746066813.590572:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1746066813.590574:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1222, 88 off115128 00000004:00080000:3.0:1746066813.590578:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801695218ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590589:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1223, 88 off115216 00000004:00080000:3.0:1746066813.590593:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801709245ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590602:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1230, 88 off115744 00000004:00080000:3.0:1746066813.590604:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801721256ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.590613:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1231, 88 off115832 00000004:00080000:3.0:1746066813.590616:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801732588ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.590624:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1232, 88 off115920 00000004:00080000:3.0:1746066813.590627:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801743873ns, next at 733263917711ns, rc = 0 00000100:00100000:2.0:1746066813.590629:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985422080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 617us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.590636:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9332 00000040:00080000:3.0:1746066813.590637:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1224, 88 off115304 00000004:00080000:3.0:1746066813.590639:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801755898ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590649:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1233, 88 off116008 00000004:00080000:3.0:1746066813.590651:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801768186ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.590661:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1225, 88 off115392 00000004:00080000:3.0:1746066813.590663:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801779988ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590672:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1234, 88 off116096 00000004:00080000:3.0:1746066813.590675:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801791338ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066813.590683:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1226, 88 off115480 00000004:00080000:3.0:1746066813.590685:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801802130ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590694:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1227, 88 off115568 00000004:00080000:3.0:1746066813.590697:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801813968ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590706:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1228, 88 off115656 00000004:00080000:3.0:1746066813.590709:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801825388ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590717:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1229, 88 off115744 00000004:00080000:3.0:1746066813.590719:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781801835548ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066813.590726:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1235, 88 off116184 00000004:00080000:3.0:1746066813.590741:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781801857335ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066813.592144:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937710 is committed 00000004:00080000:0.0:1746066813.592152:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1209 committed 00000004:00080000:0.0:1746066813.592166:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1205 committed 00000004:00080000:0.0:1746066813.592183:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1204 committed 00000004:00080000:0.0:1746066813.592185:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1203 committed 00000004:00080000:0.0:1746066813.592187:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1202 committed 00000004:00080000:0.0:1746066813.592188:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1208 committed 00000004:00080000:0.0:1746066813.592190:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1201 committed 00000004:00080000:0.0:1746066813.592191:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1207 committed 00000004:00080000:0.0:1746066813.592193:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1200 committed 00000004:00080000:0.0:1746066813.592194:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1206 committed 00000004:00080000:0.0:1746066813.592196:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1205 committed 00000004:00080000:0.0:1746066813.592198:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1204 committed 00000004:00080000:0.0:1746066813.592199:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1199 committed 00000004:00080000:0.0:1746066813.592201:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1198 committed 00000004:00080000:0.0:1746066813.592202:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1203 committed 00000004:00080000:0.0:1746066813.592204:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1202 committed 00000004:00080000:0.0:1746066813.592206:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1197 committed 00000001:00080000:0.0:1746066813.592210:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937709 is committed 00010000:00010000:3.0:1746066813.592351:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.592363:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.592366:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066813.592378:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b41200/0xf1867c21abfb138a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 29 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066813.592393:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.592403:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985113344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.592417:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985113472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.592442:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985113216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592467:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.592469:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985113600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.592488:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113472 00000100:00100000:0.0:1746066813.592491:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.592493:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985113984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.592494:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113472 00000100:00100000:0.0:1746066813.592504:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985114112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592507:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.592516:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985114496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.592516:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.592523:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113600 00000100:00100000:2.0:1746066813.592525:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113600 00000100:00100000:0.0:1746066813.592527:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985114624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592528:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.592537:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985115008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.592537:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113984 00000100:00100000:2.0:1746066813.592539:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113984 00000100:00100000:0.0:1746066813.592539:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.592547:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114112 00000100:00100000:0.0:1746066813.592548:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985115136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.592549:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114112 00000100:00100000:3.0:1746066813.592551:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.592559:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.592560:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114496 00000100:00100000:2.0:1746066813.592561:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114496 00000100:00100000:2.0:1746066813.592567:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114624 00000100:00100000:2.0:1746066813.592568:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114624 00000100:00100000:3.0:1746066813.592573:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115008 00000100:00100000:2.0:1746066813.592574:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115136 00000100:00100000:2.0:1746066813.592576:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115136 00000100:00100000:3.0:1746066813.592577:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115008 00000100:00100000:0.0:1746066813.592583:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20406 00000100:00100000:2.0:1746066813.592594:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20407 00000100:00100000:2.0:1746066813.592600:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882985113600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.592603:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20408 00000100:00100000:3.0:1746066813.592608:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882985113984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.592614:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20409 00000100:00100000:1.0:1746066813.592621:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:3774:x1830882985114112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592692:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20410 00000100:00100000:3.0:1746066813.592696:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3777:x1830882985114496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.592729:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882985113600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (236us total) trans 21474842738 rc 0/0 00000100:00100000:2.0:1746066813.592735:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20407 00000100:00100000:0.0:1746066813.592735:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3777:x1830882985113472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.592749:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20411 00000100:00100000:2.0:1746066813.592753:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+72:3774:x1830882985114624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592756:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3777:x1830882985114496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (227us total) trans 21474842739 rc 0/0 00000100:00100000:3.0:1746066813.592761:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20410 00000100:00100000:3.0:1746066813.592771:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20412 00000100:00100000:3.0:1746066813.592775:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882985115136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.592797:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3777:x1830882985113472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (329us total) trans 17179875386 rc 0/0 00000100:00100000:0.0:1746066813.592802:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20406 00000100:00100000:0.0:1746066813.592812:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20413 00000100:00100000:0.0:1746066813.592816:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3777:x1830882985115008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.592826:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+73:3774:x1830882985114624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (286us total) trans 17179875387 rc 0/0 00000100:00100000:3.0:1746066813.592828:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882985115136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (268us total) trans 21474842740 rc 0/0 00000100:00100000:2.0:1746066813.592832:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20411 00000100:00100000:3.0:1746066813.592834:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20412 00000100:00100000:1.0:1746066813.592834:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3774:x1830882985114112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (308us total) trans 17179875385 rc 0/0 00000100:00100000:1.0:1746066813.592846:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20409 00000100:00100000:2.0:1746066813.592849:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066813.592857:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:0.0:1746066813.592859:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066813.592862:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066813.592864:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:2.0:1746066813.592865:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985113856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592866:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3777:x1830882985113984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (358us total) trans 21474842737 rc 0/0 00002000:00010000:0.0:1746066813.592866:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:3.0:1746066813.592871:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20408 00000100:00100000:1.0:1746066813.592872:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113344 00000100:00100000:1.0:1746066813.592879:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113344 00000100:00100000:2.0:1746066813.592881:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.592881:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3777:x1830882985115008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (329us total) trans 17179875388 rc 0/0 00000100:00100000:0.0:1746066813.592900:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20413 00000100:00100000:3.0:1746066813.592902:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113856 00000100:00100000:2.0:1746066813.592902:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985114368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592904:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113856 00000100:00100000:2.0:1746066813.592911:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.592918:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114368 00000100:00100000:3.0:1746066813.592920:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114368 00000100:00100000:2.0:1746066813.592920:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985114880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.592925:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20414 00000100:00100000:2.0:1746066813.592930:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066813.592930:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3776:x1830882985113856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.592932:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20415 00000100:00100000:3.0:1746066813.592936:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3776:x1830882985114368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.592942:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114880 00000100:00100000:1.0:1746066813.592944:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114880 00000100:00100000:2.0:1746066813.592955:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20416 00000100:00100000:2.0:1746066813.592961:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3776:x1830882985113344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.592961:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20417 00000100:00100000:1.0:1746066813.592966:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985114880:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066813.592984:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958aed80/2, rc 0, transno 17179875386 00000100:00100000:0.0:1746066813.592988:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985113856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (105us total) trans 17179875389 rc 0/0 00000100:00100000:3.0:1746066813.592991:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985113472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.592993:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20414 00000004:00080000:3.0:1746066813.592999:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a2680/2, rc 0, transno 21474842737 00000100:00100000:3.0:1746066813.593002:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985113984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066813.593008:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a1180/2, rc 0, transno 21474842739 00000100:00100000:3.0:1746066813.593010:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985114496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066813.593012:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a1c00/2, rc 0, transno 21474842738 00000100:00100000:0.0:1746066813.593015:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985113600:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066813.593016:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7b80/2, rc 0, transno 17179875388 00000100:00100000:2.0:1746066813.593019:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882985113344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (169us total) trans 21474842741 rc 0/0 00000004:00080000:0.0:1746066813.593021:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0a80/2, rc 0, transno 17179875385 00000100:00100000:0.0:1746066813.593024:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985114112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.593025:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20416 00000004:00080000:0.0:1746066813.593029:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098926300/2, rc 0, transno 17179875387 00000100:00100000:0.0:1746066813.593032:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985114624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066813.593037:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea34380/2, rc 0, transno 21474842740 00000100:00100000:0.0:1746066813.593040:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985115136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.593047:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a0700/2, rc 0, transno 21474842741 00000100:00100000:2.0:1746066813.593051:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985113344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066813.593058:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1880/2, rc 0, transno 17179875389 00000100:00100000:2.0:1746066813.593061:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985113856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066813.593089:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985115008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.593107:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985114880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (175us total) trans 17179875391 rc 0/0 00000100:00100000:1.0:1746066813.593113:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20417 00000004:00080000:2.0:1746066813.593120:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a4e00/2, rc 0, transno 17179875391 00000100:00100000:2.0:1746066813.593124:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985114880:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066813.593131:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:3.0:1746066813.593134:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066813.593136:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066813.593138:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:1.0:1746066813.593138:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746066813.593140:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066813.593158:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113216 00000100:00100000:0.0:1746066813.593161:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113216 00000100:00100000:1.0:1746066813.593162:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985113728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.593166:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985114368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (252us total) trans 17179875390 rc 0/0 00000100:00100000:3.0:1746066813.593173:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20415 00000004:00080000:2.0:1746066813.593177:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1180/2, rc 0, transno 17179875390 00000100:00100000:0.0:1746066813.593180:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20418 00000100:00100000:2.0:1746066813.593181:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985114368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.593184:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3775:x1830882985113216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066813.593186:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066813.593199:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985114240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.593205:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985113728 00000100:00100000:2.0:1746066813.593208:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985113728 00000100:00100000:1.0:1746066813.593215:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066813.593225:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114240 00000100:00100000:1.0:1746066813.593225:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985114752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.593228:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114240 00010000:00010000:3.0:1746066813.593235:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.593238:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1746066813.593238:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20419 00000100:00100000:1.0:1746066813.593239:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746066813.593241:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006ee2fc00, rc 0) 00000100:00100000:0.0:1746066813.593242:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3775:x1830882985113216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (104us total) trans 17179875392 rc 0/0 00000100:00100000:2.0:1746066813.593243:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882985113728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.593248:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20418 00000100:00100000:1.0:1746066813.593253:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985115264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.593257:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985114752 00000100:00100000:0.0:1746066813.593259:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985114752 00000100:00100000:1.0:1746066813.593268:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066813.593271:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:3334:x1830882985421952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5137us (5301us total) trans 8589937710 rc 0/0 00000100:00100000:0.0:1746066813.593271:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20420 00000100:00100000:0.0:1746066813.593275:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882985114240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066813.593278:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17240 00000004:00080000:1.0:1746066813.593292:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958aca80/2, rc 0, transno 17179875392 00000100:00100000:1.0:1746066813.593296:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985113216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066813.593298:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882985113728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (110us total) trans 21474842742 rc 0/0 00000100:00100000:2.0:1746066813.593303:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20419 00000004:00080000:1.0:1746066813.593305:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a2d80/2, rc 0, transno 21474842742 00000100:00100000:1.0:1746066813.593308:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985113728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066813.593310:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985115264 00000100:00100000:2.0:1746066813.593312:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985115264 00000100:00100000:2.0:1746066813.593323:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20421 00000100:00100000:2.0:1746066813.593327:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882985114752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066813.593330:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20422 00000100:00100000:0.0:1746066813.593334:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882985114240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (117us total) trans 21474842743 rc 0/0 00000100:00100000:1.0:1746066813.593335:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3775:x1830882985115264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066813.593340:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20420 00000100:00100000:2.0:1746066813.593379:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3775:x1830882985114752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (139us total) trans 21474842744 rc 0/0 00000100:00100000:2.0:1746066813.593384:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20421 00000100:00100000:1.0:1746066813.593395:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3775:x1830882985115264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (125us total) trans 17179875393 rc 0/0 00000100:00100000:1.0:1746066813.593403:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20422 00000004:00080000:1.0:1746066813.593440:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7fb80/2, rc 0, transno 17179875393 00000100:00100000:1.0:1746066813.593443:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985115264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066813.593452:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a2300/2, rc 0, transno 21474842743 00000100:00100000:1.0:1746066813.593454:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985114240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066813.593462:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c4a1f80/2, rc 0, transno 21474842744 00000100:00100000:1.0:1746066813.593464:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985114752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066813.595826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.595926:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985422208 00000100:00100000:1.0:1746066813.595935:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985422208 00000100:00100000:1.0:1746066813.595977:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20423 00000100:00100000:1.0:1746066813.595982:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:3334:x1830882985422208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066813.595994:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.596007:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75c3 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066813.596022:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd7e, atime: 0x6812dd7a, ctime: 0x6812dd7e, blocks: 0x808 00010000:00010000:1.0:1746066813.596038:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.596039:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.596044:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.596053:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.596059:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728a00, rc 0) 00000100:00100000:1.0:1746066813.596100:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:3334:x1830882985422208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.596104:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20423 00000100:00100000:0.0:1746066813.600159:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.600243:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985422464 00000100:00100000:1.0:1746066813.600254:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985422464 00002000:00100000:1.0:1746066813.600298:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1679360->1683455) req@ffff88011d855880 x1830882985422464/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.600306:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855880 with x1830882985422464 ext(1679360->1683455) 00002000:00010000:1.0:1746066813.600311:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855880 00000100:00100000:1.0:1746066813.600348:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7642 00000100:00100000:1.0:1746066813.600354:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985422464:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066813.600492:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985422464:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 138us (347us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066813.600498:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7642 00002000:00100000:1.0:1746066813.600503:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1679360->1683455) req@ffff88011d855880 x1830882985422464/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.600509:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855880 with x1830882985422464 ext(1679360->1683455) 00002000:00010000:1.0:1746066813.600512:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855880 00000100:00100000:0.0:1746066813.603473:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.603648:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985422720 00000100:00100000:2.0:1746066813.603656:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985422720 00000100:00100000:2.0:1746066813.603700:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6490 00000100:00100000:2.0:1746066813.603707:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3334:x1830882985422720:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066813.604242:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3334:x1830882985422720:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 535us (775us total) trans 8589937711 rc 0/0 00000100:00100000:2.0:1746066813.604248:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6490 00000100:00100000:0.0:1746066813.635336:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.635565:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985422976 00000100:00100000:3.0:1746066813.635573:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985422976 00000100:00100000:3.0:1746066813.635618:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17241 00000100:00100000:3.0:1746066813.635626:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3339:x1830882985422976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.635647:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.635664:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb139f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75ca expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.635735:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635748:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635757:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635770:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635775:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635780:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635872:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635880:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635913:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066813.635921:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.635982:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635988:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635993:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.635997:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636003:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.636005:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636011:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636020:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066813.636022:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.636025:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636030:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636057:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636062:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636066:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636070:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.636071:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636075:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636080:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093a37a00) 00010000:00010000:3.0:1746066813.636082:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.636084:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636088:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.636120:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb139f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 32 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.636130:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.636136:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.636137:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066813.636139:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bda00, rc 0) 00000100:00100000:3.0:1746066813.636188:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:3339:x1830882985422976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 563us (860us total) trans 8589937712 rc 0/0 00000100:00100000:3.0:1746066813.636194:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17241 00000100:00100000:0.0:1746066813.639848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.640066:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423232 00000100:00100000:2.0:1746066813.640076:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423232 00000100:00100000:2.0:1746066813.640192:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6491 00000100:00100000:2.0:1746066813.640200:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3339:x1830882985423232:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066813.640820:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3339:x1830882985423232:12345-192.168.204.16@tcp:35:cat.0 Request processed in 619us (983us total) trans 8589937713 rc 0/0 00000100:00100000:2.0:1746066813.640827:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6491 00000100:00100000:0.0:1746066813.645316:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.645410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.645518:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.645618:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423360 00000100:00100000:1.0:1746066813.645628:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423360 00000100:00100000:1.0:1746066813.645668:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423616 00000100:00100000:1.0:1746066813.645670:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423616 00000100:00100000:1.0:1746066813.645681:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423872 00000100:00100000:1.0:1746066813.645682:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423872 00000100:00100000:1.0:1746066813.645698:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20424 00000100:00100000:1.0:1746066813.645705:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985423360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.645724:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.645745:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75d1 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066813.645769:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd7a, atime: 0x6812dd79, ctime: 0x6812dd7a, blocks: 0x800 00010000:00010000:1.0:1746066813.645791:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.645793:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.645804:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.645820:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.645832:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095675e00, rc 0) 00000100:00100000:1.0:1746066813.645874:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985423360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 171us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.645881:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20424 00000100:00100000:1.0:1746066813.645919:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20425 00000100:00100000:1.0:1746066813.645925:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985423616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.645930:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.645938:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75df expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066813.645949:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd7d, atime: 0x6812dd7d, ctime: 0x6812dd7d, blocks: 0x800 00010000:00010000:1.0:1746066813.645956:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.645958:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.645962:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.645970:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.645977:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729c00, rc 0) 00000100:00100000:1.0:1746066813.645992:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985423616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.645996:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20425 00000100:00100000:1.0:1746066813.646006:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20426 00000100:00100000:1.0:1746066813.646009:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985423872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.646016:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.646025:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75ed expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066813.646038:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd7e, atime: 0x6812dd7c, ctime: 0x6812dd7e, blocks: 0x1000 00010000:00010000:1.0:1746066813.646045:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.646046:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.646050:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.646059:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.646065:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728600, rc 0) 00000100:00100000:1.0:1746066813.646079:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985423872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.646091:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20426 00000100:00100000:1.0:1746066813.646139:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.646152:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423488 00000100:00100000:1.0:1746066813.646155:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423488 00000100:00100000:1.0:1746066813.646169:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20427 00000100:00100000:1.0:1746066813.646173:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985423488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066813.646179:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.646189:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75d8 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066813.646199:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd7d, atime: 0x6812dd76, ctime: 0x6812dd7d, blocks: 0x800 00010000:00010000:1.0:1746066813.646206:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.646207:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.646212:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.646220:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.646226:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:1.0:1746066813.646241:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985423488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.646245:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20427 00000100:00100000:1.0:1746066813.646312:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.646577:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985423744 00000100:00100000:0.0:1746066813.646581:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985423744 00000100:00100000:0.0:1746066813.646606:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20428 00000100:00100000:0.0:1746066813.646610:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985423744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.646616:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.646624:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75e6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066813.646636:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 4860352, mtime: 0x6812dd7e, atime: 0x6812dd7c, ctime: 0x6812dd7e, blocks: 0x1518 00010000:00010000:0.0:1746066813.646642:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.646643:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.646648:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.646656:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.646662:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2a00, rc 0) 00000100:00100000:0.0:1746066813.646675:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985423744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.646679:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20428 00010000:00010000:3.0:1746066813.652455:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066813.660023:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.660074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.660099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.660149:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.660174:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985424384 00000100:00100000:0.0:1746066813.660183:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985424384 00002000:00100000:0.0:1746066813.660231:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c4a0a80 x1830882985424384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.660248:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0a80 with x1830882985424384 ext(0->1048575) 00002000:00010000:0.0:1746066813.660254:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0a80 00000100:00100000:0.0:1746066813.660271:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985424640 00000100:00100000:0.0:1746066813.660273:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985424640 00002000:00100000:0.0:1746066813.660287:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c4a3100 x1830882985424640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 504/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.660293:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3100 with x1830882985424640 ext(1048576->2097151) 00002000:00010000:0.0:1746066813.660296:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3100 00000100:00100000:0.0:1746066813.660305:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985424896 00000100:00100000:0.0:1746066813.660307:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985424896 00002000:00100000:0.0:1746066813.660317:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c4a3b80 x1830882985424896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.660323:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3b80 with x1830882985424896 ext(1048576->2097151) 00000100:00100000:1.0:1746066813.660604:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7643 00000100:00100000:1.0:1746066813.660614:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985424384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.660779:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7644 00000100:00100000:3.0:1746066813.660788:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985424640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.661307:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985424256 00000100:00100000:3.0:1746066813.661311:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985424256 00000100:00100000:3.0:1746066813.661349:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17242 00000100:00100000:3.0:1746066813.661354:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3341:x1830882985424256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.661369:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746066813.662307:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3b80 00000100:00100000:0.0:1746066813.662328:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7645 00000100:00100000:0.0:1746066813.662335:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985424896:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066813.662813:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb13e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75f4 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.662905:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.662919:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.662931:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.662943:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.662949:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.662953:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663051:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663059:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663064:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066813.663073:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.663145:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663150:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663155:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663160:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663166:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.663169:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663175:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663184:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066813.663187:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.663191:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663195:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb13ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663223:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663228:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663232:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663236:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066813.663238:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663242:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663248:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093a37a00) 00010000:00010000:3.0:1746066813.663250:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066813.663252:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663261:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb13f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.663295:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb13e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.663305:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.663311:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.663312:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066813.663314:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bdc00, rc 0) 00000100:00100000:2.0:1746066813.665644:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.665674:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985425152 00000100:00100000:2.0:1746066813.665681:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985425152 00002000:00100000:2.0:1746066813.665718:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012e420000 x1830882985425152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.665728:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882985425152 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.665733:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:2.0:1746066813.665758:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7646 00000100:00100000:3.0:1746066813.665791:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3341:x1830882985424256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4434us (5781us total) trans 8589937714 rc 0/0 00000100:00100000:3.0:1746066813.665799:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17242 00000100:00100000:2.0:1746066813.665865:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985425152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.672054:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985424640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11254us (11940us total) trans 0 rc 647168/647168 00000100:00100000:3.0:1746066813.672067:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7644 00002000:00100000:3.0:1746066813.672085:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c4a3100 x1830882985424640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 504/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.672094:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3100 with x1830882985424640 ext(1048576->2097151) 00002000:00010000:3.0:1746066813.672101:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3100 00000100:00100000:1.0:1746066813.676486:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985424384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15861us (16399us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066813.676499:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7643 00002000:00100000:1.0:1746066813.676510:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c4a0a80 x1830882985424384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.676520:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0a80 with x1830882985424384 ext(0->1048575) 00002000:00010000:1.0:1746066813.676526:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0a80 00000100:00100000:0.0:1746066813.679438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.681768:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985425152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15993us (16121us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.681781:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7646 00002000:00100000:3.0:1746066813.681792:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012e420000 x1830882985425152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.681802:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882985425152 ext(1048576->2097151) 00002000:00010000:3.0:1746066813.681808:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:1.0:1746066813.681997:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985425280 00000100:00100000:1.0:1746066813.682007:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985425280 00000100:00100000:1.0:1746066813.682056:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20429 00000100:00100000:1.0:1746066813.682062:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3341:x1830882985425280:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066813.682078:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.682092:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d75fb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.682117:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 24 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.682123:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.682125:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.682132:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2834432->2945023] (req 2834432->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.682158:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066813.682173:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746066813.682182:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985115392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.682200:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985424896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19864us (22048us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.682208:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7645 00002000:00100000:2.0:1746066813.682214:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c4a3b80 x1830882985424896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.682222:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3b80 with x1830882985424896 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.682225:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3b80 00000100:00100000:1.0:1746066813.682252:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.685010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.685160:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985115392:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.685192:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2834432->2945023] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.685207:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59e00, rc 0) 00000100:00100000:2.0:1746066813.685386:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985425408 00000100:00100000:2.0:1746066813.685394:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985425408 00010000:00010000:2.0:1746066813.685440:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746066813.685471:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9333 00000100:00100000:2.0:1746066813.685478:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985425408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.685494:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.685516:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.685532:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.685555:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfb13d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ed expref: 23 pid: 12255 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746066813.685574:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.685576:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.685584:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.685593:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.685626:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.685638:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985115520:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066813.685683:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3341:x1830882985425280:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3618us (6261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.685691:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20429 00000100:00100000:2.0:1746066813.685693:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.687823:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985115520:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.687843:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.687983:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985425408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2504us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.687993:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9333 00000100:00100000:0.0:1746066813.688686:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.688958:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985425664 00000100:00100000:2.0:1746066813.688965:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985425664 00002000:00100000:2.0:1746066813.689003:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2838527) req@ffff8800a5766300 x1830882985425664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.689014:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766300 with x1830882985425664 ext(2834432->2838527) 00002000:00010000:2.0:1746066813.689019:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5766300 00000100:00100000:2.0:1746066813.689043:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7647 00000100:00100000:2.0:1746066813.689048:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985425664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066813.689159:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985425664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (473us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066813.689166:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7647 00002000:00100000:2.0:1746066813.689170:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2838527) req@ffff8800a5766300 x1830882985425664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.689177:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766300 with x1830882985425664 ext(2834432->2838527) 00002000:00010000:2.0:1746066813.689180:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5766300 00000100:00100000:0.0:1746066813.694562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.694695:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985425920 00000100:00100000:2.0:1746066813.694704:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985425920 00002000:00100000:2.0:1746066813.694751:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2940928->2945023) req@ffff880093c6b800 x1830882985425920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.694762:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b800 with x1830882985425920 ext(2940928->2945023) 00002000:00010000:2.0:1746066813.694767:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6b800 00000100:00100000:2.0:1746066813.694795:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7648 00000100:00100000:2.0:1746066813.694803:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985425920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066813.694981:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985425920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 178us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066813.694991:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7648 00002000:00100000:2.0:1746066813.694996:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2940928->2945023) req@ffff880093c6b800 x1830882985425920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.695003:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b800 with x1830882985425920 ext(2940928->2945023) 00002000:00010000:2.0:1746066813.695006:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6b800 00000100:00100000:0.0:1746066813.699153:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.699214:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426176 00000100:00100000:2.0:1746066813.699223:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426176 00002000:00100000:2.0:1746066813.699378:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880093c69500 x1830882985426176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.699386:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69500 with x1830882985426176 ext(2097152->3145727) 00002000:00010000:2.0:1746066813.699391:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69500 00000100:00100000:2.0:1746066813.699481:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7649 00000100:00100000:2.0:1746066813.699490:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985426176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.704589:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.704757:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426432 00000100:00100000:2.0:1746066813.704766:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426432 00000100:00100000:2.0:1746066813.704817:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6492 00000100:00100000:2.0:1746066813.704825:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3341:x1830882985426432:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066813.705664:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3341:x1830882985426432:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 838us (1084us total) trans 8589937715 rc 0/0 00000100:00100000:2.0:1746066813.705671:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6492 00000100:00100000:2.0:1746066813.709003:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985426176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9502us (9848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.709015:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7649 00002000:00100000:2.0:1746066813.709031:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880093c69500 x1830882985426176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.709041:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69500 with x1830882985426176 ext(2097152->3145727) 00002000:00010000:2.0:1746066813.709048:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69500 00000100:00100000:0.0:1746066813.718530:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.719078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.719108:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.719130:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.719155:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426560 00000100:00100000:0.0:1746066813.719164:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426560 00000100:00100000:0.0:1746066813.719204:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426688 00000100:00100000:0.0:1746066813.719205:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426688 00000100:00100000:0.0:1746066813.719217:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426816 00000100:00100000:0.0:1746066813.719218:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426816 00000100:00100000:3.0:1746066813.719222:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985426944 00000100:00100000:3.0:1746066813.719234:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985426944 00000100:00100000:0.0:1746066813.719234:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20430 00000100:00100000:0.0:1746066813.719241:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:3339:x1830882985426560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.719262:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.719279:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7602 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.719288:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20431 00000100:00100000:3.0:1746066813.719296:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985426688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.719309:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 17 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.719312:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.719317:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066813.719319:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066813.719322:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.719326:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7609 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.719347:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.719348:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.719356:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.719359:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 17 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.719370:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.719370:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 17 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.719379:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bce00, rc 0) 00000100:00100000:0.0:1746066813.719383:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985115648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.719440:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985426688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 144us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.719445:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20431 00000100:00100000:3.0:1746066813.719459:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20432 00000100:00100000:3.0:1746066813.719463:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985426816:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066813.719463:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066813.719470:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.719477:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb141d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7610 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066813.719489:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.719509:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985115776:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066813.719540:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.719542:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.719575:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427072 00000100:00100000:3.0:1746066813.719578:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427072 00000100:00100000:3.0:1746066813.719591:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427200 00000100:00100000:3.0:1746066813.719593:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427200 00000100:00100000:3.0:1746066813.719606:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20433 00000100:00100000:3.0:1746066813.719609:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985426944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.719614:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.719619:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7617 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.719627:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.719629:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.719633:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.719641:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.719690:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20434 00000100:00100000:2.0:1746066813.719698:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985427072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.719707:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.719716:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d761e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.719727:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.719729:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.719734:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.719746:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.719754:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5fa00, rc 0) 00000100:00100000:2.0:1746066813.719778:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985427072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.719783:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20434 00000100:00100000:2.0:1746066813.719799:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20435 00000100:00100000:2.0:1746066813.719804:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985427200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.719809:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.719814:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7625 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.719823:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.719824:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.719828:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.719836:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.719843:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5e000, rc 0) 00000100:00100000:2.0:1746066813.719854:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985427200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.719858:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20435 00010000:00010000:3.0:1746066813.719988:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:3.0:1746066813.720018:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985426944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 407us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.720024:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20433 00000100:00100000:2.0:1746066813.722246:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985115648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.722279:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.722294:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d000, rc 0) 00000100:00100000:2.0:1746066813.722333:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:3339:x1830882985426560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3091us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.722341:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20430 00002000:00010000:3.0:1746066813.722450:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066810 -> 1746066814 00000100:00100000:3.0:1746066813.722471:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985115776:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066813.722495:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb141d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7610 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.722504:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb141d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7610 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.722537:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd800, rc 0) 00000100:00100000:3.0:1746066813.722556:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985426816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3093us (3447us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.722561:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20432 00000100:00100000:0.0:1746066813.722630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.722773:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427328 00000100:00100000:2.0:1746066813.722779:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427328 00002000:00100000:2.0:1746066813.722815:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2945023) req@ffff8800966e3800 x1830882985427328/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.722824:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985427328 ext(2834432->2945023) 00010000:00010000:2.0:1746066813.722832:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 17 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.722842:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 17 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:2.0:1746066813.722848:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e3800 00000100:00100000:2.0:1746066813.723254:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2192 00000100:00100000:2.0:1746066813.723262:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985427328:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066813.726320:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985427328:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3048us (3680us total) trans 21474842745 rc 0/0 00000100:00100000:2.0:1746066813.726333:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2192 00002000:00100000:2.0:1746066813.726344:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2945023) req@ffff8800966e3800 x1830882985427328/t21474842745(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.726353:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985427328 ext(2834432->2945023) 00010000:00010000:2.0:1746066813.726362:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.726374:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:2.0:1746066813.726698:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e3800 00000100:00100000:0.0:1746066813.728683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.728778:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.728838:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427712 00000100:00100000:3.0:1746066813.728847:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427712 00000100:00100000:2.0:1746066813.728912:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427456 00000100:00100000:2.0:1746066813.728917:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427456 00002000:00100000:3.0:1746066813.728918:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009ea82050 x1830882985427712/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.728927:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea82050 with x1830882985427712 ext(0->1048575) 00002000:00010000:3.0:1746066813.728932:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea82050 00010000:00010000:2.0:1746066813.728936:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.728963:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7650 00000100:00100000:3.0:1746066813.728971:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985427712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.728974:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9334 00000100:00100000:2.0:1746066813.728978:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985427456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.728990:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.729007:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.729019:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.729041:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a59e00/0xf1867c21abfb1408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75fb expref: 19 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.729059:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.729062:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.729068:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.729076:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.729111:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.729123:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985115904:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.729205:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.730186:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985115904:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.730204:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.730241:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985427456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1260us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.730249:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9334 00000100:00100000:0.0:1746066813.733323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.733512:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985427968 00000100:00100000:3.0:1746066813.733521:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985427968 00000100:00100000:3.0:1746066813.734711:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17243 00000100:00100000:3.0:1746066813.734724:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3347:x1830882985427968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066813.734752:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.734772:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d762c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.734908:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.734924:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.734932:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.734938:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.734972:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.734984:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 10 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.734997:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985116032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066813.735100:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.735107:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 33 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.735114:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985116160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.735131:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.735792:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985427712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6819us (7010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.735802:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7650 00002000:00100000:3.0:1746066813.735813:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009ea82050 x1830882985427712/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.735822:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea82050 with x1830882985427712 ext(0->1048575) 00002000:00010000:3.0:1746066813.735828:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea82050 00000100:00100000:2.0:1746066813.737297:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985116032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.737307:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985116160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.737327:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066813.737649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.737691:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428480 00000100:00100000:2.0:1746066813.737698:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428480 00000100:00100000:0.0:1746066813.737705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066813.737727:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 11 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.738372:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428608 00000100:00100000:2.0:1746066813.738375:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428608 00000100:00100000:3.0:1746066813.738389:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9335 00010000:00010000:2.0:1746066813.738389:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 34 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.738398:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985428480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.738409:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066813.738413:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9336 00010000:00010000:3.0:1746066813.738415:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 11 pid: 7244 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746066813.738417:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985428608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.738433:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.738436:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 11 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.738436:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 34 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.738443:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 34 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.738524:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bdc00/0xf1867c21abfb13fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75f4 expref: 11 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.738542:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb13b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75ca expref: 34 pid: 7244 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.738552:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.738556:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.738566:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.738573:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.738617:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.738619:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.738628:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.738710:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985428480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 312us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.738710:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985428608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 291us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.738716:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9335 00000100:00100000:2.0:1746066813.738720:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9336 00010000:00010000:3.0:1746066813.738744:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066813.738750:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066813.738768:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066813.738938:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 34 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.738951:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.738957:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066813.738960:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066813.738962:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0c00, rc 0) 00000100:00100000:3.0:1746066813.738997:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:3347:x1830882985427968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4276us (5684us total) trans 8589937716 rc 0/0 00000100:00100000:3.0:1746066813.739003:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17243 00000100:00100000:0.0:1746066813.739736:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.739775:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.739832:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428352 00000100:00100000:3.0:1746066813.739836:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428352 00002000:00100000:3.0:1746066813.739865:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012ea35180 x1830882985428352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.739875:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35180 with x1830882985428352 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.739879:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea35180 00000100:00100000:3.0:1746066813.739909:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428736 00000100:00100000:3.0:1746066813.739912:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428736 00002000:00100000:3.0:1746066813.739925:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012ea37800 x1830882985428736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.739932:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37800 with x1830882985428736 ext(3145728->4194303) 00002000:00010000:3.0:1746066813.739936:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea37800 00000100:00100000:3.0:1746066813.739959:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7651 00000100:00100000:3.0:1746066813.739964:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985428352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.740644:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7652 00000100:00100000:0.0:1746066813.740653:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985428736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.748978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.749276:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428864 00000100:00100000:3.0:1746066813.749288:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428864 00000100:00100000:3.0:1746066813.749340:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20436 00000100:00100000:3.0:1746066813.749351:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3344:x1830882985428864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.749373:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.749393:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7633 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.749440:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.749449:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066813.749451:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066813.749455:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.751127:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.751150:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 24 pid: 20361 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746066813.751169:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985116288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.751305:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.754765:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985428352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14792us (15021us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066813.754765:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985116288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066813.754776:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7651 00002000:00100000:3.0:1746066813.754787:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012ea35180 x1830882985428352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066813.754792:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066813.754797:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35180 with x1830882985428352 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.754802:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea35180 00010000:00010000:2.0:1746066813.754809:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419800, rc 0) 00000100:00100000:2.0:1746066813.754828:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3344:x1830882985428864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5481us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.754835:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20436 00000100:00100000:0.0:1746066813.755378:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.755484:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985428992 00000100:00100000:3.0:1746066813.755491:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985428992 00002000:00100000:3.0:1746066813.755526:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1282048->1683455) req@ffff88012ea35f80 x1830882985428992/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.755535:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35f80 with x1830882985428992 ext(1282048->1683455) 00010000:00010000:3.0:1746066813.755543:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 23 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.755554:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 23 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:3.0:1746066813.755561:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea35f80 00000100:00100000:3.0:1746066813.755585:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2193 00000100:00100000:3.0:1746066813.755591:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985428992:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066813.760626:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985428736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19960us (20834us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066813.760640:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7652 00002000:00100000:1.0:1746066813.760653:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012ea37800 x1830882985428736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.760664:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37800 with x1830882985428736 ext(3145728->4194303) 00002000:00010000:1.0:1746066813.760671:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea37800 00000100:00100000:3.0:1746066813.764995:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985428992:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9396us (9615us total) trans 21474842746 rc 0/0 00000100:00100000:3.0:1746066813.765008:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2193 00002000:00100000:3.0:1746066813.765019:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1282048->1683455) req@ffff88012ea35f80 x1830882985428992/t21474842746(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/448 e 0 to 0 dl 1746066824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.765028:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35f80 with x1830882985428992 ext(1282048->1683455) 00010000:00010000:3.0:1746066813.765037:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 25 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.765052:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 25 pid: 20361 timeout: 881 lvb_type: 0 00002000:00010000:3.0:1746066813.765059:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea35f80 00000100:00100000:0.0:1746066813.769027:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.769118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.769214:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985429120 00000100:00100000:2.0:1746066813.769224:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985429120 00000100:00100000:3.0:1746066813.769261:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985429248 00000100:00100000:2.0:1746066813.769263:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20437 00000100:00100000:3.0:1746066813.769266:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985429248 00000100:00100000:2.0:1746066813.769269:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985429120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.769283:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.769288:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 26 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:2.0:1746066813.769296:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d763a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.769310:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9337 00000100:00100000:3.0:1746066813.769316:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985429248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.769867:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.769908:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 27 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.769921:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 27 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.769939:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1398 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1282048->1683455) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75c3 expref: 27 pid: 20361 timeout: 881 lvb_type: 0 00010000:00010000:3.0:1746066813.769955:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.769957:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.769963:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.769970:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.769997:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.770008:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985116416:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066813.770075:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb900 going to sleep for 11 seconds 00010000:00010000:2.0:1746066813.770152:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.770155:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.770160:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.770171:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.770184:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15000, rc 0) 00000100:00100000:2.0:1746066813.770219:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985429120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 950us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.770225:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20437 00000100:00100000:0.0:1746066813.771869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.771925:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985116416:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066813.771941:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.771955:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985429376 00000100:00100000:2.0:1746066813.771960:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985429376 00000100:00100000:3.0:1746066813.771971:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985429248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2655us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.771979:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9337 00000100:00100000:2.0:1746066813.772002:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17244 00000100:00100000:2.0:1746066813.772008:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3344:x1830882985429376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.772024:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.772037:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7641 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.772080:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.772091:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.772104:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.772107:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066813.772109:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006ee2e000, rc 0) 00000100:00100000:2.0:1746066813.772131:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3344:x1830882985429376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 124us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.772136:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17244 00000100:00100000:0.0:1746066813.774940:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.775021:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985429632 00000100:00100000:3.0:1746066813.775029:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985429632 00002000:00100000:3.0:1746066813.775063:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c775180 x1830882985429632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.775077:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775180 with x1830882985429632 ext(4194304->4861951) 00002000:00010000:3.0:1746066813.775083:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775180 00000100:00100000:3.0:1746066813.775360:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7653 00000100:00100000:3.0:1746066813.775368:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985429632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.782185:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.782230:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.782254:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.782294:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985430016 00000100:00100000:3.0:1746066813.782303:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985430016 00000100:00100000:0.0:1746066813.782306:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985430144 00000100:00100000:0.0:1746066813.782315:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985430144 00000100:00100000:2.0:1746066813.782332:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985430272 00000100:00100000:2.0:1746066813.782336:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985430272 00002000:00100000:3.0:1746066813.782340:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958a4a80 x1830882985430016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.782346:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958a6a00 x1830882985430144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.782350:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882985430016 ext(1048576->2097151) 00002000:00100000:2.0:1746066813.782353:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958a5c00 x1830882985430272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746066813.782354:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4a80 00002000:00100000:0.0:1746066813.782356:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6a00 with x1830882985430144 ext(1048576->2097151) 00002000:00010000:0.0:1746066813.782360:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6a00 00002000:00100000:2.0:1746066813.782361:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5c00 with x1830882985430272 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.782364:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5c00 00000100:00100000:3.0:1746066813.782375:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7654 00000100:00100000:3.0:1746066813.782382:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985430016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066813.782386:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7655 00000100:00100000:2.0:1746066813.782394:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7656 00000100:00100000:0.0:1746066813.782394:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985430144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.782399:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985430272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.783171:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985429632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7802us (8236us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066813.783178:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7653 00002000:00100000:3.0:1746066813.783184:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c775180 x1830882985429632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.783191:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775180 with x1830882985429632 ext(4194304->4861951) 00002000:00010000:3.0:1746066813.783194:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775180 00000100:00100000:2.0:1746066813.792013:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985430144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9610us (9773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.792025:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7655 00002000:00100000:2.0:1746066813.792037:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958a6a00 x1830882985430144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.792046:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6a00 with x1830882985430144 ext(1048576->2097151) 00002000:00010000:2.0:1746066813.792051:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6a00 00000100:00100000:3.0:1746066813.792200:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985430016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9818us (10022us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.792207:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7654 00002000:00100000:3.0:1746066813.792213:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958a4a80 x1830882985430016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.792220:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882985430016 ext(1048576->2097151) 00002000:00010000:3.0:1746066813.792223:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:0.0:1746066813.796960:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985430272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14550us (14696us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066813.796973:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7656 00002000:00100000:0.0:1746066813.796985:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958a5c00 x1830882985430272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066813.796994:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5c00 with x1830882985430272 ext(1048576->2097151) 00002000:00010000:0.0:1746066813.797000:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5c00 00000100:00100000:0.0:1746066813.810828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.810930:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985430656 00000100:00100000:2.0:1746066813.810940:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985430656 00002000:00100000:2.0:1746066813.810983:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88009c775500 x1830882985430656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.810989:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775500 with x1830882985430656 ext(2097152->3145727) 00002000:00010000:2.0:1746066813.810994:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775500 00000100:00100000:2.0:1746066813.811399:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7657 00000100:00100000:2.0:1746066813.811407:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985430656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066813.819259:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985430656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7843us (8432us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066813.819270:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7657 00002000:00100000:2.0:1746066813.819281:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88009c775500 x1830882985430656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.819290:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775500 with x1830882985430656 ext(2097152->3145727) 00002000:00010000:2.0:1746066813.819295:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775500 00000100:00100000:0.0:1746066813.830523:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.830589:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985430784 00000100:00100000:2.0:1746066813.830597:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985430784 00000100:00100000:2.0:1746066813.830647:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20438 00000100:00100000:2.0:1746066813.830655:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3344:x1830882985430784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.831395:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.831411:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7648 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.831442:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.831444:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.831451:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.831466:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.831474:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096196a00, rc 0) 00000100:00100000:2.0:1746066813.831531:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3344:x1830882985430784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 876us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.831539:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20438 00000100:00100000:0.0:1746066813.837122:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.837207:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431040 00000100:00100000:2.0:1746066813.837220:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431040 00000100:00100000:2.0:1746066813.837283:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17245 00000100:00100000:2.0:1746066813.837290:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3350:x1830882985431040:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.837305:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.837323:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb146a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d764f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.837387:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837397:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837407:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837428:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837434:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837439:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837523:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837531:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837538:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066813.837545:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066813.837604:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837610:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837614:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837619:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837623:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.837626:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837631:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837639:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066813.837641:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.837644:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837648:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb1471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837673:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837681:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837686:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837689:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066813.837691:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837695:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837700:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855800) 00010000:00010000:2.0:1746066813.837702:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066813.837704:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837708:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb1478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066813.837737:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb146a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.837747:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.837753:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066813.837754:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066813.837757:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00000100:00100000:2.0:1746066813.837822:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3350:x1830882985431040:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 531us (711us total) trans 8589937717 rc 0/0 00000100:00100000:2.0:1746066813.837828:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17245 00000100:00100000:0.0:1746066813.838635:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.839146:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431168 00000100:00100000:2.0:1746066813.839153:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431168 00000100:00100000:2.0:1746066813.839181:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20439 00000100:00100000:2.0:1746066813.839186:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:3347:x1830882985431168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.839198:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.839208:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7656 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.839227:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.839234:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.839240:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.839242:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.839245:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.839268:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.839278:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066813.839289:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.840975:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.840987:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 19 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066813.840996:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.841020:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.841231:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.841268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.841285:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431552 00000100:00100000:3.0:1746066813.841296:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431552 00002000:00100000:3.0:1746066813.841342:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c775880 x1830882985431552/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.841352:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775880 with x1830882985431552 ext(2097152->4194303) 00002000:00010000:3.0:1746066813.841357:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c775880 00000100:00100000:3.0:1746066813.841384:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431680 00000100:00100000:3.0:1746066813.841387:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431680 00002000:00100000:3.0:1746066813.841400:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88009c774380 x1830882985431680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.841407:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774380 with x1830882985431680 ext(3145728->4194303) 00002000:00010000:3.0:1746066813.841410:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774380 00000100:00100000:0.0:1746066813.841416:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7658 00000100:00100000:0.0:1746066813.841434:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985431552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.841448:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7659 00000100:00100000:3.0:1746066813.841455:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985431680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.848287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.848415:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985431680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6958us (7144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066813.848437:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7659 00002000:00100000:3.0:1746066813.848449:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88009c774380 x1830882985431680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.848458:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774380 with x1830882985431680 ext(3145728->4194303) 00002000:00010000:3.0:1746066813.848466:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774380 00000100:00100000:2.0:1746066813.848628:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116544:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.848637:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.848662:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.849206:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895400, rc 0) 00000100:00100000:2.0:1746066813.849273:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:3347:x1830882985431168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10085us (10638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.849280:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20439 00000100:00100000:1.0:1746066813.849462:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.849531:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431808 00000100:00100000:2.0:1746066813.849538:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431808 00010000:00010000:2.0:1746066813.849562:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066813.849614:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9338 00000100:00100000:2.0:1746066813.849621:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985431808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.849634:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.849654:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066813.849664:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066813.849685:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfb1455 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d763a expref: 26 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066813.849697:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.849716:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985431808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.849721:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9338 00000100:00100000:2.0:1746066813.849730:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985431936 00000100:00100000:2.0:1746066813.849732:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985431936 00010000:00010000:2.0:1746066813.849741:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 22 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066813.850462:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9339 00000100:00100000:2.0:1746066813.850469:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985431936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.850477:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.850486:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 22 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.850494:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 22 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.850512:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb144e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7633 expref: 22 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.850703:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.850705:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.850712:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.850721:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.850753:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.850765:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985116800:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.850831:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.854977:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985431552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13532us (13734us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066813.854989:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7658 00002000:00100000:2.0:1746066813.855001:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c775880 x1830882985431552/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.855011:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775880 with x1830882985431552 ext(2097152->4194303) 00002000:00010000:2.0:1746066813.855017:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c775880 00000100:00100000:3.0:1746066813.855162:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985116800:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066813.855181:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066813.855215:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985431936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4746us (5753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066813.855223:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9339 00000100:00100000:0.0:1746066813.855862:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.856153:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432192 00000100:00100000:2.0:1746066813.856160:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432192 00002000:00100000:2.0:1746066813.856193:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->1314815) req@ffff88009c776300 x1830882985432192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.856201:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776300 with x1830882985432192 ext(1310720->1314815) 00002000:00010000:2.0:1746066813.856204:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c776300 00000100:00100000:2.0:1746066813.856233:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7660 00000100:00100000:2.0:1746066813.856241:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985432192:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066813.856358:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985432192:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 118us (497us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066813.856364:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7660 00002000:00100000:2.0:1746066813.856369:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->1314815) req@ffff88009c776300 x1830882985432192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066813.856376:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776300 with x1830882985432192 ext(1310720->1314815) 00002000:00010000:2.0:1746066813.856378:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c776300 00000100:00100000:0.0:1746066813.861446:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.861519:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432320 00000100:00100000:2.0:1746066813.861530:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432320 00000100:00100000:2.0:1746066813.861586:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20440 00000100:00100000:2.0:1746066813.861594:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985432320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066813.861614:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.861632:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894e00/0xf1867c21abfb1494 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d765d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.861687:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116928:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066813.862598:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.864771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.865142:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432448 00000100:00100000:2.0:1746066813.865152:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432448 00000100:00100000:3.0:1746066813.865559:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985116928:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066813.865592:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894e00/0xf1867c21abfb1494 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d765d expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.865607:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894e00/0xf1867c21abfb1494 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d765d expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066813.865667:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20441 00000100:00100000:2.0:1746066813.865674:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:3347:x1830882985432448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066813.865690:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.865704:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7664 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.865729:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.865737:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.865743:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.865745:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.865748:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.865778:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.865790:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066813.865803:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.865914:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.865926:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066813.865934:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117184:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.865966:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00010000:00010000:3.0:1746066813.866013:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894e00, rc 0) 00000100:00100000:3.0:1746066813.866047:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985432320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4453us (4613us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.866054:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20440 00000100:00100000:2.0:1746066813.870541:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066813.870556:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117184:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066813.870672:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.870692:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:2.0:1746066813.871009:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:3347:x1830882985432448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5334us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.871019:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20441 00000100:00100000:0.0:1746066813.872659:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.872701:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066813.872758:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432704 00000100:00100000:1.0:1746066813.872766:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432704 00010000:00010000:1.0:1746066813.872803:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066813.872815:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432576 00000100:00100000:3.0:1746066813.872826:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432576 00000100:00100000:1.0:1746066813.872848:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9340 00000100:00100000:1.0:1746066813.872856:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985432704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066813.872863:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066813.872871:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066813.872915:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066813.872927:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066813.872939:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9341 00000100:00100000:3.0:1746066813.872946:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985432576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066813.872952:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfb13d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d8 expref: 26 pid: 9592 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066813.872957:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066813.872972:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066813.872975:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066813.872984:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066813.873003:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb1424 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7617 expref: 19 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066813.873008:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985432704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.873015:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9340 00010000:00010000:3.0:1746066813.873021:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.873023:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066813.873029:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.873036:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.873064:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.873075:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985117312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066813.874924:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.875154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.875198:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985432960 00000100:00100000:3.0:1746066813.875205:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985432960 00002000:00100000:3.0:1746066813.875242:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c774000 x1830882985432960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.875252:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774000 with x1830882985432960 ext(4194304->4861951) 00002000:00010000:3.0:1746066813.875256:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774000 00000100:00100000:0.0:1746066813.876402:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.876563:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985117312:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066813.876581:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.876627:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985432576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3680us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.876635:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9341 00000100:00100000:3.0:1746066813.876678:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433216 00000100:00100000:3.0:1746066813.876682:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433216 00002000:00100000:3.0:1746066813.876703:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1069056->1073151) req@ffff88009c774700 x1830882985433216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.876710:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985433216 ext(1069056->1073151) 00002000:00010000:3.0:1746066813.876714:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774700 00000100:00100000:3.0:1746066813.876725:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7661 00000100:00100000:3.0:1746066813.876731:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985432960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066813.876772:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7662 00000100:00100000:1.0:1746066813.876785:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985433216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066813.877085:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985433216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 303us (682us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066813.877093:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7662 00002000:00100000:1.0:1746066813.877100:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1069056->1073151) req@ffff88009c774700 x1830882985433216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066813.877108:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985433216 ext(1069056->1073151) 00002000:00010000:1.0:1746066813.877113:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774700 00000100:00100000:3.0:1746066813.883659:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985432960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6919us (8500us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066813.883670:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7661 00002000:00100000:3.0:1746066813.883681:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c774000 x1830882985432960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/440 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.883690:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774000 with x1830882985432960 ext(4194304->4861951) 00002000:00010000:3.0:1746066813.883695:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774000 00000100:00100000:0.0:1746066813.888564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066813.888603:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.889114:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433344 00000100:00100000:2.0:1746066813.889114:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433472 00000100:00100000:3.0:1746066813.889122:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433344 00000100:00100000:2.0:1746066813.889122:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433472 00000100:00100000:3.0:1746066813.889175:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20442 00000100:00100000:0.0:1746066813.889180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.889181:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20443 00000100:00100000:3.0:1746066813.889182:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985433344:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066813.889188:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985433472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.889199:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.889200:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066813.889217:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895000/0xf1867c21abfb14a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7672 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066813.889242:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfb14a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d766b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066813.889258:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433600 00000100:00100000:1.0:1746066813.889262:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433600 00000100:00100000:3.0:1746066813.889279:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985117568:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066813.889279:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117440:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066813.889293:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20444 00000100:00100000:1.0:1746066813.889298:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3350:x1830882985433600:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066813.889358:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.889358:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00010000:00010000:1.0:1746066813.889463:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066813.889471:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7679 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889489:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889497:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889503:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.889504:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066813.889507:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3321856->3919871] (req 3321856->3919871) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 23 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889648:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889667:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 23 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066813.889677:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985117696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.889764:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.889772:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 24 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066813.889780:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985117824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.889797:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.890703:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985117568:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066813.890728:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfb14a9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d766b expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.890739:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfb14a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d766b expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066813.890753:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419c00, rc 0) 00000100:00100000:3.0:1746066813.890781:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985433344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1599us (2177us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066813.890788:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20442 00002000:00010000:2.0:1746066813.891128:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066813 -> 1746066814 00002000:00010000:2.0:1746066813.891133:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066806 -> 1746066814 00002000:00010000:2.0:1746066813.891135:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066813 -> 1746066814 00000100:00100000:2.0:1746066813.891144:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985117440:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066813.891161:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895000/0xf1867c21abfb14a2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7672 expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.891175:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895000/0xf1867c21abfb14a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7672 expref: 21 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.891196:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895000, rc 0) 00000100:00100000:2.0:1746066813.891230:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985433472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2039us (2673us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066813.891236:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20443 00000100:00100000:1.0:1746066813.893040:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985117696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066813.893051:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985117824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066813.893081:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3321856->3919871] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066813.893096:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba200, rc 0) 00000100:00100000:1.0:1746066813.893136:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3350:x1830882985433600:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3836us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066813.893143:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20444 00000100:00100000:0.0:1746066813.893706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.893766:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433728 00000100:00100000:2.0:1746066813.893774:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433728 00010000:00010000:2.0:1746066813.893801:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 19 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066813.893844:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9342 00000100:00100000:2.0:1746066813.893853:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985433728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.893865:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.893918:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 19 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.893930:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 19 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.893952:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096196a00/0xf1867c21abfb1463 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7648 expref: 19 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.893964:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066813.893984:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985433728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066813.893990:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9342 00000100:00100000:3.0:1746066813.895000:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.895160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.895199:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.895216:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433984 00000100:00100000:3.0:1746066813.895221:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433984 00000100:00100000:3.0:1746066813.895258:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985433856 00000100:00100000:3.0:1746066813.895261:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985433856 00000100:00100000:3.0:1746066813.895272:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985434112 00000100:00100000:3.0:1746066813.895274:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985434112 00000100:00100000:3.0:1746066813.895286:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20445 00000100:00100000:3.0:1746066813.895291:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985433984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.895306:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.895320:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfb14b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7687 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.895364:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985117952:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066813.895443:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066813.895461:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20446 00000100:00100000:3.0:1746066813.895466:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985433856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066813.895472:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066813.895479:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfb14be lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7680 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066813.895501:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985118080:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066813.895520:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066813.895702:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20447 00000100:00100000:0.0:1746066813.895710:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985434112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066813.895716:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066813.895722:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9c00/0xf1867c21abfb14c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d768e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066813.895734:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066813.895742:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9c00/0xf1867c21abfb14c5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d768e expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.895752:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9c00/0xf1867c21abfb14c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d768e expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.895766:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9c00, rc 0) 00000100:00100000:0.0:1746066813.895790:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985434112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 81us (591us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066813.895796:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20447 00000100:00100000:0.0:1746066813.895844:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.895969:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985434240 00000100:00100000:2.0:1746066813.895973:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985434240 00010000:00010000:2.0:1746066813.895989:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 25 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066813.896006:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9343 00000100:00100000:2.0:1746066813.896010:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985434240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066813.896020:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066813.896034:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 25 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.896048:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 25 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.896062:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb140f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7602 expref: 25 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066813.896073:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.896074:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066813.896081:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.896089:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066813.896108:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066813.896115:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985118208:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066813.896142:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066813.897259:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985118080:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066813.897284:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfb14be lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7680 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.897295:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfb14be lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7680 expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066813.897309:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418200, rc 0) 00000100:00100000:2.0:1746066813.897337:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985433856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1870us (2177us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066813.897343:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20446 00000100:00100000:0.0:1746066813.898123:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985117952:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066813.898140:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfb14b7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7687 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.898150:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfb14b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7687 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066813.898163:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00000100:00100000:0.0:1746066813.898365:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985433984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3071us (3365us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066813.898370:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20445 00000100:00100000:0.0:1746066813.898591:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985118208:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066813.898604:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066813.898634:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985434240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2623us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066813.898643:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9343 00000100:00100000:0.0:1746066813.902501:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066813.902569:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985434496 00000100:00100000:3.0:1746066813.902579:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985434496 00002000:00100000:3.0:1746066813.902628:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3915776->3919871) req@ffff880095800e00 x1830882985434496/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/0 e 0 to 0 dl 1746066824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.902638:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800e00 with x1830882985434496 ext(3915776->3919871) 00002000:00010000:3.0:1746066813.902644:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800e00 00000100:00100000:3.0:1746066813.902675:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7663 00000100:00100000:3.0:1746066813.902684:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985434496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066813.902837:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985434496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 154us (346us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066813.902844:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7663 00002000:00100000:3.0:1746066813.902849:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3915776->3919871) req@ffff880095800e00 x1830882985434496/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:219/0 lens 488/4536 e 0 to 0 dl 1746066824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066813.902857:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800e00 with x1830882985434496 ext(3915776->3919871) 00002000:00010000:3.0:1746066813.902859:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800e00 00000100:00100000:0.0:1746066813.907164:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066813.907225:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985434752 00000100:00100000:2.0:1746066813.907234:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985434752 00000100:00100000:2.0:1746066813.907289:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6493 00000100:00100000:2.0:1746066813.907297:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3350:x1830882985434752:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066813.907533:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3350:x1830882985434752:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 235us (376us total) trans 8589937718 rc 0/0 00000100:00100000:2.0:1746066813.907540:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6493 00000100:00100000:0.0:1746066814.012209:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.012315:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985435008 00000100:00100000:2.0:1746066814.012325:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985435008 00000100:00100000:2.0:1746066814.012498:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17246 00000100:00100000:2.0:1746066814.012508:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:3356:x1830882985435008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.012536:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.012554:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfb14cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7695 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.012629:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012641:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012652:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012667:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012672:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012677:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012772:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012785:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012792:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066814.012800:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066814.012909:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012916:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012920:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012925:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012930:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066814.012934:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012941:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012951:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066814.012954:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066814.012957:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.012962:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfb14d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013464:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013470:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013474:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013479:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066814.013482:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013577:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013586:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855200) 00010000:00010000:2.0:1746066814.013589:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066814.013592:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013596:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfb14da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.013634:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfb14cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.013644:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 35 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.013649:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.013651:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066814.013653:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:2.0:1746066814.013999:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:3356:x1830882985435008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1492us (1800us total) trans 8589937719 rc 0/0 00000100:00100000:2.0:1746066814.014006:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17246 00000100:00100000:0.0:1746066814.016166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.016328:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985435264 00000100:00100000:2.0:1746066814.016336:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985435264 00000100:00100000:2.0:1746066814.016385:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6494 00000100:00100000:2.0:1746066814.016393:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3356:x1830882985435264:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066814.016584:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3356:x1830882985435264:12345-192.168.204.16@tcp:35:cat.0 Request processed in 191us (424us total) trans 8589937720 rc 0/0 00000100:00100000:2.0:1746066814.016591:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6494 00000100:00100000:0.0:1746066814.018093:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.018333:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985435392 00000100:00100000:2.0:1746066814.018341:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985435392 00000100:00100000:2.0:1746066814.018385:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20448 00000100:00100000:2.0:1746066814.018392:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985435392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.018408:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.018432:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb14ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d769c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.018491:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118336:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066814.018577:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.019390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746066814.019446:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066812 -> 1746066814 00000100:00100000:2.0:1746066814.019465:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118336:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.019485:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb14ef lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d769c expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.019495:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb14ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d769c expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.019505:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894200, rc 0) 00000100:00100000:2.0:1746066814.019540:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985435392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1148us (1450us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066814.019547:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20448 00000100:00100000:3.0:1746066814.019634:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985435648 00000100:00100000:3.0:1746066814.019639:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985435648 00000100:00100000:3.0:1746066814.019666:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17247 00000100:00100000:3.0:1746066814.019671:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3359:x1830882985435648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.019684:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.019696:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb14f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76a3 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.019755:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019767:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019777:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019788:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019793:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019799:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019879:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfb150b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019908:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfb150b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019914:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfb150b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066814.019926:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066814.019985:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019990:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.019996:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020001:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020006:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.020010:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020015:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020024:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066814.020026:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.020029:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020034:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb14fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020046:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020051:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020059:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020063:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.020065:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020069:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020074:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5746f00) 00010000:00010000:3.0:1746066814.020075:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.020077:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020081:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb1504 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.020107:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb14f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76a3 expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.020115:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfb150b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76a3 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.020120:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.020122:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066814.020124:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894e00, rc 0) 00000100:00100000:3.0:1746066814.020158:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3359:x1830882985435648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 486us (769us total) trans 8589937721 rc 0/0 00000100:00100000:3.0:1746066814.020163:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17247 00000100:00100000:0.0:1746066814.022108:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.022280:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985435776 00000100:00100000:2.0:1746066814.022288:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985435776 00000100:00100000:2.0:1746066814.022346:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 943 00000100:00100000:2.0:1746066814.022353:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985435776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.022366:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.022389:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfb150b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76a3 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.022407:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.022412:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.022458:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985435776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.022465:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 943 00000100:00100000:0.0:1746066814.022830:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.023066:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436032 00000100:00100000:2.0:1746066814.023070:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436032 00000100:00100000:2.0:1746066814.023098:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6495 00000100:00100000:2.0:1746066814.023103:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3359:x1830882985436032:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066814.023263:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3359:x1830882985436032:12345-192.168.204.16@tcp:35:cat.0 Request processed in 158us (433us total) trans 8589937722 rc 0/0 00000100:00100000:2.0:1746066814.023269:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6495 00000100:00100000:0.0:1746066814.026969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.027071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.027133:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436160 00000100:00100000:1.0:1746066814.027143:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436160 00000100:00100000:1.0:1746066814.027202:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436288 00000100:00100000:1.0:1746066814.027206:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436288 00000100:00100000:1.0:1746066814.027220:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20449 00000100:00100000:1.0:1746066814.027227:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985436160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066814.027251:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.027267:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bb000/0xf1867c21abfb1519 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76aa expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.027276:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20450 00000100:00100000:2.0:1746066814.027285:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985436288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.027292:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.027301:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096196600/0xf1867c21abfb1520 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76b1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066814.027324:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985118464:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066814.027328:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118592:192.168.204.16@tcp:106: 00000100:00080000:3.0:1746066814.027361:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066814.028902:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066814.029019:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.029185:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.029282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.029300:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436544 00000100:00100000:3.0:1746066814.029305:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436544 00002000:00100000:3.0:1746066814.029338:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1310719) req@ffff8800a5d7e300 x1830882985436544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.029348:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830882985436544 ext(1048576->1310719) 00002000:00010000:3.0:1746066814.029352:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:3.0:1746066814.029365:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436800 00000100:00100000:3.0:1746066814.029367:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436800 00002000:00100000:3.0:1746066814.029378:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1073152->2097151) req@ffff8800a5d7d880 x1830882985436800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.029384:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882985436800 ext(1073152->2097151) 00002000:00010000:3.0:1746066814.029386:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:3.0:1746066814.029396:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7664 00000100:00100000:3.0:1746066814.029402:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985436544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.029411:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7665 00000100:00100000:1.0:1746066814.029426:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985436800:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:1.0:1746066814.033947:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066814 -> 1746066815 00000100:00100000:1.0:1746066814.033975:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985118464:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066814.034012:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bb000/0xf1867c21abfb1519 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76aa expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.034027:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb000/0xf1867c21abfb1519 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76aa expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.034053:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb000, rc 0) 00000100:00100000:1.0:1746066814.034106:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985436160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6878us (7147us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066814.034115:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20449 00002000:00010000:2.0:1746066814.034199:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066814 -> 1746066815 00000100:00100000:2.0:1746066814.034208:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118592:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.034224:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096196600/0xf1867c21abfb1520 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b1 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.034233:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096196600/0xf1867c21abfb1520 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b1 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.034245:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096196600, rc 0) 00000100:00100000:2.0:1746066814.034261:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985436288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6978us (7190us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066814.034266:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20450 00000100:00100000:3.0:1746066814.035985:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985436544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6576us (6795us total) trans 0 rc 262144/262144 00000100:00100000:3.0:1746066814.035994:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7664 00002000:00100000:3.0:1746066814.036004:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1310719) req@ffff8800a5d7e300 x1830882985436544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.036013:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830882985436544 ext(1048576->1310719) 00002000:00010000:3.0:1746066814.036018:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:1.0:1746066814.038071:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985436800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8638us (8781us total) trans 0 rc 1024000/1024000 00000100:00100000:1.0:1746066814.038087:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7665 00002000:00100000:1.0:1746066814.038098:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1073152->2097151) req@ffff8800a5d7d880 x1830882985436800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1024000/1024000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.038106:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882985436800 ext(1073152->2097151) 00002000:00010000:1.0:1746066814.038112:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:0.0:1746066814.041756:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.041830:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985436928 00000100:00100000:3.0:1746066814.041839:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985436928 00000100:00100000:3.0:1746066814.042250:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20451 00000100:00100000:3.0:1746066814.042259:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3359:x1830882985436928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.042277:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.042295:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76b8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.042323:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.042330:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.042332:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.042335:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.042364:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.042374:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 23 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.042386:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118720:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.042477:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.046985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.047061:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437056 00000100:00100000:1.0:1746066814.047069:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437056 00002000:00100000:1.0:1746066814.047113:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->2097151) req@ffff880095800000 x1830882985437056/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.047123:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882985437056 ext(1310720->2097151) 00010000:00010000:1.0:1746066814.047133:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 24 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.047146:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 24 pid: 9590 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746066814.047152:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800000 00000100:00100000:3.0:1746066814.047318:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118720:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.047329:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2194 00000100:00100000:1.0:1746066814.047337:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985437056:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066814.047341:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.047362:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2da00, rc 0) 00000100:00100000:3.0:1746066814.047682:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3359:x1830882985436928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5423us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.047689:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20451 00000100:00100000:2.0:1746066814.048042:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.048177:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437184 00000100:00100000:3.0:1746066814.048181:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437184 00000100:00100000:3.0:1746066814.048212:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20452 00000100:00100000:3.0:1746066814.048218:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:3356:x1830882985437184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.048227:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.048241:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76bf expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.048259:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.048265:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.048267:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.048270:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.048293:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.048301:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 18 pid: 12237 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.048316:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118848:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.048370:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.050547:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985118848:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.050574:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.050591:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2dc00, rc 0) 00000100:00100000:3.0:1746066814.050626:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:3356:x1830882985437184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2407us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.050634:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20452 00000100:00100000:2.0:1746066814.053254:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.053505:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437312 00000100:00100000:3.0:1746066814.053515:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437312 00002000:00100000:3.0:1746066814.053558:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3321856->3919871) req@ffff88012e422300 x1830882985437312/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.053568:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422300 with x1830882985437312 ext(3321856->3919871) 00010000:00010000:3.0:1746066814.053581:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 19 pid: 12237 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.053593:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 19 pid: 12237 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.053600:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422300 00000100:00100000:3.0:1746066814.053619:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2195 00000100:00100000:3.0:1746066814.053626:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985437312:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066814.057132:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985437056:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9783us (10145us total) trans 21474842747 rc 0/0 00000100:00100000:2.0:1746066814.057146:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2194 00002000:00100000:2.0:1746066814.057159:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1310720->2097151) req@ffff880095800000 x1830882985437056/t21474842747(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.057169:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882985437056 ext(1310720->2097151) 00010000:00010000:2.0:1746066814.057180:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.057194:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.057202:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800000 00000100:00100000:3.0:1746066814.060045:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985437312:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6408us (6789us total) trans 21474842748 rc 0/0 00000100:00100000:3.0:1746066814.060058:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2195 00002000:00100000:3.0:1746066814.060070:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3321856->3919871) req@ffff88012e422300 x1830882985437312/t21474842748(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.060079:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422300 with x1830882985437312 ext(3321856->3919871) 00010000:00010000:3.0:1746066814.060089:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.060101:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.060108:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422300 00000100:00100000:0.0:1746066814.060641:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.060910:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437440 00000100:00100000:2.0:1746066814.060918:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437440 00010000:00010000:2.0:1746066814.060946:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.061027:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9344 00000100:00100000:2.0:1746066814.061036:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985437440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.061049:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.061066:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.061076:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.061099:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb148d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7656 expref: 27 pid: 9590 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.061333:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.061336:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.061343:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.061352:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.061383:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.061396:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985118976:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.061574:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.062219:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.062363:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437568 00000100:00100000:1.0:1746066814.062376:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437568 00010000:00010000:1.0:1746066814.062431:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.063073:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9345 00000100:00100000:1.0:1746066814.063080:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985437568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.063091:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.063105:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.063115:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.063133:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba200/0xf1867c21abfb14b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7679 expref: 21 pid: 12237 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.063164:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.063166:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.063172:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.063180:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.063207:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066814.063216:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985119104:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066814.063301:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.064468:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985118976:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.064488:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.064531:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985437440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3495us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.064540:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9344 00000100:00100000:1.0:1746066814.064556:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985119104:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066814.064572:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.064602:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985437568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1521us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.064609:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9345 00000100:00100000:0.0:1746066814.068934:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.068979:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.069014:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985437952 00000100:00100000:3.0:1746066814.069025:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985437952 00002000:00100000:3.0:1746066814.069071:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009c777800 x1830882985437952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.069081:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c777800 with x1830882985437952 ext(1048576->2097151) 00000100:00100000:2.0:1746066814.069084:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438080 00002000:00010000:3.0:1746066814.069085:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c777800 00000100:00100000:2.0:1746066814.069092:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438080 00000100:00100000:3.0:1746066814.069126:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7666 00002000:00100000:2.0:1746066814.069127:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c774a80 x1830882985438080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066814.069134:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985437952:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066814.069137:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774a80 with x1830882985438080 ext(2097152->4194303) 00002000:00010000:2.0:1746066814.069141:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774a80 00000100:00100000:2.0:1746066814.069174:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7667 00000100:00100000:2.0:1746066814.069181:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985438080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.077025:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985437952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7882us (8093us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066814.077036:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7666 00002000:00100000:3.0:1746066814.077049:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009c777800 x1830882985437952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.077058:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c777800 with x1830882985437952 ext(1048576->2097151) 00002000:00010000:3.0:1746066814.077063:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c777800 00000100:00100000:0.0:1746066814.082745:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.082783:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985438080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13599us (13799us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066814.082796:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7667 00002000:00100000:2.0:1746066814.082808:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c774a80 x1830882985438080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.082818:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774a80 with x1830882985438080 ext(2097152->4194303) 00002000:00010000:2.0:1746066814.082824:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774a80 00000100:00100000:3.0:1746066814.083036:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438208 00000100:00100000:3.0:1746066814.083048:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438208 00000100:00100000:3.0:1746066814.083106:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20453 00000100:00100000:3.0:1746066814.083114:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3359:x1830882985438208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.083129:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.083144:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76c6 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.083169:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.083176:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.083177:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.083180:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.083207:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.083217:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 25 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.083228:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985119232:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.083317:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.084500:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.084584:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438336 00000100:00100000:2.0:1746066814.084591:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438336 00000100:00100000:2.0:1746066814.084654:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17248 00000100:00100000:2.0:1746066814.084662:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:3360:x1830882985438336:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.084683:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.084699:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb153c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76cd expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.084765:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084777:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084788:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084800:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084805:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084811:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084879:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084915:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 35 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.084921:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.084948:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 35 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.084958:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 35 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.084974:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985119360:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.085044:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00080000:3.0:1746066814.085369:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066814.085508:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985119232:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.085529:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.085543:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:2.0:1746066814.086029:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3359:x1830882985438208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2914us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.086037:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20453 00000100:00100000:2.0:1746066814.086703:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985119360:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.086719:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066814.088666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.088713:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.089401:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438464 00000100:00100000:2.0:1746066814.089410:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438464 00002000:00100000:2.0:1746066814.089475:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1073151) req@ffff880095dd7480 x1830882985438464/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.089485:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882985438464 ext(1048576->1073151) 00010000:00010000:2.0:1746066814.089493:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 26 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.089548:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438720 00000100:00100000:3.0:1746066814.089553:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438720 00000100:00100000:3.0:1746066814.089596:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6496 00000100:00100000:3.0:1746066814.089604:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:314:x1830882985438720:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066814.089907:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:314:x1830882985438720:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 302us (1191us total) trans 8589937723 rc 0/0 00000100:00100000:3.0:1746066814.089915:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6496 00010000:00010000:2.0:1746066814.090177:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 26 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.090191:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd7480 00000100:00100000:2.0:1746066814.090208:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2196 00000100:00100000:2.0:1746066814.090214:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985438464:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066814.091636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.091659:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.091682:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438848 00000100:00100000:0.0:1746066814.091689:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438848 00000100:00100000:2.0:1746066814.091707:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.091851:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985438976 00000100:00100000:0.0:1746066814.091855:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985438976 00000100:00100000:2.0:1746066814.091867:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20454 00000100:00100000:2.0:1746066814.091876:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985438848:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066814.091878:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20455 00000100:00100000:0.0:1746066814.091904:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985438976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066814.091916:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066814.091930:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1558 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76db expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066814.091986:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985119488:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066814.092006:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439104 00000100:00100000:1.0:1746066814.092010:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439104 00000100:00100000:0.0:1746066814.092057:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00010000:00010000:2.0:1746066814.092068:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.092077:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76d4 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.092091:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.092093:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.092102:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 33 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.092117:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 33 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.092127:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629be00, rc 0) 00000100:00100000:2.0:1746066814.092149:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985438848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 274us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.092154:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20454 00010000:00010000:1.0:1746066814.092202:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 37 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.092225:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9346 00000100:00100000:1.0:1746066814.092231:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985439104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.092240:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.092246:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 37 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.092358:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 37 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.092379:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1440 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d762c expref: 37 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.092398:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066814.092403:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.092425:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.092432:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.092462:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.092479:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985439104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 249us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.092485:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9346 00010000:00010000:2.0:1746066814.092491:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092499:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066814.092537:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985438464:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2322us (3877us total) trans 21474842749 rc 0/0 00000004:00200000:2.0:1746066814.092542:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:3.0:1746066814.092545:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2196 00000004:00200000:2.0:1746066814.092547:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00100000:3.0:1746066814.092552:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1073151) req@ffff880095dd7480 x1830882985438464/t21474842749(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.092560:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882985438464 ext(1048576->1073151) 00000004:00010000:2.0:1746066814.092562:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.092566:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 31 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.092571:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.092576:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 31 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.092582:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd7480 00010000:00010000:2.0:1746066814.092583:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092589:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092594:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092600:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092605:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066814.092610:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092616:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092624:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066814.092627:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066814.092630:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092635:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092661:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092666:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092671:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092675:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629b000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066814.092677:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092681:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092688:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855a00) 00010000:00010000:2.0:1746066814.092690:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066814.092692:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092697:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb154a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.092727:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb153c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.092737:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.092747:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.092749:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066814.092751:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:2.0:1746066814.092789:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3360:x1830882985438336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 8128us (8294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.092795:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17248 00000100:00100000:2.0:1746066814.096792:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985119488:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.096831:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1558 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76db expref: 30 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.096845:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1558 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76db expref: 30 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.096856:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf800, rc 0) 00000100:00100000:0.0:1746066814.097118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.097151:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.097165:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.097177:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.097180:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439360 00000100:00100000:1.0:1746066814.097187:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439360 00000100:00100000:0.0:1746066814.097193:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439232 00000100:00100000:0.0:1746066814.097197:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439232 00000100:00100000:3.0:1746066814.097207:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439488 00000100:00100000:3.0:1746066814.097211:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439488 00000100:00100000:1.0:1746066814.097230:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439744 00000100:00100000:1.0:1746066814.097233:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439744 00000100:00100000:2.0:1746066814.097336:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985438976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5043us (5267us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066814.097344:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20455 00000100:00100000:2.0:1746066814.097367:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20456 00000100:00100000:2.0:1746066814.097375:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985439360:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.097389:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.097403:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76e9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.097434:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.097436:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.097444:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.097457:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.097466:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ac00, rc 0) 00000100:00100000:2.0:1746066814.097483:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985439360:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.097488:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20456 00000100:00100000:2.0:1746066814.097499:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20457 00000100:00100000:2.0:1746066814.097503:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985439232:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.097509:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.097518:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76e2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.097529:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.097530:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066814.097634:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20458 00000100:00100000:0.0:1746066814.097640:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985439488:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066814.097647:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20459 00010000:00010000:0.0:1746066814.097647:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066814.097653:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985439744:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066814.097653:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faea00/0xf1867c21abfb1574 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76f0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.097661:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.097668:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76fe expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.097680:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.097681:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.097686:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066814.097692:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985119616:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066814.097698:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.097706:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c200, rc 0) 00000100:00100000:3.0:1746066814.097727:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985439744:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 74us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.097733:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20459 00000100:00100000:0.0:1746066814.097737:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00080000:3.0:1746066814.097747:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746066814.097750:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066814.097755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.097771:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985440000 00000100:00100000:1.0:1746066814.097774:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985440000 00010000:00010000:1.0:1746066814.097787:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 29 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.097807:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9347 00000100:00100000:1.0:1746066814.097812:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985440000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.097821:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.097830:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 29 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.097840:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 29 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.097853:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.097864:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.097869:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.097898:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.097918:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.097919:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066814.097927:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985119744:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.097931:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.097939:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00000100:00100000:2.0:1746066814.097956:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985439232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 453us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.097965:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20457 00000100:00100000:1.0:1746066814.097967:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.100088:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.100126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.100232:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439616 00000100:00100000:2.0:1746066814.100239:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439616 00000100:00100000:2.0:1746066814.100282:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985439872 00000100:00100000:2.0:1746066814.100285:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985439872 00000100:00100000:2.0:1746066814.100301:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20460 00000100:00100000:2.0:1746066814.100309:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985439616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.100327:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.100343:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d76f7 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.100364:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.100366:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.100374:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.100388:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.100400:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a200, rc 0) 00000100:00100000:3.0:1746066814.100569:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20461 00000100:00100000:3.0:1746066814.100576:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985439872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.100583:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.100591:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7705 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.100602:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.100604:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.100607:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.100621:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.100628:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d800, rc 0) 00000100:00100000:2.0:1746066814.101048:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985439616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 738us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.101055:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20460 00000100:00100000:3.0:1746066814.101313:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985439872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 736us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.101318:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20461 00010000:00010000:1.0:1746066814.101380:0:20361:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880095dd5180 x1830882985119616) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 29 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.101408:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb149b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7664 expref: 29 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.101441:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985119616:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066814.101468:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faea00/0xf1867c21abfb1574 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f0 expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.101476:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faea00/0xf1867c21abfb1574 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f0 expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.101484:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faea00, rc 0) 00000100:00100000:0.0:1746066814.101573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.101714:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985440256 00000100:00100000:3.0:1746066814.101718:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985440256 00000100:00100000:3.0:1746066814.101749:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17249 00000100:00100000:3.0:1746066814.101754:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3362:x1830882985440256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066814.101768:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.101781:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096196600/0xf1867c21abfb1590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d770c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.101847:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.101858:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.101868:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.101879:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.101903:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.101909:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.102151:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985439488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4511us (4984us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066814.102160:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20458 00000100:00100000:1.0:1746066814.102192:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985119744:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066814.102205:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066814.102209:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102218:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.102221:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985440000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4409us (4468us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066814.102224:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.102229:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9347 00000004:00200000:3.0:1746066814.102232:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066814.102474:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102481:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102487:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102492:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102498:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.102502:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102508:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102517:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066814.102520:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.102524:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102528:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb1597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102545:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102549:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102553:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102557:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc1c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.102560:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102806:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102814:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098485000) 00010000:00010000:3.0:1746066814.102816:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.102818:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102822:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb159e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.102859:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096196600/0xf1867c21abfb1590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.102873:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.102879:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.102898:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066814.102901:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:3.0:1746066814.102936:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3362:x1830882985440256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1181us (1367us total) trans 8589937724 rc 0/0 00000100:00100000:3.0:1746066814.102942:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17249 00000100:00100000:2.0:1746066814.103440:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.103469:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.103532:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985440640 00000100:00100000:3.0:1746066814.103538:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985440640 00002000:00100000:3.0:1746066814.103567:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012e423800 x1830882985440640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.103578:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882985440640 ext(1048576->2097151) 00002000:00010000:3.0:1746066814.103582:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:3.0:1746066814.103597:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7668 00000100:00100000:3.0:1746066814.103603:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985440640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.103998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.104066:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985440896 00000100:00100000:2.0:1746066814.104070:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985440896 00000100:00100000:2.0:1746066814.104092:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17250 00000100:00100000:2.0:1746066814.104096:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3360:x1830882985440896:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.104106:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.104118:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb15b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d771a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.104180:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.104191:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.104197:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 37 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.104202:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.104227:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 37 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.104236:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 37 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746066814.104236:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985440384 00000100:00100000:0.0:1746066814.104241:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985440384 00000100:00100000:2.0:1746066814.104246:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985119872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066814.104264:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20462 00000100:00100000:0.0:1746066814.104269:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985440384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066814.104277:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066814.104286:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7713 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.104302:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066814.104304:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066814.104310:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066814.104320:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066814.104329:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf400, rc 0) 00000100:00100000:0.0:1746066814.104354:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985440384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066814.104359:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20462 00010000:00010000:2.0:1746066814.105111:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.105126:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 8 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.105135:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985120000:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.105156:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.111953:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985119872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066814.112233:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.112624:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441024 00000100:00100000:1.0:1746066814.112632:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441024 00010000:00010000:1.0:1746066814.112671:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 38 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746066814.112699:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.112767:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985120000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.112874:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.113000:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441152 00000100:00100000:1.0:1746066814.113003:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441152 00010000:00010000:1.0:1746066814.113015:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 9 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.113033:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9348 00000100:00100000:1.0:1746066814.113040:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985441024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.113053:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.113058:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 38 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.113067:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 38 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.113088:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb15a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d770c expref: 38 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.113238:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9349 00000100:00100000:2.0:1746066814.113245:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985441152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.113253:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.113259:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 9 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.113273:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 9 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.113286:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb1551 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76cd expref: 9 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.113306:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.113310:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.113319:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.113330:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.113357:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.113523:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985441152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 277us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.113530:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9349 00010000:00010000:3.0:1746066814.113575:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.113582:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066814.113607:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066814.113728:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb15b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.113747:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.113753:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.113756:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066814.113758:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629aa00, rc 0) 00000100:00100000:3.0:1746066814.113780:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985440896:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9684us (9784us total) trans 8589937725 rc 0/0 00000100:00100000:3.0:1746066814.113785:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17250 00010000:00010000:1.0:1746066814.114157:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066814.114160:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.114178:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985441024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1139us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.114184:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9348 00000100:00100000:3.0:1746066814.115054:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985440640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11448us (11580us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066814.115063:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7668 00002000:00100000:3.0:1746066814.115074:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012e423800 x1830882985440640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.115083:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882985440640 ext(1048576->2097151) 00002000:00010000:3.0:1746066814.115088:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:0.0:1746066814.124500:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.124831:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441280 00000100:00100000:3.0:1746066814.124842:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441280 00000100:00100000:3.0:1746066814.124924:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17251 00000100:00100000:3.0:1746066814.124933:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985441280:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.124961:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.124983:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb15cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7721 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.125075:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.125090:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.125097:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.125128:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.125140:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 9 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.125152:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985120128:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.125244:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.126792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.126872:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441408 00000100:00100000:3.0:1746066814.126878:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441408 00000100:00100000:3.0:1746066814.126933:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20463 00000100:00100000:3.0:1746066814.126939:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3359:x1830882985441408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.126954:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.126968:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7728 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.126991:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.126993:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.126999:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.127013:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.127023:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b200, rc 0) 00000100:00100000:3.0:1746066814.127053:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3359:x1830882985441408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.127058:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20463 00000100:00100000:3.0:1746066814.128627:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985120128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066814.128628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066814.128651:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.128685:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441536 00000100:00100000:1.0:1746066814.128691:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441536 00010000:00010000:1.0:1746066814.128717:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 10 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.128751:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9350 00000100:00100000:1.0:1746066814.128758:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985441536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.129035:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.129042:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 10 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.129053:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 10 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.129073:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb15ba lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d771a expref: 10 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.129092:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066814.129096:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.129105:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.129112:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066814.129139:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066814.129162:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.129169:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066814.129177:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985441536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 419us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.129183:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9350 00000004:00200000:3.0:1746066814.129429:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066814.129434:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066814.129450:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.129480:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb15cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.129511:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.129518:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.129521:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066814.129523:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:3.0:1746066814.129550:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985441280:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4618us (5063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.129557:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17251 00000100:00100000:2.0:1746066814.134586:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.134706:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441920 00000100:00100000:3.0:1746066814.134718:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441920 00000100:00100000:3.0:1746066814.134791:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17252 00000100:00100000:3.0:1746066814.134802:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3365:x1830882985441920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066814.134832:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.134854:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a800/0xf1867c21abfb15e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7736 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.134975:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.134992:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135004:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135019:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135026:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135031:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135148:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135158:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135166:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066814.135177:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066814.135282:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135290:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135295:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135301:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135307:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356ba00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.135311:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135318:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135330:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066814.135333:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.135337:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135342:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ba00/0xf1867c21abfb15eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135357:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135366:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135370:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135374:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356be00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.135376:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135381:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135387:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098485900) 00010000:00010000:3.0:1746066814.135389:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.135392:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135396:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356be00/0xf1867c21abfb15f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.135453:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a800/0xf1867c21abfb15e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.135467:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.135474:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.135476:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066814.135478:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ac00, rc 0) 00000100:00100000:3.0:1746066814.135563:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3365:x1830882985441920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 760us (986us total) trans 8589937726 rc 0/0 00000100:00100000:3.0:1746066814.135571:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17252 00000100:00100000:2.0:1746066814.136748:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.136865:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985441664 00000100:00100000:3.0:1746066814.136873:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985441664 00000100:00100000:3.0:1746066814.136963:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20464 00000100:00100000:3.0:1746066814.136973:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985441664:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.136988:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.137015:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d772f expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.137040:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.137043:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.137052:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.137067:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.137078:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b000, rc 0) 00000100:00100000:3.0:1746066814.137139:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985441664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 167us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.137145:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20464 00000100:00100000:2.0:1746066814.140274:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.140386:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985442176 00000100:00100000:3.0:1746066814.140395:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985442176 00002000:00100000:3.0:1746066814.140456:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012e423100 x1830882985442176/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.140466:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882985442176 ext(2097152->4194303) 00002000:00010000:3.0:1746066814.140475:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:3.0:1746066814.140502:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7669 00000100:00100000:3.0:1746066814.140512:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985442176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066814.144502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.144584:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985442432 00000100:00100000:3.0:1746066814.144593:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985442432 00000100:00100000:3.0:1746066814.144648:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17253 00000100:00100000:3.0:1746066814.144656:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985442432:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.144677:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.144696:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb160e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d773d expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.144801:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144816:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144829:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144841:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144847:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144852:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144857:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.144861:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.144869:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.145028:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.145032:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066814.145038:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.145043:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfb1615 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.145074:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb160e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d773d expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.145081:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfb160e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d773d expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.145089:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:3.0:1746066814.145142:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985442432:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 485us (650us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.145148:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17253 00000100:00100000:0.0:1746066814.152262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.152311:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985442688 00000100:00100000:3.0:1746066814.152320:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985442688 00000100:00100000:3.0:1746066814.152365:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6497 00000100:00100000:3.0:1746066814.152374:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3360:x1830882985442688:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066814.152585:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3360:x1830882985442688:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 212us (334us total) trans 8589937727 rc 0/0 00000100:00100000:3.0:1746066814.152594:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6497 00000100:00100000:2.0:1746066814.155821:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985442176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15296us (15545us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066814.155835:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7669 00002000:00100000:2.0:1746066814.155850:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012e423100 x1830882985442176/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.155860:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882985442176 ext(2097152->4194303) 00002000:00010000:2.0:1746066814.155866:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:0.0:1746066814.156580:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.158515:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985442816 00000100:00100000:3.0:1746066814.158529:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985442816 00000100:00100000:3.0:1746066814.158688:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20465 00000100:00100000:3.0:1746066814.158699:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3365:x1830882985442816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066814.158723:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.158746:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7744 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.158780:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.158789:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 7 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.158796:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.158802:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.158804:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.158808:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1482752->1810431] (req 1482752->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.158848:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.158861:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 28 pid: 20361 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.159206:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.159724:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 7 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.159735:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 7 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.159744:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.159791:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.159800:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 23 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.159809:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120512:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.159835:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.165365:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.165435:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.165464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.165529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.165958:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120256:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.165974:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.165983:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.166019:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1482752->1810431] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.166045:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0c00, rc 0) 00000100:00100000:3.0:1746066814.166106:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3365:x1830882985442816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7407us (9523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.166115:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20465 00000100:00100000:3.0:1746066814.166154:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985443328 00000100:00100000:3.0:1746066814.166161:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985443328 00000100:00100000:3.0:1746066814.166207:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20466 00000100:00100000:3.0:1746066814.166216:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985443328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.166234:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.166250:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1623 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d774b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.166272:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.166284:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1623 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d774b expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.166294:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1623 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d774b expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.166304:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6c00, rc 0) 00000100:00100000:1.0:1746066814.166498:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985443072 00000100:00100000:1.0:1746066814.166502:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985443072 00010000:00010000:1.0:1746066814.166521:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.166538:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985442944 00000100:00100000:1.0:1746066814.166540:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985442944 00010000:00010000:1.0:1746066814.166547:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.166558:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985443200 00000100:00100000:1.0:1746066814.166559:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985443200 00010000:00010000:1.0:1746066814.166567:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.166581:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9351 00000100:00100000:1.0:1746066814.166585:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985443072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.166595:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.166615:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066814.166630:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.166638:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9352 00000100:00100000:2.0:1746066814.166646:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985442944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.166646:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf400/0xf1867c21abfb15c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7713 expref: 29 pid: 20361 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066814.166653:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.166659:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066814.166661:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.166673:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.166674:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882985443072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.166679:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9351 00010000:00010000:2.0:1746066814.166684:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb1535 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76c6 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.166690:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9353 00000100:00100000:1.0:1746066814.166694:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985443200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.166695:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066814.166699:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.166705:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.166709:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985442944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (1247us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066814.166713:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.166714:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9352 00010000:00010000:1.0:1746066814.166723:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb1607 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d772f expref: 8 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066814.166730:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.166731:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.166738:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.166779:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.166817:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066814.166832:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985120640:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066814.166933:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.167314:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985443328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1098us (1878us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.167319:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20466 00000100:00100000:1.0:1746066814.169714:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985120640:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066814.169737:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066814.170220:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.170305:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985443584 00000100:00100000:3.0:1746066814.170315:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985443584 00002000:00100000:3.0:1746066814.170358:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1486847) req@ffff8800a5960000 x1830882985443584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.170367:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960000 with x1830882985443584 ext(1482752->1486847) 00002000:00010000:3.0:1746066814.170372:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960000 00000100:00100000:1.0:1746066814.170452:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985443200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3755us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.170461:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9353 00000100:00100000:3.0:1746066814.170563:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7670 00000100:00100000:3.0:1746066814.170570:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985443584:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066814.171236:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985443584:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 661us (1012us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066814.171242:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7670 00002000:00100000:3.0:1746066814.171250:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1486847) req@ffff8800a5960000 x1830882985443584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.171257:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960000 with x1830882985443584 ext(1482752->1486847) 00002000:00010000:3.0:1746066814.171261:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960000 00000100:00100000:0.0:1746066814.176083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.176216:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985443840 00000100:00100000:3.0:1746066814.176527:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985443840 00002000:00100000:3.0:1746066814.176571:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1806336->1810431) req@ffff8800a5960a80 x1830882985443840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.176580:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960a80 with x1830882985443840 ext(1806336->1810431) 00002000:00010000:3.0:1746066814.176584:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960a80 00000100:00100000:3.0:1746066814.176622:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7671 00000100:00100000:3.0:1746066814.176629:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985443840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.176911:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985443840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 281us (838us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066814.176917:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7671 00002000:00100000:3.0:1746066814.176923:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1806336->1810431) req@ffff8800a5960a80 x1830882985443840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.176930:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960a80 with x1830882985443840 ext(1806336->1810431) 00002000:00010000:3.0:1746066814.176932:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960a80 00000100:00100000:0.0:1746066814.179858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.179917:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444096 00000100:00100000:3.0:1746066814.179924:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444096 00000100:00100000:3.0:1746066814.179967:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6498 00000100:00100000:3.0:1746066814.179973:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3365:x1830882985444096:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066814.180167:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3365:x1830882985444096:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 193us (315us total) trans 8589937728 rc 0/0 00000100:00100000:3.0:1746066814.180174:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6498 00000100:00100000:0.0:1746066814.230802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.230917:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444224 00000100:00100000:3.0:1746066814.230927:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444224 00000100:00100000:3.0:1746066814.230972:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20467 00000100:00100000:3.0:1746066814.230984:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:3362:x1830882985444224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066814.231003:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.231023:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7752 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.231056:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.231063:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 6 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.231070:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 29 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.231076:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.231078:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.231082:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1130496->2035711] (req 1130496->2035711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.231114:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 29 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.231124:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 29 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.231136:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120768:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.231399:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 6 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.231422:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 6 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.231431:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.231457:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.231466:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 21 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.231476:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.231491:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.233851:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.233877:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.233938:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444352 00000100:00100000:2.0:1746066814.233945:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444352 00000100:00100000:0.0:1746066814.233973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066814.233979:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 30 pid: 12233 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.234001:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444480 00000100:00100000:0.0:1746066814.234002:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444608 00000100:00100000:2.0:1746066814.234003:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444480 00000100:00100000:0.0:1746066814.234004:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444608 00010000:00010000:2.0:1746066814.234013:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.234015:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.234026:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9354 00000100:00100000:0.0:1746066814.234029:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9355 00000100:00100000:0.0:1746066814.234034:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985444480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066814.234037:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985444352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.234046:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066814.234046:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.234065:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 30 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.234065:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.234075:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.234393:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.234406:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985120896:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.234425:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121024:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.234490:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9356 00000100:00100000:1.0:1746066814.234497:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985444608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.234504:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.234530:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 30 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.234552:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1566 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e9 expref: 7 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.234587:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [1130496->2035711] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.234599:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7200, rc 0) 00010000:00010000:1.0:1746066814.234659:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.234667:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.234678:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfb1527 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76b8 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.234697:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.234712:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985444608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 216us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.234718:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9356 00010000:00010000:0.0:1746066814.234792:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.234793:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629be00/0xf1867c21abfb155f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76d4 expref: 30 pid: 12233 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.234794:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066814.234801:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.234809:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.234818:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.234833:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985444352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 802us (990us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066814.234837:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.234838:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9354 00000100:00100000:0.0:1746066814.234848:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5886a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121152:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066814.234900:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.235079:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:3362:x1830882985444224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4099us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.235086:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20467 00000100:00100000:0.0:1746066814.236710:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.236803:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5886a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121152:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.236821:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.236851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985444480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2816us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.236859:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9355 00000100:00100000:1.0:1746066814.236993:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985444864 00000100:00100000:1.0:1746066814.237000:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985444864 00002000:00100000:1.0:1746066814.237035:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->1134591) req@ffff8800a5885180 x1830882985444864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.237044:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885180 with x1830882985444864 ext(1130496->1134591) 00002000:00010000:1.0:1746066814.237048:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885180 00000100:00100000:1.0:1746066814.237107:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7672 00000100:00100000:1.0:1746066814.237113:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985444864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066814.237230:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985444864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066814.237236:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7672 00002000:00100000:1.0:1746066814.237240:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->1134591) req@ffff8800a5885180 x1830882985444864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.237248:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885180 with x1830882985444864 ext(1130496->1134591) 00002000:00010000:1.0:1746066814.237250:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885180 00000100:00100000:0.0:1746066814.244757:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.244911:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445120 00000100:00100000:3.0:1746066814.244921:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445120 00002000:00100000:3.0:1746066814.244972:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (2031616->2035711) req@ffff8800a5887800 x1830882985445120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.244983:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5887800 with x1830882985445120 ext(2031616->2035711) 00002000:00010000:3.0:1746066814.244989:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5887800 00000100:00100000:3.0:1746066814.245025:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7673 00000100:00100000:3.0:1746066814.245033:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985445120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066814.245182:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985445120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066814.245192:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7673 00002000:00100000:3.0:1746066814.245198:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (2031616->2035711) req@ffff8800a5887800 x1830882985445120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.245205:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5887800 with x1830882985445120 ext(2031616->2035711) 00002000:00010000:3.0:1746066814.245209:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5887800 00000100:00100000:0.0:1746066814.250018:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.250122:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445376 00000100:00100000:3.0:1746066814.250131:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445376 00000100:00100000:3.0:1746066814.250184:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6499 00000100:00100000:3.0:1746066814.250193:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3362:x1830882985445376:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066814.250447:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3362:x1830882985445376:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 251us (435us total) trans 8589937729 rc 0/0 00000100:00100000:3.0:1746066814.250457:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6499 00000100:00100000:0.0:1746066814.290921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.291056:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445504 00000100:00100000:3.0:1746066814.291064:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445504 00000100:00100000:3.0:1746066814.291108:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20468 00000100:00100000:3.0:1746066814.291116:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985445504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.291136:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.291154:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1631 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7759 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.291203:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121280:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066814.292129:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00002000:00010000:3.0:1746066814.293601:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066814 -> 1746066815 00002000:00010000:3.0:1746066814.293606:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066814 -> 1746066815 00000100:00100000:3.0:1746066814.293656:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121280:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066814.293684:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1631 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7759 expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.293697:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1631 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7759 expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.293724:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7600, rc 0) 00000100:00100000:3.0:1746066814.293773:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985445504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2656us (2895us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.293781:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20468 00000100:00100000:0.0:1746066814.299525:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.299842:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445632 00000100:00100000:3.0:1746066814.299851:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445632 00000100:00100000:3.0:1746066814.299931:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20469 00000100:00100000:3.0:1746066814.299940:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3373:x1830882985445632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.299965:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.299984:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7760 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.300015:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.300022:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.300024:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.300027:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.300062:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.300074:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 27 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.300086:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121408:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.300498:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.303164:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121408:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.303196:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.303214:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7e00, rc 0) 00000100:00100000:3.0:1746066814.303339:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3373:x1830882985445632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3397us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.303348:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20469 00000100:00100000:0.0:1746066814.303683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.303726:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445760 00000100:00100000:1.0:1746066814.303733:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445760 00002000:00100000:1.0:1746066814.303770:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->2035711) req@ffff8800a5886d80 x1830882985445760/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.303785:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985445760 ext(1130496->2035711) 00010000:00010000:1.0:1746066814.303792:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 28 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.303804:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 28 pid: 12233 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746066814.303810:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886d80 00000100:00100000:1.0:1746066814.303837:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2197 00000100:00100000:1.0:1746066814.303844:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985445760:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066814.314310:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985445760:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10450us (10612us total) trans 21474842750 rc 0/0 00000100:00100000:1.0:1746066814.314324:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2197 00002000:00100000:1.0:1746066814.314339:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1130496->2035711) req@ffff8800a5886d80 x1830882985445760/t21474842750(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.314349:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985445760 ext(1130496->2035711) 00010000:00010000:1.0:1746066814.314360:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.314377:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746066814.314384:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886d80 00000100:00100000:0.0:1746066814.317530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.317592:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985445888 00000100:00100000:2.0:1746066814.317601:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985445888 00010000:00010000:2.0:1746066814.317654:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.317692:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9357 00000100:00100000:2.0:1746066814.317700:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985445888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.317714:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.317733:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.317749:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.317771:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7200/0xf1867c21abfb162a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1130496->2035711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7752 expref: 30 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.317804:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.317805:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.317813:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.317822:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.317855:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.317867:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121536:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.318793:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.320979:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121536:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.321000:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.321042:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985445888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3341us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.321058:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9357 00000100:00100000:0.0:1746066814.324183:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.324231:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.324688:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985446144 00000100:00100000:1.0:1746066814.324698:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985446144 00002000:00100000:1.0:1746066814.324735:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5884000 x1830882985446144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.324745:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884000 with x1830882985446144 ext(1048576->2097151) 00002000:00010000:1.0:1746066814.324749:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5884000 00000100:00100000:1.0:1746066814.324773:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985446400 00000100:00100000:1.0:1746066814.324775:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985446400 00002000:00100000:1.0:1746066814.324786:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5885c00 x1830882985446400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 504/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.324792:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885c00 with x1830882985446400 ext(1048576->2097151) 00002000:00010000:1.0:1746066814.324795:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885c00 00000100:00100000:1.0:1746066814.324807:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7674 00000100:00100000:1.0:1746066814.324813:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985446144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.325045:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7675 00000100:00100000:3.0:1746066814.325053:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985446400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066814.333287:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.333324:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.333515:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985446528 00000100:00100000:1.0:1746066814.333527:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985446528 00000100:00100000:1.0:1746066814.333573:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985446656 00000100:00100000:1.0:1746066814.333575:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985446656 00000100:00100000:1.0:1746066814.333602:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20470 00000100:00100000:1.0:1746066814.333609:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985446528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066814.333625:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066814.333638:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20471 00010000:00010000:1.0:1746066814.333641:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7767 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.333649:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985446656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.333663:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.333664:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.333666:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.333674:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.333675:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb1646 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d776e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.333692:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.333703:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b000, rc 0) 00000100:00100000:3.0:1746066814.333740:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121664:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066814.333762:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985446400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8709us (9528us total) trans 0 rc 720896/720896 00000100:00100000:2.0:1746066814.333772:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7675 00002000:00100000:2.0:1746066814.333780:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5885c00 x1830882985446400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 504/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.333793:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885c00 with x1830882985446400 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.333797:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885c00 00000100:00100000:1.0:1746066814.333987:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985446528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 377us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.333993:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20470 00000100:00100000:3.0:1746066814.334000:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00002000:00010000:3.0:1746066814.336199:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066814 -> 1746066815 00002000:00010000:3.0:1746066814.336205:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066814 -> 1746066815 00000100:00100000:3.0:1746066814.336427:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121664:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066814.336457:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb1646 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d776e expref: 31 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.336471:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb1646 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d776e expref: 31 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.336499:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7c00, rc 0) 00000100:00100000:3.0:1746066814.336546:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985446656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2898us (3219us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.336553:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20471 00000100:00100000:1.0:1746066814.336995:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985446144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12181us (12819us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066814.337003:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7674 00002000:00100000:1.0:1746066814.337011:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5884000 x1830882985446144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.337020:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884000 with x1830882985446144 ext(1048576->2097151) 00002000:00010000:1.0:1746066814.337025:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5884000 00000100:00100000:0.0:1746066814.342557:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.342624:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985446912 00000100:00100000:1.0:1746066814.342633:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985446912 00002000:00100000:1.0:1746066814.342675:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5886a00 x1830882985446912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.342682:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985446912 ext(1048576->2097151) 00002000:00010000:1.0:1746066814.342687:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:1.0:1746066814.342718:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7676 00000100:00100000:1.0:1746066814.342726:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985446912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.350347:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985446912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7611us (7802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066814.350359:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7676 00002000:00100000:1.0:1746066814.350370:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5886a00 x1830882985446912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.350378:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985446912 ext(1048576->2097151) 00002000:00010000:1.0:1746066814.350384:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:0.0:1746066814.356112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.356484:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447040 00000100:00100000:3.0:1746066814.356495:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447040 00000100:00100000:3.0:1746066814.356574:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20472 00000100:00100000:3.0:1746066814.356582:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+30:3376:x1830882985447040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.356601:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.356620:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7775 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.356650:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.356658:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.356660:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.356664:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 31 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.356700:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.356713:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 21 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.356726:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.356842:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.358657:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985121792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.358683:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 31 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.358700:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6600, rc 0) 00000100:00100000:3.0:1746066814.358745:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+31:3376:x1830882985447040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2163us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.358754:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20472 00000100:00100000:0.0:1746066814.359328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.359498:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447168 00000100:00100000:1.0:1746066814.359511:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447168 00002000:00100000:1.0:1746066814.359558:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1810431) req@ffff88012b165880 x1830882985447168/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.359566:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882985447168 ext(1482752->1810431) 00010000:00010000:1.0:1746066814.359576:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.359590:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746066814.359597:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165880 00000100:00100000:1.0:1746066814.359631:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2198 00000100:00100000:1.0:1746066814.359638:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985447168:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066814.365201:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985447168:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5550us (5861us total) trans 21474842751 rc 0/0 00000100:00100000:0.0:1746066814.365214:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2198 00002000:00100000:0.0:1746066814.365228:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1810431) req@ffff88012b165880 x1830882985447168/t21474842751(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066814.365237:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882985447168 ext(1482752->1810431) 00010000:00010000:0.0:1746066814.365248:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.365262:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00002000:00010000:0.0:1746066814.365270:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165880 00000100:00100000:0.0:1746066814.369045:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.369097:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.369181:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447424 00000100:00100000:2.0:1746066814.369189:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447424 00010000:00010000:2.0:1746066814.369224:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.369251:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9358 00000100:00100000:2.0:1746066814.369258:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985447424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.369270:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.369289:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.369300:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.369321:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfb161c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7744 expref: 24 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.369730:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447296 00000100:00100000:3.0:1746066814.369741:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447296 00000100:00100000:3.0:1746066814.369799:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17254 00000100:00100000:3.0:1746066814.369807:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3378:x1830882985447296:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.369830:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.369845:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7a00/0xf1867c21abfb1654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d777c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.369931:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.369942:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.369951:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.369960:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.369965:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.369969:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370028:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370036:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370040:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066814.370069:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066814.370073:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066814.370085:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370093:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370099:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370104:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370109:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370114:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370118:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acda7c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.370121:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370127:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370134:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066814.370136:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.370140:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370144:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7c00/0xf1867c21abfb165b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370169:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370174:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370179:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370182:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acda7200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066814.370184:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370187:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370193:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098485e00) 00010000:00010000:3.0:1746066814.370195:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066814.370196:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370200:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7200/0xf1867c21abfb1662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066814.370222:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7a00/0xf1867c21abfb1654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d777c expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.370232:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d777c expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.370238:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.370239:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066814.370241:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7600, rc 0) 00000100:00100000:3.0:1746066814.370289:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985447296:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 483us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.370296:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17254 00010000:00010000:2.0:1746066814.370387:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.370391:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.370400:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.370589:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.372830:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066814.375187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.375223:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.375264:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.375305:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447808 00000100:00100000:1.0:1746066814.375314:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447552 00000100:00100000:0.0:1746066814.375314:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447808 00000100:00100000:1.0:1746066814.375326:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447552 00000100:00100000:1.0:1746066814.375386:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985447680 00000100:00100000:1.0:1746066814.375389:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985447680 00000100:00100000:3.0:1746066814.375521:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20473 00000100:00100000:3.0:1746066814.375533:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985447552:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066814.375550:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.376633:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7783 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.377527:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.377531:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.377543:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 8 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.377560:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 8 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.377572:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6c00, rc 0) 00000100:00100000:2.0:1746066814.377593:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121920:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066814.377647:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985447552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2117us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.377654:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20473 00000100:00100000:2.0:1746066814.377665:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066814.378352:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20474 00000100:00100000:1.0:1746066814.378363:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985447680:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746066814.379645:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 944 00000100:00100000:0.0:1746066814.379655:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985447808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.379657:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066814.379673:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.379679:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d778a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.379696:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1669 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d777c expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.379724:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066814.379729:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066814.379759:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985447808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (4494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066814.379765:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 944 00010000:00010000:1.0:1746066814.379869:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.379872:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.379893:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.379909:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.379919:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a400, rc 0) 00000100:00100000:1.0:1746066814.379963:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985447680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1602us (4738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.379970:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20474 00000100:00100000:3.0:1746066814.383132:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.383188:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448064 00000100:00100000:1.0:1746066814.383198:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448064 00000100:00100000:1.0:1746066814.383254:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17255 00000100:00100000:1.0:1746066814.383260:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3378:x1830882985448064:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066814.383279:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.383388:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb167e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7791 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.384067:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985121920:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.384088:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.384253:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985447424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 14994us (15153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.384263:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9358 00010000:00010000:1.0:1746066814.384908:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066814.384925:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.384933:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.384943:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066814.384975:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.384986:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 18 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.385002:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122048:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.385148:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.385157:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 10 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.385164:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122176:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.385302:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.386355:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.386427:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.386491:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448320 00000100:00100000:2.0:1746066814.386498:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448320 00002000:00100000:2.0:1746066814.386565:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012b164700 x1830882985448320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.386575:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164700 with x1830882985448320 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.386580:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b164700 00000100:00100000:2.0:1746066814.386600:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7677 00000100:00100000:2.0:1746066814.386608:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985448320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.386620:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448448 00000100:00100000:3.0:1746066814.386624:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448448 00010000:00010000:3.0:1746066814.386644:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 19 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.386689:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9359 00000100:00100000:3.0:1746066814.386694:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985448448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.386704:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.386710:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 19 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.386720:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 19 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.386740:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.386745:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.386752:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.386757:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.386787:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985448448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.386794:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9359 00010000:00010000:1.0:1746066814.386855:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfb15f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7736 expref: 18 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.386877:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122048:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.386910:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122176:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066814.386917:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066814.386939:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066814.387531:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448576 00000100:00100000:3.0:1746066814.387537:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448576 00010000:00010000:3.0:1746066814.387553:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 11 pid: 10125 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.387575:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9360 00000100:00100000:3.0:1746066814.387580:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985448576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.387590:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.387594:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 11 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.387603:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 11 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.387617:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356aa00/0xf1867c21abfb15d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7721 expref: 11 pid: 10125 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.387631:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.387634:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.387642:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.387649:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.387677:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.387700:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985448576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.387706:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9360 00010000:00010000:1.0:1746066814.387821:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066814.387833:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066814.387853:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066814.387992:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb167e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.388004:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.388011:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066814.388013:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066814.388015:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:1.0:1746066814.388053:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985448064:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4793us (4928us total) trans 8589937730 rc 0/0 00000100:00100000:1.0:1746066814.388059:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17255 00000100:00100000:0.0:1746066814.394601:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.394774:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448704 00000100:00100000:1.0:1746066814.394785:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448704 00000100:00100000:1.0:1746066814.394847:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17256 00000100:00100000:1.0:1746066814.394856:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985448704:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066814.394916:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.394937:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb1693 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7798 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.395036:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066814.395050:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.395057:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066814.396368:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.396383:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 11 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.396397:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.396505:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.399003:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985448320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12387us (12642us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066814.399018:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7677 00002000:00100000:2.0:1746066814.399029:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012b164700 x1830882985448320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.399038:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164700 with x1830882985448320 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.399044:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b164700 00000100:00100000:0.0:1746066814.399159:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122304:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066814.399186:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066814.399927:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.399972:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985448832 00000100:00100000:3.0:1746066814.399985:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985448832 00010000:00010000:3.0:1746066814.400012:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.400044:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9361 00000100:00100000:3.0:1746066814.400049:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985448832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.400057:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.400061:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.400073:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.400088:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1685 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7791 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.400102:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.400105:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.400111:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.400115:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.400147:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.400174:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985448832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 126us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.400179:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9361 00010000:00010000:0.0:1746066814.400315:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066814.400322:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746066814.400367:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066814.400371:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066814.400384:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066814.400427:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb1693 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.400441:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.400446:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066814.400449:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066814.400451:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152e00, rc 0) 00000100:00100000:0.0:1746066814.400472:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985448704:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5618us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066814.400478:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17256 00000100:00100000:0.0:1746066814.402808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.402924:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449088 00000100:00100000:2.0:1746066814.402931:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449088 00000100:00100000:2.0:1746066814.402981:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17257 00000100:00100000:2.0:1746066814.402989:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3380:x1830882985449088:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066814.403008:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.403021:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfb16a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d779f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.403091:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.403102:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.403107:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066814.403126:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.403134:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 9 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.403144:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.403378:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.407927:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.408066:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985122432:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.408089:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066814.408146:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449344 00000100:00100000:2.0:1746066814.408152:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449344 00000100:00100000:0.0:1746066814.408184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.408190:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17258 00000100:00100000:2.0:1746066814.408197:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985449344:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066814.408211:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.408224:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb16af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77a6 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.408335:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449472 00000100:00100000:3.0:1746066814.408338:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449472 00010000:00010000:3.0:1746066814.408354:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.408387:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9362 00000100:00100000:3.0:1746066814.408392:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985449472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.408402:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.408406:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.408425:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.408439:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfb169a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7798 expref: 12 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.408453:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.408457:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.408465:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.408471:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.408484:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.408514:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985449472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.408520:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9362 00010000:00010000:3.0:1746066814.408566:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066814.408574:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066814.408588:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066814.408683:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfb16a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.408694:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.408700:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066814.408702:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066814.408703:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:3.0:1746066814.408736:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3380:x1830882985449088:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5748us (5933us total) trans 8589937731 rc 0/0 00000100:00100000:3.0:1746066814.408741:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17257 00010000:00010000:2.0:1746066814.408977:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.408986:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.408992:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 4/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.409012:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.409022:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 19 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.409032:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985122560:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.409070:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.410536:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985122560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.410559:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066814.411314:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.411650:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449600 00000100:00100000:2.0:1746066814.411656:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449600 00010000:00010000:2.0:1746066814.411682:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 20 pid: 7244 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.411713:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9363 00000100:00100000:2.0:1746066814.411718:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985449600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.411728:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.411732:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 20 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.411739:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 20 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.411757:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb16a8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d779f expref: 20 pid: 7244 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.411959:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.411965:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.411975:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.411981:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.412011:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066814.412034:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412041:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412058:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412064:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412070:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412076:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066814.412080:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412086:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412095:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066814.412097:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066814.412101:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412105:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb16bd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066814.412189:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb16af lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77a6 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.412196:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb16af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77a6 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.412199:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985449600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 479us (886us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066814.412205:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b600, rc 0) 00000100:00100000:2.0:1746066814.412207:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9363 00000100:00100000:0.0:1746066814.412273:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3378:x1830882985449344:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4075us (4353us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066814.412280:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17258 00000100:00100000:0.0:1746066814.415245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.415628:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449856 00000100:00100000:3.0:1746066814.415637:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449856 00000100:00100000:3.0:1746066814.415676:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6500 00000100:00100000:3.0:1746066814.415683:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3378:x1830882985449856:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066814.415869:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3378:x1830882985449856:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 186us (634us total) trans 8589937732 rc 0/0 00000100:00100000:3.0:1746066814.415876:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6500 00000100:00100000:0.0:1746066814.451547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.451671:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985449984 00000100:00100000:1.0:1746066814.451682:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985449984 00000100:00100000:1.0:1746066814.451750:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20475 00000100:00100000:1.0:1746066814.451758:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3380:x1830882985449984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066814.451777:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.451795:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77ad expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.451824:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.451838:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.451845:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.451852:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.451854:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.451857:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1351680->1937407] (req 1351680->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.451911:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.451923:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 13 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.451935:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.452025:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.452033:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.452040:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.452064:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.452071:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.452078:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122944:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.452092:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05180 going to sleep for 11 seconds 00000100:00080000:3.0:1746066814.452254:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066814.457931:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.457968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.458007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.458032:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985450240 00000100:00100000:0.0:1746066814.458040:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985450240 00000100:00100000:2.0:1746066814.458058:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985450112 00000100:00100000:2.0:1746066814.458064:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985450112 00010000:00010000:2.0:1746066814.458083:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 10 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.458083:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 14 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.458176:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985450368 00000100:00100000:2.0:1746066814.458180:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985450368 00010000:00010000:2.0:1746066814.458192:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00000100:00100000:0.0:1746066814.458204:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9364 00000100:00100000:2.0:1746066814.458208:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9365 00000100:00100000:0.0:1746066814.458212:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985450240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066814.458213:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985450112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.458224:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066814.458224:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.458242:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 10 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.458243:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 14 pid: 9592 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746066814.458253:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 14 pid: 9592 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066814.458286:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 10 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066814.458316:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066814.458316:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.458353:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985450112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 138us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066814.458353:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985450240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.458359:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9365 00000100:00100000:0.0:1746066814.458363:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9364 00000100:00100000:2.0:1746066814.458376:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9366 00000100:00100000:2.0:1746066814.458380:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985450368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.458385:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.458391:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066814.458400:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746066814.458420:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.458422:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.458429:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.458437:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.458467:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.458479:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985123072:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.458546:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.460458:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985123072:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.460479:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.460505:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985450368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2123us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.460516:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9366 00010000:00010000:1.0:1746066814.460820:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5fa00/0xf1867c21abfb142b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d761e expref: 13 pid: 9592 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.460839:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.460851:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1582 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76f7 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.460860:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.460872:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfb13c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75df expref: 36 pid: 12255 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.460880:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985122944:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.460935:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.460946:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575aa00, rc 0) 00000100:00100000:1.0:1746066814.460970:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3380:x1830882985449984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9213us (9434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.460977:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20475 00000100:00100000:0.0:1746066814.462634:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.463155:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985450624 00000100:00100000:2.0:1746066814.463164:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985450624 00002000:00100000:2.0:1746066814.463205:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1355775) req@ffff88012b165500 x1830882985450624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.463214:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985450624 ext(1351680->1355775) 00002000:00010000:2.0:1746066814.463219:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165500 00000100:00100000:2.0:1746066814.463249:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7678 00000100:00100000:2.0:1746066814.463257:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985450624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.463397:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985450624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 141us (769us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.463404:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7678 00002000:00100000:2.0:1746066814.463421:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1355775) req@ffff88012b165500 x1830882985450624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.463428:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985450624 ext(1351680->1355775) 00002000:00010000:2.0:1746066814.463431:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165500 00000100:00100000:0.0:1746066814.469080:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.469299:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985450880 00000100:00100000:2.0:1746066814.469308:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985450880 00002000:00100000:2.0:1746066814.469364:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1933312->1937407) req@ffff88012c490e00 x1830882985450880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.469374:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882985450880 ext(1933312->1937407) 00002000:00010000:2.0:1746066814.469380:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490e00 00000100:00100000:2.0:1746066814.469420:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7679 00000100:00100000:2.0:1746066814.469429:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985450880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.470353:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985450880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (507us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.470360:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7679 00002000:00100000:2.0:1746066814.470371:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1933312->1937407) req@ffff88012c490e00 x1830882985450880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.470378:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882985450880 ext(1933312->1937407) 00002000:00010000:2.0:1746066814.470382:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490e00 00000100:00100000:0.0:1746066814.471047:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.471368:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451136 00000100:00100000:2.0:1746066814.471373:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451136 00000100:00100000:2.0:1746066814.471545:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17259 00000100:00100000:2.0:1746066814.471552:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3384:x1830882985451136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066814.471570:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.471587:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb16cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77b4 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.471687:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.471701:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.471711:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066814.471721:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066814.471807:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfb16cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.472123:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.472130:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.472133:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066814.472137:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a800, rc 0) 00000100:00100000:2.0:1746066814.472184:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3384:x1830882985451136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 633us (1138us total) trans 8589937733 rc 0/0 00000100:00100000:2.0:1746066814.472190:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17259 00000100:00100000:0.0:1746066814.472635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.473144:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451392 00000100:00100000:3.0:1746066814.473149:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451392 00000100:00100000:3.0:1746066814.473399:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6501 00000100:00100000:3.0:1746066814.473415:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3380:x1830882985451392:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066814.473563:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3380:x1830882985451392:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 155us (927us total) trans 8589937734 rc 0/0 00000100:00100000:3.0:1746066814.473568:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6501 00000100:00100000:0.0:1746066814.476337:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.476628:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451520 00000100:00100000:1.0:1746066814.476636:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451520 00000100:00100000:1.0:1746066814.476676:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20476 00000100:00100000:1.0:1746066814.476683:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3384:x1830882985451520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066814.476701:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.476718:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77bb expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.476747:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.476755:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.476762:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.476768:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.476769:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.476772:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2834432->2945023] (req 2834432->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.476803:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066814.476813:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 7 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.476825:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.477772:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.477782:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 22 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.477791:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123328:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.477820:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.477827:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.477834:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066814.477848:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066814.482496:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.482554:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.482583:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451648 00000100:00100000:1.0:1746066814.482591:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451648 00010000:00010000:1.0:1746066814.482625:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 8 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746066814.482647:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451776 00000100:00100000:1.0:1746066814.482649:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451776 00010000:00010000:1.0:1746066814.482656:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 23 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.482668:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9367 00000100:00100000:1.0:1746066814.482673:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985451648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.482685:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.482706:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 8 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066814.482716:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 8 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066814.482740:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.482777:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985451648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.482783:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9367 00000100:00100000:1.0:1746066814.482796:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9368 00000100:00100000:1.0:1746066814.482801:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985451776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.482806:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.482812:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 23 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.483116:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfb1589 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7705 expref: 7 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.483147:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123200:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.483158:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123328:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.483165:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985123456:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.483194:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2834432->2945023] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.483203:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779400, rc 0) 00000100:00100000:2.0:1746066814.483224:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3384:x1830882985451520:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6542us (6899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.483230:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20476 00010000:00010000:1.0:1746066814.483283:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 23 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.483295:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb15dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7728 expref: 23 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746066814.483317:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.483333:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985451776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 533us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.483340:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9368 00000100:00100000:3.0:1746066814.483569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.483679:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985451904 00000100:00100000:0.0:1746066814.483683:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985451904 00010000:00010000:0.0:1746066814.483698:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746066814.483728:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9369 00000100:00100000:0.0:1746066814.483734:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985451904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066814.483741:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066814.483750:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.483758:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.483771:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb152e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76bf expref: 32 pid: 12233 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.483828:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066814.483831:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066814.483839:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.483847:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066814.483878:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066814.484086:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985123584:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066814.484276:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.485228:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985123584:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.485243:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.485275:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985451904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1540us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.485283:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9369 00000100:00100000:0.0:1746066814.486191:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.486256:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452160 00000100:00100000:2.0:1746066814.486261:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452160 00002000:00100000:2.0:1746066814.486298:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2838527) req@ffff88012c493b80 x1830882985452160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.486308:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882985452160 ext(2834432->2838527) 00002000:00010000:2.0:1746066814.486313:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493b80 00000100:00100000:2.0:1746066814.486341:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7680 00000100:00100000:2.0:1746066814.486348:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985452160:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.486507:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985452160:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (318us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.486513:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7680 00002000:00100000:2.0:1746066814.486517:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2838527) req@ffff88012c493b80 x1830882985452160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.486524:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882985452160 ext(2834432->2838527) 00002000:00010000:2.0:1746066814.486526:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493b80 00000100:00100000:0.0:1746066814.488689:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.489074:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452416 00000100:00100000:2.0:1746066814.489082:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452416 00002000:00100000:2.0:1746066814.489121:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2940928->2945023) req@ffff88012c491180 x1830882985452416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.489131:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985452416 ext(2940928->2945023) 00002000:00010000:2.0:1746066814.489138:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:2.0:1746066814.489168:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7681 00000100:00100000:2.0:1746066814.489177:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882985452416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.489300:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882985452416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 123us (618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.489306:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7681 00002000:00100000:2.0:1746066814.489311:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2940928->2945023) req@ffff88012c491180 x1830882985452416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.489317:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985452416 ext(2940928->2945023) 00002000:00010000:2.0:1746066814.489320:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:0.0:1746066814.535242:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.536102:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452544 00000100:00100000:2.0:1746066814.536113:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452544 00000100:00100000:2.0:1746066814.536193:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20477 00000100:00100000:2.0:1746066814.536201:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985452544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.536219:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.536236:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb16e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77c2 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.536286:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985123712:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066814.537556:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00002000:00010000:2.0:1746066814.537798:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066813 -> 1746066815 00002000:00010000:2.0:1746066814.537801:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066813 -> 1746066815 00002000:00010000:2.0:1746066814.537803:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066813 -> 1746066815 00000100:00100000:2.0:1746066814.537823:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985123712:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.537847:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb16e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c2 expref: 37 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.537859:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb16e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c2 expref: 37 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.537896:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a200, rc 0) 00000100:00100000:2.0:1746066814.537929:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985452544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1728us (2697us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066814.537936:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20477 00000100:00100000:0.0:1746066814.543986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.544123:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452672 00000100:00100000:2.0:1746066814.544133:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452672 00000100:00100000:2.0:1746066814.544175:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20478 00000100:00100000:2.0:1746066814.544183:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3389:x1830882985452672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.544202:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.544220:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77c9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.544249:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.544256:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066814.544258:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066814.544261:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.544288:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.544304:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 11 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.544317:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985123840:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.544398:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.547198:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985123840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.547229:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.547248:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:2.0:1746066814.547287:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3389:x1830882985452672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3104us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.547296:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20478 00000100:00100000:0.0:1746066814.547501:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.547661:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452800 00000100:00100000:3.0:1746066814.547668:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452800 00002000:00100000:3.0:1746066814.547707:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1937407) req@ffff88012c490380 x1830882985452800/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.547721:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882985452800 ext(1351680->1937407) 00010000:00010000:3.0:1746066814.547728:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 12 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.547740:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 12 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.547746:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c490380 00000100:00100000:3.0:1746066814.547775:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2199 00000100:00100000:3.0:1746066814.547782:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985452800:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066814.557716:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985452800:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9926us (10207us total) trans 17179875394 rc 0/0 00000100:00100000:3.0:1746066814.557727:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2199 00002000:00100000:3.0:1746066814.557739:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1937407) req@ffff88012c490380 x1830882985452800/t17179875394(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.557754:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882985452800 ext(1351680->1937407) 00010000:00010000:3.0:1746066814.557763:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.557777:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.557784:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c490380 00000100:00100000:0.0:1746066814.564606:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.564675:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985452928 00000100:00100000:2.0:1746066814.564685:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985452928 00010000:00010000:2.0:1746066814.564724:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.564764:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9370 00000100:00100000:2.0:1746066814.564772:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985452928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.564788:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.564809:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.564825:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.564850:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb16c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ad expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.564904:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.564907:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.564915:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.564924:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.565594:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.565607:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985123968:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.566857:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.569142:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985123968:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066814.569166:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.569226:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985452928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4453us (4633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.569237:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9370 00000100:00100000:0.0:1746066814.570861:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.571286:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985453056 00000100:00100000:2.0:1746066814.571295:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985453056 00000100:00100000:2.0:1746066814.572106:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20479 00000100:00100000:2.0:1746066814.572115:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985453056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.572134:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.572151:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77d0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.572176:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.572178:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.572187:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.572201:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.572211:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a600, rc 0) 00000100:00100000:2.0:1746066814.572257:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985453056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.572263:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20479 00000100:00100000:1.0:1746066814.572612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.572804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.573044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.573125:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985453184 00000100:00100000:2.0:1746066814.573130:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985453184 00000100:00100000:2.0:1746066814.573151:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985453312 00000100:00100000:2.0:1746066814.573153:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985453312 00000100:00100000:2.0:1746066814.573169:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20480 00000100:00100000:3.0:1746066814.573170:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985453568 00000100:00100000:2.0:1746066814.573174:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985453184:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066814.573175:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985453568 00010000:00010000:2.0:1746066814.573184:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.573196:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77d7 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066814.573208:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958a5f80 x1830882985453568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066814.573210:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.573212:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746066814.573216:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5f80 with x1830882985453568 ext(1048576->2097151) 00010000:00010000:2.0:1746066814.573217:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746066814.573221:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5f80 00010000:00010000:2.0:1746066814.573231:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066814.573236:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7682 00000100:00100000:3.0:1746066814.573240:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985453568:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746066814.573240:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b000, rc 0) 00000100:00100000:2.0:1746066814.573261:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985453184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.573266:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20480 00000100:00100000:2.0:1746066814.573276:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20481 00000100:00100000:2.0:1746066814.573280:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985453312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.573286:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.573293:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb1703 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77de expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.573331:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985124096:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066814.573373:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0000 going to sleep for 11 seconds 00002000:00010000:2.0:1746066814.579922:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066814 -> 1746066815 00002000:00010000:2.0:1746066814.579930:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066814 -> 1746066815 00002000:00010000:2.0:1746066814.579932:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066814 -> 1746066815 00000100:00100000:2.0:1746066814.579956:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985124096:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.579990:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb1703 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77de expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.580002:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb1703 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77de expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.580032:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a000, rc 0) 00000100:00100000:2.0:1746066814.580090:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985453312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6808us (7284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066814.580098:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20481 00000100:00100000:3.0:1746066814.585158:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985453568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11905us (12102us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066814.585169:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7682 00002000:00100000:3.0:1746066814.585183:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958a5f80 x1830882985453568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.585193:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5f80 with x1830882985453568 ext(1048576->2097151) 00002000:00010000:3.0:1746066814.585198:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5f80 00000100:00100000:0.0:1746066814.593922:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.594249:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985453824 00000100:00100000:2.0:1746066814.594258:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985453824 00000100:00100000:2.0:1746066814.594457:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17260 00000100:00100000:2.0:1746066814.594466:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3394:x1830882985453824:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066814.594494:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.594511:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfb170a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77e5 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.594628:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.594643:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066814.594654:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066814.594666:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066814.594761:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfb170a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.594782:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.594796:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066814.594798:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066814.594802:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b600, rc 0) 00000100:00100000:2.0:1746066814.594847:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3394:x1830882985453824:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 382us (962us total) trans 8589937735 rc 0/0 00000100:00100000:2.0:1746066814.594853:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17260 00000100:00100000:0.0:1746066814.601363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.601472:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454080 00000100:00100000:3.0:1746066814.601482:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454080 00002000:00100000:3.0:1746066814.601531:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89d500 x1830882985454080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 504/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.601541:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d500 with x1830882985454080 ext(2097152->4194303) 00002000:00010000:3.0:1746066814.601547:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d500 00000100:00100000:3.0:1746066814.601730:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7683 00000100:00100000:3.0:1746066814.601738:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985454080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066814.612805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.612843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.613027:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454336 00000100:00100000:2.0:1746066814.613037:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454336 00002000:00100000:2.0:1746066814.613080:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89dc00 x1830882985454336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.613090:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89dc00 with x1830882985454336 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.613095:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89dc00 00000100:00100000:2.0:1746066814.613116:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454592 00000100:00100000:2.0:1746066814.613118:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454592 00002000:00100000:2.0:1746066814.613130:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89d180 x1830882985454592/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.613137:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985454592 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.613139:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89d180 00000100:00100000:2.0:1746066814.613152:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7684 00000100:00100000:2.0:1746066814.613158:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985454336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.613318:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7685 00000100:00100000:3.0:1746066814.613327:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985454592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066814.618212:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985454080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16463us (16849us total) trans 0 rc 1986560/1986560 00000100:00100000:3.0:1746066814.618223:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7683 00002000:00100000:3.0:1746066814.618234:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89d500 x1830882985454080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 504/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1986560/1986560 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.618245:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d500 with x1830882985454080 ext(2097152->4194303) 00002000:00010000:3.0:1746066814.618251:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d500 00000100:00100000:2.0:1746066814.627429:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985454336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14257us (14621us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066814.627443:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7684 00002000:00100000:2.0:1746066814.627455:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89dc00 x1830882985454336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.627465:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89dc00 with x1830882985454336 ext(1048576->2097151) 00002000:00010000:2.0:1746066814.627471:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89dc00 00000100:00100000:3.0:1746066814.632854:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985454592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19512us (19993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066814.632873:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7685 00002000:00100000:3.0:1746066814.632913:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89d180 x1830882985454592/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.632924:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985454592 ext(1048576->2097151) 00002000:00010000:3.0:1746066814.632931:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89d180 00000100:00100000:0.0:1746066814.649387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.649819:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454720 00000100:00100000:2.0:1746066814.649830:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454720 00000100:00100000:2.0:1746066814.649921:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20482 00000100:00100000:2.0:1746066814.649934:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3392:x1830882985454720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066814.649954:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.649973:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77ec expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.650005:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.650012:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066814.650014:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066814.650017:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.650227:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.650240:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 30 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.650253:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985124224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.651733:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0480 going to sleep for 11 seconds 00010000:00010000:1.0:1746066814.654400:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066814.658026:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985124224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.658061:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.658081:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b800, rc 0) 00000100:00100000:2.0:1746066814.658125:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3392:x1830882985454720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8192us (8748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.658135:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20482 00000100:00100000:0.0:1746066814.659502:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.659582:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454848 00000100:00100000:3.0:1746066814.659590:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454848 00002000:00100000:3.0:1746066814.659631:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2945023) req@ffff88009d89e300 x1830882985454848/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.659641:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e300 with x1830882985454848 ext(2834432->2945023) 00010000:00010000:3.0:1746066814.659648:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 31 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.659661:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 31 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.659668:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d89e300 00000100:00100000:3.0:1746066814.659699:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2200 00000100:00100000:3.0:1746066814.659706:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985454848:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066814.664427:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985454848:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4713us (4921us total) trans 21474842752 rc 0/0 00000100:00100000:3.0:1746066814.664437:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2200 00002000:00100000:3.0:1746066814.664447:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2834432->2945023) req@ffff88009d89e300 x1830882985454848/t21474842752(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.664461:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e300 with x1830882985454848 ext(2834432->2945023) 00010000:00010000:3.0:1746066814.664469:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.664482:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746066814.664488:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d89e300 00000100:00100000:0.0:1746066814.676991:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.677919:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985454976 00000100:00100000:3.0:1746066814.677931:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985454976 00010000:00010000:3.0:1746066814.677971:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.678000:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9371 00000100:00100000:3.0:1746066814.678007:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985454976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.678019:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.678037:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.678048:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.678067:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779400/0xf1867c21abfb16e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77bb expref: 33 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.678087:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.678089:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.678094:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.678101:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.678127:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.678136:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985124352:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066814.678855:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.679690:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985124352:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066814.679709:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.679745:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985454976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1737us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.679755:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9371 00000100:00100000:0.0:1746066814.684133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.685248:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455232 00000100:00100000:3.0:1746066814.685258:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455232 00002000:00100000:3.0:1746066814.685308:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89e680 x1830882985455232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066814.685319:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e680 with x1830882985455232 ext(2097152->4194303) 00002000:00010000:3.0:1746066814.685324:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89e680 00000100:00100000:3.0:1746066814.685400:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7686 00000100:00100000:3.0:1746066814.685418:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985455232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066814.693225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.693309:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455360 00000100:00100000:2.0:1746066814.693320:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455360 00000100:00100000:2.0:1746066814.693384:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20483 00000100:00100000:2.0:1746066814.693392:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3394:x1830882985455360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066814.693425:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.693444:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77f3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.693478:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693486:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693494:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693500:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.693502:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.693507:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [208896->888831] (req 208896->888831) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.693538:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693551:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.693563:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.693677:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693686:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 8 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.693695:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.693722:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.693730:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 36 pid: 12255 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746066814.693738:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.693753:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.696860:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.696945:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455488 00000100:00100000:1.0:1746066814.696955:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455488 00000100:00100000:1.0:1746066814.697012:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20484 00000100:00100000:1.0:1746066814.697020:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:3396:x1830882985455488:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066814.697036:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066814.697052:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d77fa expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.697077:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.697084:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.697086:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.697089:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3321856->3919871] (req 3321856->3919871) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.697097:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.697108:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.697115:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.697116:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985124736:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066814.697130:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 25 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746066814.697140:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985124864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066814.697145:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [208896->888831] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.697159:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:2.0:1746066814.697215:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3394:x1830882985455360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3823us (3998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.697223:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20483 00000100:00100000:1.0:1746066814.697237:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.699332:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.699359:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.699394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.699448:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455616 00000100:00100000:3.0:1746066814.699454:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455616 00010000:00010000:3.0:1746066814.699481:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.699504:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455744 00000100:00100000:3.0:1746066814.699507:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455744 00010000:00010000:3.0:1746066814.699516:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.699528:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985455872 00000100:00100000:3.0:1746066814.699529:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985455872 00010000:00010000:3.0:1746066814.699538:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746066814.699551:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9372 00000100:00100000:3.0:1746066814.699557:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985455616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.699566:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.699580:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.699588:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.699605:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfb1416 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7609 expref: 15 pid: 11630 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.699619:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.699646:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985455616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.699650:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9373 00000100:00100000:3.0:1746066814.699654:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9372 00000100:00100000:1.0:1746066814.699657:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985455744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.699665:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066814.699669:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9374 00000100:00100000:3.0:1746066814.699673:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985455872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066814.699674:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.699679:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066814.699683:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.700183:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.700192:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.700203:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095675e00/0xf1867c21abfb13c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75d1 expref: 37 pid: 12255 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746066814.700211:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.700226:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985455872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 553us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.700232:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9374 00010000:00010000:1.0:1746066814.700271:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a400/0xf1867c21abfb156d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76e2 expref: 9 pid: 9590 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746066814.700287:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.700289:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066814.700296:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.700304:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066814.700336:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.700374:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985124864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066814.700381:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985455232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14958us (16252us total) trans 0 rc 2097152/2097152 00010000:00010000:3.0:1746066814.700393:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3321856->3919871] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.700393:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7686 00010000:00010000:3.0:1746066814.700410:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46e200, rc 0) 00002000:00100000:2.0:1746066814.700418:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89e680 x1830882985455232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.700427:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89e680 with x1830882985455232 ext(2097152->4194303) 00000100:00100000:3.0:1746066814.700429:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:3396:x1830882985455488:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3411us (3577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.700435:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20484 00010000:00010000:2.0:1746066814.700435:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.700450:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.700456:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d89e680 00000100:00100000:1.0:1746066814.700537:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985124992:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066814.700607:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066814.703678:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985124992:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066814.703705:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066814.703755:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985455744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4098us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.703765:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9373 00000100:00100000:0.0:1746066814.704008:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.704219:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985456128 00000100:00100000:2.0:1746066814.704226:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985456128 00002000:00100000:2.0:1746066814.704263:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->212991) req@ffff88009d89c000 x1830882985456128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.704272:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89c000 with x1830882985456128 ext(208896->212991) 00002000:00010000:2.0:1746066814.704277:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89c000 00000100:00100000:2.0:1746066814.704309:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7687 00000100:00100000:2.0:1746066814.704316:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985456128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.704653:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985456128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 336us (1053us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.704659:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7687 00002000:00100000:2.0:1746066814.704665:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->212991) req@ffff88009d89c000 x1830882985456128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.704672:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89c000 with x1830882985456128 ext(208896->212991) 00002000:00010000:2.0:1746066814.704675:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89c000 00000100:00100000:0.0:1746066814.705777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.705842:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985456256 00000100:00100000:1.0:1746066814.705846:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985456256 00010000:00010000:1.0:1746066814.705869:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746066814.706000:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9375 00000100:00100000:2.0:1746066814.706008:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985456256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.706017:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.706035:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.706046:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.706069:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb171f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77ec expref: 24 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.706092:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.706094:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.706100:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.706107:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.706137:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.706147:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985125120:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.706209:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.706864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.706966:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985456384 00000100:00100000:3.0:1746066814.706969:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985456384 00000100:00100000:3.0:1746066814.706995:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20485 00000100:00100000:3.0:1746066814.706999:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3392:x1830882985456384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.707009:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.707019:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7801 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.707035:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.707042:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.707043:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.707046:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.707065:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.707076:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 32 pid: 3528 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.707085:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985125248:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.707167:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066814.707503:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985125120:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.707515:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.707534:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985456256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1526us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.707541:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9375 00000100:00100000:3.0:1746066814.707870:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985125248:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.707903:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.707918:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:3.0:1746066814.707939:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3392:x1830882985456384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 940us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.707945:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20485 00000100:00100000:0.0:1746066814.711467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.711655:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985456640 00000100:00100000:2.0:1746066814.711665:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985456640 00002000:00100000:2.0:1746066814.711717:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7f:0x0] (884736->888831) req@ffff88009666ed80 x1830882985456640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.711727:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882985456640 ext(884736->888831) 00002000:00010000:2.0:1746066814.711733:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:2.0:1746066814.711756:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7688 00000100:00100000:2.0:1746066814.711764:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985456640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.711967:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985456640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 202us (509us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.711974:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7688 00002000:00100000:2.0:1746066814.711980:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7f:0x0] (884736->888831) req@ffff88009666ed80 x1830882985456640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.711987:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882985456640 ext(884736->888831) 00002000:00010000:2.0:1746066814.711989:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:0.0:1746066814.716190:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.716335:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985456896 00000100:00100000:2.0:1746066814.716344:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985456896 00002000:00100000:2.0:1746066814.716390:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3915776->3919871) req@ffff88009666c380 x1830882985456896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.716415:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882985456896 ext(3915776->3919871) 00010000:00010000:2.0:1746066814.716425:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.716439:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.716446:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666c380 00000100:00100000:2.0:1746066814.716923:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2201 00000100:00100000:2.0:1746066814.716932:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985456896:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.717293:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985456896:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 362us (1113us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066814.717305:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2201 00002000:00100000:2.0:1746066814.717311:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3915776->3919871) req@ffff88009666c380 x1830882985456896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.717319:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882985456896 ext(3915776->3919871) 00010000:00010000:2.0:1746066814.717324:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.717334:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.717341:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666c380 00000100:00100000:0.0:1746066814.721598:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.721740:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457152 00000100:00100000:2.0:1746066814.721750:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457152 00002000:00100000:2.0:1746066814.721800:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3321856->3919871) req@ffff88009666d180 x1830882985457152/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.721810:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d180 with x1830882985457152 ext(3321856->3919871) 00010000:00010000:2.0:1746066814.721820:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.721834:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 33 pid: 3528 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.721842:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666d180 00000100:00100000:2.0:1746066814.721873:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2202 00000100:00100000:2.0:1746066814.721880:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985457152:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066814.729750:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985457152:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7856us (8150us total) trans 21474842753 rc 0/0 00000100:00100000:0.0:1746066814.729766:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2202 00002000:00100000:0.0:1746066814.729779:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3321856->3919871) req@ffff88009666d180 x1830882985457152/t21474842753(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066814.729789:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d180 with x1830882985457152 ext(3321856->3919871) 00010000:00010000:0.0:1746066814.729800:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.729817:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00002000:00010000:0.0:1746066814.729824:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666d180 00000100:00100000:0.0:1746066814.733467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.733558:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457280 00000100:00100000:3.0:1746066814.733566:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457280 00010000:00010000:3.0:1746066814.733602:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.733676:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9376 00000100:00100000:3.0:1746066814.733684:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985457280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.733699:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.733719:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.733732:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.733757:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e200/0xf1867c21abfb172d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3321856->3919871) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77fa expref: 35 pid: 3528 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.733788:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.733791:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.733798:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.733812:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.733846:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.733860:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985125376:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066814.734223:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.737144:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985125376:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066814.737171:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.737230:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985457280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3545us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.737240:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9376 00000100:00100000:0.0:1746066814.738376:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.738561:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457536 00000100:00100000:2.0:1746066814.738569:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457536 00002000:00100000:2.0:1746066814.738612:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009666d880 x1830882985457536/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.738622:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d880 with x1830882985457536 ext(3145728->4194303) 00002000:00010000:2.0:1746066814.738626:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666d880 00000100:00100000:2.0:1746066814.738642:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7689 00000100:00100000:2.0:1746066814.738649:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985457536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066814.744948:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985457536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6285us (6560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066814.744961:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7689 00002000:00100000:2.0:1746066814.745002:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009666d880 x1830882985457536/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.745011:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d880 with x1830882985457536 ext(3145728->4194303) 00002000:00010000:2.0:1746066814.745018:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666d880 00000100:00100000:0.0:1746066814.748107:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066814.748172:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066814.748924:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985125504 00000100:00100000:1.0:1746066814.748932:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985125504 00000100:00080000:3.0:1746066814.748982:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066814.748997:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1746066814.749005:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985125504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746066814.749029:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1295269184 pending 3477504 free 3906400256 avail 3674877952 00000100:00100000:1.0:1746066814.749079:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985125504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066814.749085:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1746066814.749095:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066814.760788:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.760839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.760840:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457664 00000100:00100000:3.0:1746066814.760849:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457664 00000100:00100000:2.0:1746066814.760870:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457792 00000100:00100000:2.0:1746066814.760874:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457792 00000100:00100000:3.0:1746066814.760909:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20486 00000100:00100000:2.0:1746066814.760916:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20487 00000100:00100000:3.0:1746066814.760917:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985457664:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066814.760922:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985457792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.760934:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066814.760934:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.760951:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ebbde00/0xf1867c21abfb1742 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7808 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.760951:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d780f expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.760972:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.760974:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.760982:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066814.760996:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066814.761003:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985125632:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066814.761006:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83000, rc 0) 00000100:00100000:2.0:1746066814.761057:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985457792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.761062:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20487 00000100:00100000:3.0:1746066814.761081:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00002000:00010000:3.0:1746066814.763115:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066810 -> 1746066815 00002000:00010000:3.0:1746066814.763120:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066809 -> 1746066815 00002000:00010000:3.0:1746066814.763121:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066810 -> 1746066815 00000100:00100000:3.0:1746066814.763138:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985125632:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066814.763163:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ebbde00/0xf1867c21abfb1742 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7808 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.763172:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ebbde00/0xf1867c21abfb1742 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7808 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.763192:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ebbde00, rc 0) 00000100:00100000:3.0:1746066814.763223:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985457664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2307us (2446us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.763228:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20486 00000100:00100000:0.0:1746066814.764947:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.764993:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985457920 00000100:00100000:3.0:1746066814.765001:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985457920 00000100:00100000:3.0:1746066814.765038:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20488 00000100:00100000:3.0:1746066814.765046:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:3403:x1830882985457920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.765061:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.765076:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7816 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.765100:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.765107:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.765109:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066814.765112:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.765136:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.765147:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 13 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.765158:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985125760:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.765234:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.768816:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985125760:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.768846:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.768868:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016a00, rc 0) 00000100:00100000:3.0:1746066814.768951:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:3403:x1830882985457920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3904us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.768959:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20488 00000100:00100000:0.0:1746066814.770440:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066814.770521:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458048 00000100:00100000:2.0:1746066814.770528:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458048 00002000:00100000:2.0:1746066814.770568:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->888831) req@ffff8800a59c7100 x1830882985458048/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066814.770582:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7100 with x1830882985458048 ext(208896->888831) 00010000:00010000:2.0:1746066814.770590:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:2.0:1746066814.770601:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 14 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:2.0:1746066814.770607:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a59c7100 00000100:00100000:2.0:1746066814.770621:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2203 00000100:00100000:2.0:1746066814.770626:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985458048:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066814.781074:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985458048:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10435us (10624us total) trans 17179875395 rc 0/0 00000100:00100000:0.0:1746066814.781087:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2203 00002000:00100000:0.0:1746066814.781099:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->888831) req@ffff8800a59c7100 x1830882985458048/t17179875395(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/448 e 0 to 0 dl 1746066825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066814.781110:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7100 with x1830882985458048 ext(208896->888831) 00010000:00010000:0.0:1746066814.781471:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746066814.781486:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00002000:00010000:0.0:1746066814.781493:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a59c7100 00000100:00100000:0.0:1746066814.782795:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.782910:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458176 00000100:00100000:3.0:1746066814.782918:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458176 00010000:00010000:3.0:1746066814.782946:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746066814.783534:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9377 00000100:00100000:3.0:1746066814.783544:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985458176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066814.783561:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066814.783582:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.783593:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.783617:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfb1726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77f3 expref: 16 pid: 11630 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746066814.783647:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.783650:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.783658:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.783666:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.783697:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.783708:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985125888:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066814.783786:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.787708:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.787999:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985125888:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066814.788018:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066814.788058:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985458176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4515us (5264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.788072:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9377 00000100:00100000:1.0:1746066814.788147:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458432 00000100:00100000:1.0:1746066814.788154:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458432 00002000:00100000:1.0:1746066814.788192:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c4a80 x1830882985458432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.788202:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4a80 with x1830882985458432 ext(0->1048575) 00002000:00010000:1.0:1746066814.788207:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4a80 00000100:00100000:1.0:1746066814.788233:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7690 00000100:00100000:1.0:1746066814.788365:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985458432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.816138:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985458432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27885us (28427us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066814.816153:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7690 00002000:00100000:1.0:1746066814.816165:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c4a80 x1830882985458432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.816175:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4a80 with x1830882985458432 ext(0->1048575) 00002000:00010000:1.0:1746066814.816181:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4a80 00000100:00100000:0.0:1746066814.840708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.840836:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458688 00000100:00100000:1.0:1746066814.840846:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458688 00002000:00100000:1.0:1746066814.840969:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a59c5c00 x1830882985458688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.840979:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5c00 with x1830882985458688 ext(2097152->4194303) 00002000:00010000:1.0:1746066814.840985:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5c00 00000100:00100000:1.0:1746066814.841418:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7691 00000100:00100000:1.0:1746066814.841427:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985458688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.865345:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985458688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23907us (24638us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066814.865356:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7691 00002000:00100000:1.0:1746066814.865369:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a59c5c00 x1830882985458688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.865377:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5c00 with x1830882985458688 ext(2097152->4194303) 00002000:00010000:1.0:1746066814.865383:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5c00 00000100:00100000:0.0:1746066814.952691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.953126:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458816 00000100:00100000:3.0:1746066814.953135:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458816 00000100:00100000:3.0:1746066814.953188:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20489 00000100:00100000:3.0:1746066814.953196:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:3408:x1830882985458816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066814.953210:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.953223:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d781d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.953248:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.953255:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.953262:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 6 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.953268:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.953269:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.953272:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1482752->1810431] (req 1482752->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.953298:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 6 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.953309:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 6 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066814.953321:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.953417:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.953426:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 23 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066814.953434:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126144:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.953458:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.953466:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066814.953473:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.953487:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.956713:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.957018:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126144:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066814.957025:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126272:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066814.957048:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1482752->1810431] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066814.957069:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017c00, rc 0) 00000100:00100000:3.0:1746066814.957121:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:3408:x1830882985458816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3925us (4437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.957130:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20489 00000100:00100000:0.0:1746066814.959081:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.959119:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066814.959152:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.959225:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985458944 00000100:00100000:1.0:1746066814.959232:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985458944 00010000:00010000:1.0:1746066814.959266:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 7 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066814.959290:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459072 00000100:00100000:1.0:1746066814.959292:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459072 00010000:00010000:1.0:1746066814.959301:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 24 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066814.959574:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459200 00000100:00100000:1.0:1746066814.959577:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459200 00010000:00010000:1.0:1746066814.959589:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066814.959652:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9378 00000100:00100000:2.0:1746066814.959661:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985458944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.959674:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.959690:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 7 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959701:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 7 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959721:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb1677 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d778a expref: 7 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959739:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.959770:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985458944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.959776:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9378 00000100:00100000:2.0:1746066814.959790:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9379 00000100:00100000:2.0:1746066814.959794:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985459072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.959800:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.959806:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 24 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959813:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 24 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959823:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a600/0xf1867c21abfb16f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d0 expref: 24 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066814.959836:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066814.959850:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985459072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.959855:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9379 00000100:00100000:2.0:1746066814.959865:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9380 00000100:00100000:2.0:1746066814.959868:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985459200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066814.959873:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066814.959879:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066814.959912:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066814.959923:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb164d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7775 expref: 36 pid: 12233 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066814.959931:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.959932:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066814.959938:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.959944:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066814.959970:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066814.959980:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985126400:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066814.960018:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066814.961974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.962009:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459456 00000100:00100000:1.0:1746066814.962014:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459456 00000100:00100000:2.0:1746066814.962016:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985126400:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066814.962031:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746066814.962045:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1486847) req@ffff8800a59c6680 x1830882985459456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.962054:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985459456 ext(1482752->1486847) 00002000:00010000:1.0:1746066814.962058:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:2.0:1746066814.962067:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985459200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2196us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066814.962075:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9380 00000100:00100000:1.0:1746066814.962082:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7692 00000100:00100000:1.0:1746066814.962088:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985459456:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066814.962199:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985459456:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 111us (231us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066814.962205:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7692 00002000:00100000:1.0:1746066814.962210:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1486847) req@ffff8800a59c6680 x1830882985459456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.962217:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985459456 ext(1482752->1486847) 00002000:00010000:1.0:1746066814.962219:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:0.0:1746066814.968594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.968645:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459712 00000100:00100000:1.0:1746066814.968653:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459712 00002000:00100000:1.0:1746066814.968686:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1806336->1810431) req@ffff8800a59c6300 x1830882985459712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.968693:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6300 with x1830882985459712 ext(1806336->1810431) 00002000:00010000:1.0:1746066814.968697:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6300 00000100:00100000:1.0:1746066814.968718:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7693 00000100:00100000:1.0:1746066814.968733:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985459712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066814.968762:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.968779:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459840 00000100:00100000:3.0:1746066814.968784:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459840 00000100:00100000:3.0:1746066814.968820:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20490 00000100:00100000:3.0:1746066814.968826:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985459840:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066814.968834:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985459712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 112us (248us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746066814.968835:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066814.968839:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7693 00002000:00100000:1.0:1746066814.968843:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1806336->1810431) req@ffff8800a59c6300 x1830882985459712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746066814.968847:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7824 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066814.968847:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6300 with x1830882985459712 ext(1806336->1810431) 00002000:00010000:1.0:1746066814.968849:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6300 00010000:00010000:3.0:1746066814.968864:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.968866:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066814.968872:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.968907:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.968917:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016800, rc 0) 00000100:00100000:3.0:1746066814.968937:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985459840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066814.968943:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20490 00000100:00100000:0.0:1746066814.969715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066814.969757:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985459968 00000100:00100000:3.0:1746066814.969761:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985459968 00000100:00100000:3.0:1746066814.969787:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20491 00000100:00100000:3.0:1746066814.969792:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985459968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066814.969800:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066814.969809:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb175e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d782b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066814.969839:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126528:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066814.969919:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066814.974100:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126528:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066814.974132:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb175e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d782b expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.974145:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb175e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d782b expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066814.974171:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017000, rc 0) 00000100:00100000:3.0:1746066814.974208:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985459968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4414us (4493us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066814.974215:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20491 00000100:00100000:0.0:1746066814.978764:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066814.982488:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460224 00000100:00100000:1.0:1746066814.982500:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460224 00002000:00100000:1.0:1746066814.982546:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c5500 x1830882985460224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/0 e 0 to 0 dl 1746066825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.982561:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5500 with x1830882985460224 ext(0->1048575) 00002000:00010000:1.0:1746066814.982567:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5500 00000100:00100000:1.0:1746066814.982603:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7694 00000100:00100000:1.0:1746066814.982611:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985460224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066814.990462:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985460224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7843us (11696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066814.990473:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7694 00002000:00100000:1.0:1746066814.990483:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a59c5500 x1830882985460224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:220/0 lens 488/440 e 0 to 0 dl 1746066825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066814.990492:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5500 with x1830882985460224 ext(0->1048575) 00002000:00010000:1.0:1746066814.990497:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5500 00000100:00100000:0.0:1746066815.000287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.000534:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460352 00000100:00100000:3.0:1746066815.000546:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460352 00000100:00100000:3.0:1746066815.000611:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20492 00000100:00100000:3.0:1746066815.000620:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3411:x1830882985460352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.000638:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.000654:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7832 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.000685:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.000693:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.000694:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.000698:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.000728:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.000741:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 34 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.000753:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.001683:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.003381:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985126656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.003415:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.003428:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017600, rc 0) 00000100:00100000:3.0:1746066815.003715:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3411:x1830882985460352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3096us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.003722:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20492 00000100:00100000:0.0:1746066815.003845:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.003906:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460480 00000100:00100000:0.0:1746066815.003912:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460480 00002000:00100000:0.0:1746066815.003957:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1810431) req@ffff8800a59c6d80 x1830882985460480/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.003971:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6d80 with x1830882985460480 ext(1482752->1810431) 00010000:00010000:0.0:1746066815.003977:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 35 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.003988:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 35 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:0.0:1746066815.003994:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a59c6d80 00000100:00100000:0.0:1746066815.004007:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2204 00000100:00100000:0.0:1746066815.004012:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985460480:12345-192.168.204.16@tcp:4:multiop.0 00000100:00080000:2.0:1746066815.004769:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066815.011256:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985460480:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7231us (7398us total) trans 21474842754 rc 0/0 00000100:00100000:2.0:1746066815.011269:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2204 00002000:00100000:2.0:1746066815.011281:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1482752->1810431) req@ffff8800a59c6d80 x1830882985460480/t21474842754(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.011290:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6d80 with x1830882985460480 ext(1482752->1810431) 00010000:00010000:2.0:1746066815.011301:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.011317:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:2.0:1746066815.011536:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a59c6d80 00000100:00100000:0.0:1746066815.014219:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.014299:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460608 00000100:00100000:2.0:1746066815.014307:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460608 00010000:00010000:2.0:1746066815.014335:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.014365:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9381 00000100:00100000:2.0:1746066815.014371:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985460608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.014380:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.014394:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.014415:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.014437:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb1750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1810431) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d781d expref: 37 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.014462:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.014464:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.014469:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.014476:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.014502:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.014513:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985126784:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066815.014595:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.018295:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985126784:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066815.018314:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.018348:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985460608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3976us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.018357:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9381 00000100:00100000:0.0:1746066815.041947:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.042386:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.042440:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460992 00000100:00100000:3.0:1746066815.042448:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460992 00000100:00100000:2.0:1746066815.042449:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985460864 00000100:00100000:2.0:1746066815.042453:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985460864 00002000:00100000:2.0:1746066815.042481:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c7b80 x1830882985460864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.042490:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7b80 with x1830882985460864 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.042494:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c7b80 00000100:00100000:3.0:1746066815.042498:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20493 00000100:00100000:3.0:1746066815.042505:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3407:x1830882985460992:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746066815.042513:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7695 00010000:00010000:3.0:1746066815.042516:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066815.042517:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985460864:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066815.042530:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7839 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.042551:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042558:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042569:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042574:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.042576:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.042579:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.042601:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042612:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.042622:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985126912:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.042695:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042702:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 7 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.042710:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.042730:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.042737:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 36 pid: 9590 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.042744:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127168:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.042756:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.045346:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985126912:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.045357:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127040:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.045364:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.045389:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.045413:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017400, rc 0) 00000100:00100000:3.0:1746066815.045523:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3407:x1830882985460992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3016us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.045532:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20493 00000100:00100000:0.0:1746066815.048758:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.048844:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.048908:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985461120 00000100:00100000:3.0:1746066815.048920:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985461120 00000100:00100000:2.0:1746066815.048940:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985461248 00000100:00100000:2.0:1746066815.048945:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985461248 00010000:00010000:3.0:1746066815.048953:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00000100:00080000:0.0:1746066815.048969:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746066815.048970:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.048993:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9382 00000100:00100000:3.0:1746066815.049001:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985461120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066815.049001:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9383 00000100:00100000:2.0:1746066815.049007:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985461248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.049013:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.049015:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.049029:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.049029:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.049038:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.049054:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.049074:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe2a00/0xf1867c21abfb13de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75e6 expref: 37 pid: 9590 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.049079:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb157b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d76fe expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.049094:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.049095:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.049135:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985461120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.049135:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985461248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.049141:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9382 00000100:00100000:2.0:1746066815.049144:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9383 00000100:00100000:0.0:1746066815.053267:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.053325:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985461376 00000100:00100000:3.0:1746066815.053333:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985461376 00010000:00010000:3.0:1746066815.053361:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.053414:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9384 00000100:00100000:3.0:1746066815.053421:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985461376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.053432:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.053481:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.053492:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.053512:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb1432 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7625 expref: 17 pid: 9592 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.053615:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985460864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11096us (11674us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066815.053625:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7695 00002000:00100000:2.0:1746066815.053633:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c7b80 x1830882985460864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.053642:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7b80 with x1830882985460864 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.053646:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c7b80 00010000:00010000:3.0:1746066815.053691:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.053694:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.053700:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.053708:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.053737:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.053748:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985127296:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.053794:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.056988:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985127296:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.057008:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.057280:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985461376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3857us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.057291:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9384 00000100:00100000:0.0:1746066815.059724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.059840:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985461632 00000100:00100000:2.0:1746066815.059853:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985461632 00002000:00100000:2.0:1746066815.059926:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->2826239) req@ffff8800a5b0ca80 x1830882985461632/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.059934:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ca80 with x1830882985461632 ext(2822144->2826239) 00002000:00010000:2.0:1746066815.059938:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ca80 00000100:00100000:2.0:1746066815.059960:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7696 00000100:00100000:2.0:1746066815.059965:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985461632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.060087:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985461632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 121us (370us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.060094:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7696 00002000:00100000:2.0:1746066815.060099:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->2826239) req@ffff8800a5b0ca80 x1830882985461632/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.060105:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ca80 with x1830882985461632 ext(2822144->2826239) 00002000:00010000:2.0:1746066815.060107:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ca80 00000100:00100000:0.0:1746066815.061828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.061880:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.061967:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985461888 00000100:00100000:2.0:1746066815.061973:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985461888 00000100:00100000:1.0:1746066815.061984:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462144 00000100:00100000:1.0:1746066815.061988:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462144 00002000:00100000:2.0:1746066815.061995:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b0ce00 x1830882985461888/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 504/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.062003:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ce00 with x1830882985461888 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.062006:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ce00 00002000:00100000:1.0:1746066815.062006:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800a5b0e300 x1830882985462144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.062014:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0e300 with x1830882985462144 ext(2097152->3145727) 00002000:00010000:1.0:1746066815.062017:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0e300 00000100:00100000:2.0:1746066815.062033:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7697 00000100:00100000:1.0:1746066815.062038:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7698 00000100:00100000:2.0:1746066815.062039:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985461888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.062050:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985462144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.073392:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985462144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11341us (11505us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.073416:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7698 00002000:00100000:1.0:1746066815.073432:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800a5b0e300 x1830882985462144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.073442:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0e300 with x1830882985462144 ext(2097152->3145727) 00002000:00010000:1.0:1746066815.073447:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0e300 00000100:00100000:2.0:1746066815.076302:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985461888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14256us (14472us total) trans 0 rc 2093056/2093056 00000100:00100000:2.0:1746066815.076310:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7697 00002000:00100000:2.0:1746066815.076318:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b0ce00 x1830882985461888/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 504/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.076326:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ce00 with x1830882985461888 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.076330:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ce00 00000100:00100000:0.0:1746066815.080822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.080966:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462272 00000100:00100000:3.0:1746066815.080974:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462272 00000100:00100000:3.0:1746066815.081020:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20494 00000100:00100000:3.0:1746066815.081026:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3407:x1830882985462272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.081038:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.081051:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7840 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.081079:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.081087:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.081092:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.081094:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.081097:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.081122:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.081133:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 35 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.081145:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985127424:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.081238:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.081246:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 25 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.081255:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985127552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.081274:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.082508:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985127424:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.082517:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985127552:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.082536:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.082547:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017000, rc 0) 00000100:00100000:3.0:1746066815.082572:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3407:x1830882985462272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1546us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.082578:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20494 00000100:00100000:0.0:1746066815.085350:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.085495:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462400 00000100:00100000:3.0:1746066815.085503:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462400 00010000:00010000:3.0:1746066815.085532:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.085546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.085676:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.085705:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462528 00000100:00100000:2.0:1746066815.085709:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462528 00000100:00100000:2.0:1746066815.085734:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20495 00000100:00100000:2.0:1746066815.085740:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3411:x1830882985462528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.085751:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.085762:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7847 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.085779:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.085781:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.085786:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.085797:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.085805:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46fc00, rc 0) 00000100:00100000:2.0:1746066815.085836:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3411:x1830882985462528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.085840:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20495 00000100:00100000:3.0:1746066815.086249:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462656 00000100:00100000:3.0:1746066815.086253:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462656 00010000:00010000:3.0:1746066815.086264:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746066815.086268:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9385 00000100:00100000:0.0:1746066815.086274:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985462400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066815.086279:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9386 00010000:00010000:0.0:1746066815.086281:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.086283:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985462656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.086289:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.086298:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.086306:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746066815.086314:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746066815.086329:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfb173b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d780f expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746066815.086343:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.086414:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.086425:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb1734 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7801 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.086444:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985462400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 170us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.086450:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9385 00010000:00010000:3.0:1746066815.086504:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.086506:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.086510:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.086517:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.086538:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.086548:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985127680:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.086651:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.089751:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985127680:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.089769:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.089838:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985462656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3552us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.089848:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9386 00000100:00100000:0.0:1746066815.090041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.090076:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985462912 00000100:00100000:2.0:1746066815.090082:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985462912 00002000:00100000:2.0:1746066815.090112:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a5b0d500 x1830882985462912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.090120:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0d500 with x1830882985462912 ext(3145728->4194303) 00002000:00010000:2.0:1746066815.090124:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0d500 00000100:00100000:2.0:1746066815.090145:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7699 00000100:00100000:2.0:1746066815.090150:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985462912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.091990:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.092053:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463168 00000100:00100000:1.0:1746066815.092059:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463168 00002000:00100000:1.0:1746066815.092085:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2547712->2551807) req@ffff8800a5b0f480 x1830882985463168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.092094:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0f480 with x1830882985463168 ext(2547712->2551807) 00002000:00010000:1.0:1746066815.092099:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0f480 00000100:00100000:1.0:1746066815.092126:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7700 00000100:00100000:1.0:1746066815.092132:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985463168:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.092226:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985463168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 94us (240us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066815.092232:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7700 00002000:00100000:1.0:1746066815.092237:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2547712->2551807) req@ffff8800a5b0f480 x1830882985463168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.092243:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0f480 with x1830882985463168 ext(2547712->2551807) 00002000:00010000:1.0:1746066815.092245:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0f480 00000100:00100000:0.0:1746066815.095078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.095110:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.095147:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985462912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4994us (5103us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066815.095156:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.095158:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7699 00002000:00100000:2.0:1746066815.095169:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a5b0d500 x1830882985462912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066815.095174:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463424 00002000:00100000:2.0:1746066815.095176:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0d500 with x1830882985462912 ext(3145728->4194303) 00000100:00100000:3.0:1746066815.095181:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463424 00002000:00010000:2.0:1746066815.095181:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0d500 00000100:00100000:2.0:1746066815.095201:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463296 00000100:00100000:2.0:1746066815.095204:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463296 00000100:00100000:1.0:1746066815.095239:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463552 00000100:00100000:1.0:1746066815.095242:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463552 00000100:00100000:3.0:1746066815.095366:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20496 00000100:00100000:2.0:1746066815.095372:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20497 00000100:00100000:3.0:1746066815.095373:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463424:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066815.095378:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.095386:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.095386:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.095412:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfb1781 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7855 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.095436:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20498 00000100:00100000:1.0:1746066815.095442:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066815.095448:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066815.095454:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127808:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066815.095454:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb178f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d785c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.095472:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb178f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d785c expref: 37 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.095481:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb178f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d785c expref: 37 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.095494:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1d600, rc 0) 00000100:00100000:3.0:1746066815.095497:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.095511:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (356us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066815.095516:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20498 00010000:00010000:2.0:1746066815.095577:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d784e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.095589:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.095591:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.095598:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.095613:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.095622:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6600, rc 0) 00000100:00100000:2.0:1746066815.095654:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 275us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.095658:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20497 00002000:00010000:3.0:1746066815.098331:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066814 -> 1746066816 00002000:00010000:3.0:1746066815.098335:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066812 -> 1746066816 00002000:00010000:3.0:1746066815.098337:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066814 -> 1746066816 00000100:00100000:3.0:1746066815.098351:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127808:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066815.098372:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfb1781 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7855 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.098381:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfb1781 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7855 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.098418:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017e00, rc 0) 00000100:00100000:3.0:1746066815.098470:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985463424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3097us (3398us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.098475:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20496 00000100:00100000:0.0:1746066815.098876:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.098916:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463680 00000100:00100000:3.0:1746066815.098921:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463680 00000100:00100000:3.0:1746066815.098953:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20499 00000100:00100000:3.0:1746066815.098959:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985463680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.098970:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.098981:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfb1796 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7863 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.098999:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfb1796 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7863 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.099006:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfb1796 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7863 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.099013:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016c00, rc 0) 00000100:00100000:3.0:1746066815.099039:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985463680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (163us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.099044:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20499 00000100:00100000:2.0:1746066815.104318:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.104422:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985463936 00000100:00100000:3.0:1746066815.104431:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985463936 00002000:00100000:3.0:1746066815.104475:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012e420000 x1830882985463936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.104484:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882985463936 ext(4194304->4861951) 00002000:00010000:3.0:1746066815.104488:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:3.0:1746066815.104507:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7701 00000100:00100000:3.0:1746066815.104513:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985463936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.104963:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.105911:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464192 00000100:00100000:0.0:1746066815.106331:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464192 00002000:00100000:0.0:1746066815.106358:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5b0c000 x1830882985464192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.106366:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0c000 with x1830882985464192 ext(1048576->2097151) 00002000:00010000:0.0:1746066815.106370:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0c000 00000100:00100000:0.0:1746066815.106411:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7702 00000100:00100000:0.0:1746066815.106418:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985464192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.113691:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985463936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9168us (9371us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066815.113702:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7701 00002000:00100000:3.0:1746066815.113713:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012e420000 x1830882985463936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.113722:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882985463936 ext(4194304->4861951) 00002000:00010000:3.0:1746066815.113727:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:2.0:1746066815.114801:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985464192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8380us (9836us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066815.114808:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7702 00002000:00100000:2.0:1746066815.114814:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5b0c000 x1830882985464192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.114820:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0c000 with x1830882985464192 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.114824:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0c000 00000100:00100000:0.0:1746066815.118005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.118093:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464320 00000100:00100000:3.0:1746066815.118102:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464320 00000100:00100000:3.0:1746066815.118154:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20500 00000100:00100000:3.0:1746066815.118162:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985464320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.118182:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.118200:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb179d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d786a expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.118231:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb179d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d786a expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.118241:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfb179d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d786a expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.118902:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017c00, rc 0) 00000100:00100000:3.0:1746066815.118955:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985464320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 793us (959us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.118962:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20500 00000100:00100000:0.0:1746066815.122115:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.122186:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464448 00000100:00100000:2.0:1746066815.122196:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464448 00000100:00100000:2.0:1746066815.122239:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20501 00000100:00100000:2.0:1746066815.122248:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985464448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.122262:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.122279:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7871 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.122327:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127936:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.122429:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.122805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.122856:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464576 00000100:00100000:0.0:1746066815.122972:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464576 00000100:00100000:0.0:1746066815.123009:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20502 00000100:00100000:0.0:1746066815.123015:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985464576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066815.123028:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.123041:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07200/0xf1867c21abfb17ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7878 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.123065:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07200/0xf1867c21abfb17ab lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7878 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.123074:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07200/0xf1867c21abfb17ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7878 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.123093:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07200, rc 0) 00000100:00100000:0.0:1746066815.123136:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985464576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 120us (331us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066815.123142:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20502 00000100:00100000:2.0:1746066815.123633:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985127936:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066815.123652:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7871 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.123663:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7871 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.123676:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3800, rc 0) 00000100:00100000:2.0:1746066815.123700:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985464448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1454us (1594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066815.123706:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20501 00000100:00100000:0.0:1746066815.123926:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.124117:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464704 00000100:00100000:2.0:1746066815.124122:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464704 00000100:00100000:2.0:1746066815.124148:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20503 00000100:00100000:2.0:1746066815.124153:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985464704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.124162:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.124170:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfb17b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d787f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.124186:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfb17b2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d787f expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.124193:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfb17b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d787f expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.124199:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2000, rc 0) 00000100:00100000:2.0:1746066815.124232:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985464704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (308us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066815.124236:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20503 00000100:00100000:0.0:1746066815.134714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.134795:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464832 00000100:00100000:2.0:1746066815.134804:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464832 00000100:00100000:2.0:1746066815.134848:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20504 00000100:00100000:2.0:1746066815.134856:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3415:x1830882985464832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.134876:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.134917:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7886 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.134948:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.134955:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.134957:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.134960:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.134989:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.135002:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 15 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.135014:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128064:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.135094:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.138280:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128064:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.138308:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.138325:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3800, rc 0) 00000100:00100000:2.0:1746066815.138375:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3415:x1830882985464832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3518us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.138383:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20504 00000100:00100000:0.0:1746066815.139110:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.139164:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985464960 00000100:00100000:2.0:1746066815.139171:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985464960 00002000:00100000:2.0:1746066815.139207:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->3145727) req@ffff88011f760e00 x1830882985464960/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.139215:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760e00 with x1830882985464960 ext(2822144->3145727) 00010000:00010000:2.0:1746066815.139222:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 16 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.139233:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 16 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:2.0:1746066815.139240:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f760e00 00000100:00100000:2.0:1746066815.139262:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2205 00000100:00100000:2.0:1746066815.139268:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985464960:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066815.145697:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985464960:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6416us (6575us total) trans 17179875396 rc 0/0 00000100:00100000:2.0:1746066815.145709:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2205 00002000:00100000:2.0:1746066815.145722:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->3145727) req@ffff88011f760e00 x1830882985464960/t17179875396(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.145731:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760e00 with x1830882985464960 ext(2822144->3145727) 00010000:00010000:2.0:1746066815.145741:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.145758:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:2.0:1746066815.145764:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f760e00 00000100:00100000:0.0:1746066815.151344:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.152065:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985465088 00000100:00100000:3.0:1746066815.152074:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985465088 00010000:00010000:3.0:1746066815.152113:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.152665:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9387 00000100:00100000:3.0:1746066815.152673:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985465088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.152689:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.152708:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.152721:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.152744:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfb176c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7839 expref: 18 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.153084:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.153087:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.153095:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.153109:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.153144:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.153157:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985128192:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.153774:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.158611:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985128192:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.158635:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.158684:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985465088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6010us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.158695:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9387 00000100:00100000:0.0:1746066815.159426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.160282:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985465344 00000100:00100000:3.0:1746066815.160291:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985465344 00002000:00100000:3.0:1746066815.160331:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88011f763100 x1830882985465344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.160341:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763100 with x1830882985465344 ext(2097152->3145727) 00002000:00010000:3.0:1746066815.160346:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f763100 00000100:00100000:3.0:1746066815.160363:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7703 00000100:00100000:3.0:1746066815.160370:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985465344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.171935:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985465344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11553us (12498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066815.171950:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7703 00002000:00100000:3.0:1746066815.171962:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88011f763100 x1830882985465344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.171971:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763100 with x1830882985465344 ext(2097152->3145727) 00002000:00010000:3.0:1746066815.171977:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f763100 00000100:00100000:0.0:1746066815.174833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.174927:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985465472 00000100:00100000:2.0:1746066815.174936:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985465472 00000100:00100000:2.0:1746066815.174982:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20505 00000100:00100000:2.0:1746066815.174989:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3415:x1830882985465472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.175009:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.175026:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d788d expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.175055:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.175062:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.175063:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.175066:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.175095:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.175105:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 24 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.175116:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985128320:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.175377:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.176844:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985128320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.176871:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.176920:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3600, rc 0) 00000100:00100000:2.0:1746066815.176956:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3415:x1830882985465472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1966us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.176963:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20505 00000100:00100000:0.0:1746066815.177681:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.177761:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985465600 00000100:00100000:3.0:1746066815.177769:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985465600 00002000:00100000:3.0:1746066815.177806:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2551807) req@ffff88011f763b80 x1830882985465600/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.177814:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763b80 with x1830882985465600 ext(2097152->2551807) 00010000:00010000:3.0:1746066815.177822:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.177834:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 25 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746066815.177840:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f763b80 00000100:00100000:3.0:1746066815.177857:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2206 00000100:00100000:3.0:1746066815.177864:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985465600:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066815.182539:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985465600:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4666us (4857us total) trans 21474842755 rc 0/0 00000100:00100000:3.0:1746066815.182550:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2206 00002000:00100000:3.0:1746066815.182563:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2551807) req@ffff88011f763b80 x1830882985465600/t21474842755(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.182577:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763b80 with x1830882985465600 ext(2097152->2551807) 00010000:00010000:3.0:1746066815.182586:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.182598:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746066815.182604:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f763b80 00000100:00100000:0.0:1746066815.184434:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.184574:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985465728 00000100:00100000:3.0:1746066815.184582:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985465728 00010000:00010000:3.0:1746066815.184606:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.184640:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9388 00000100:00100000:3.0:1746066815.184646:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985465728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.184656:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066815.184666:0:8395:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066815 -> 1746066816 00010000:00010000:3.0:1746066815.184671:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.184679:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.184697:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017000/0xf1867c21abfb1773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7840 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.184724:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.184725:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.184737:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.184745:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.184768:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.184777:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985128448:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.184976:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.187542:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985128448:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.187562:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.187597:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985465728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2950us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.187607:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9388 00000100:00100000:0.0:1746066815.194922:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.194959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.195226:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985466112 00000100:00100000:1.0:1746066815.195236:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985466112 00002000:00100000:1.0:1746066815.195278:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f763480 x1830882985466112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.195287:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763480 with x1830882985466112 ext(2097152->4194303) 00002000:00010000:1.0:1746066815.195292:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f763480 00000100:00100000:1.0:1746066815.195315:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985466240 00000100:00100000:1.0:1746066815.195318:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985466240 00002000:00100000:1.0:1746066815.195333:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f761500 x1830882985466240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.195340:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761500 with x1830882985466240 ext(3145728->4194303) 00002000:00010000:1.0:1746066815.195343:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f761500 00000100:00100000:0.0:1746066815.195343:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7704 00000100:00100000:0.0:1746066815.195353:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985466112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.195364:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7705 00000100:00100000:1.0:1746066815.195370:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985466240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.206028:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985466240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10650us (11059us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.206039:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7705 00002000:00100000:1.0:1746066815.206049:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f761500 x1830882985466240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.206058:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f761500 with x1830882985466240 ext(3145728->4194303) 00002000:00010000:1.0:1746066815.206063:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f761500 00000100:00100000:0.0:1746066815.211818:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985466112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16454us (16888us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066815.211831:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7704 00002000:00100000:0.0:1746066815.211845:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f763480 x1830882985466112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.211854:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f763480 with x1830882985466112 ext(2097152->4194303) 00002000:00010000:0.0:1746066815.211860:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f763480 00000100:00100000:0.0:1746066815.227973:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.228196:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985466496 00000100:00100000:2.0:1746066815.228207:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985466496 00002000:00100000:2.0:1746066815.228255:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011f762680 x1830882985466496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.228266:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762680 with x1830882985466496 ext(4194304->4861951) 00002000:00010000:2.0:1746066815.228271:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f762680 00000100:00100000:2.0:1746066815.228304:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7706 00000100:00100000:2.0:1746066815.228312:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985466496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.237067:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.237155:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985466624 00000100:00100000:3.0:1746066815.237166:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985466624 00000100:00100000:3.0:1746066815.237217:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17261 00000100:00100000:3.0:1746066815.237223:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3420:x1830882985466624:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.237241:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.237253:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb17c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7894 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.237301:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237310:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237318:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237326:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237329:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237332:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237382:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237389:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.237408:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.237414:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.237440:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.237455:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 21 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.237465:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985128576:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.237738:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985466496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9424us (9772us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066815.237748:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7706 00002000:00100000:2.0:1746066815.237759:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011f762680 x1830882985466496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.237768:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762680 with x1830882985466496 ext(4194304->4861951) 00010000:00010000:3.0:1746066815.237771:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066815.237772:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f762680 00010000:00010000:3.0:1746066815.237778:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 39 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.237785:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985128704:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.237803:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.244094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.244138:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.244161:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985128576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.244174:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985128704:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.244200:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066815.244302:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985466880 00000100:00100000:1.0:1746066815.244311:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985466880 00000100:00100000:2.0:1746066815.244438:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467008 00000100:00100000:2.0:1746066815.244442:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467008 00010000:00010000:2.0:1746066815.244725:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 40 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.244745:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6502 00000100:00100000:1.0:1746066815.244753:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:30848:x1830882985466880:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066815.244756:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9389 00000100:00100000:2.0:1746066815.244762:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985467008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.244773:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.244780:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 40 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.244790:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 40 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.244811:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb16d2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77b4 expref: 40 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.244839:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.244843:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.244852:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.244857:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.244862:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746066815.244916:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066815.244934:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985467008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.244941:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9389 00000100:00100000:1.0:1746066815.245287:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:30848:x1830882985466880:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 535us (1203us total) trans 8589937736 rc 0/0 00000100:00100000:1.0:1746066815.245294:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6502 00000100:00100000:0.0:1746066815.248082:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.248171:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467136 00000100:00100000:3.0:1746066815.248183:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467136 00000100:00100000:3.0:1746066815.248320:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20506 00000100:00100000:3.0:1746066815.248329:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3419:x1830882985467136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.248346:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.248361:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d789b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.248405:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.248412:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.248418:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.248420:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.248423:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1351680->1937407] (req 1351680->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.248450:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.248990:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 16 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.249003:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.249117:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.249126:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.249134:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128960:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.249152:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.251599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.251924:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467264 00000100:00100000:2.0:1746066815.251935:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467264 00010000:00010000:2.0:1746066815.251975:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.252012:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9390 00000100:00100000:2.0:1746066815.252020:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985467264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.252032:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.252038:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.252049:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.252071:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1711 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77e5 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.252207:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.252212:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.252222:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.252229:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.252255:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.252288:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252302:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066815.252305:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985467264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 286us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.252312:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9390 00000004:00200000:3.0:1746066815.252352:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066815.252356:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066815.252373:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252384:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252408:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252414:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252419:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252424:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252429:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbeae00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066815.252432:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252438:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252449:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066815.252452:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066815.252456:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252461:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb17ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252477:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252482:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252487:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252491:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbea800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066815.252493:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252498:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252503:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ea100) 00010000:00010000:3.0:1746066815.252504:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066815.252507:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252510:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea800/0xf1867c21abfb17d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.252542:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb17c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.252554:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.252560:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.252562:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066815.252564:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb600, rc 0) 00000100:00100000:3.0:1746066815.252615:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+11:3420:x1830882985466624:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 15391us (15558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.252623:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17261 00000100:00100000:3.0:1746066815.253499:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128832:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.253513:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985128960:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.253534:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1351680->1937407] (req 1351680->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.253540:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066815.253548:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea200, rc 0) 00000100:00100000:3.0:1746066815.253579:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3419:x1830882985467136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5251us (5507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.253586:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20506 00000100:00100000:2.0:1746066815.253593:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467392 00000100:00100000:2.0:1746066815.253599:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467392 00010000:00010000:2.0:1746066815.253619:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 17 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.253637:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9391 00000100:00100000:2.0:1746066815.253642:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985467392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.253650:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.253668:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 17 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.253676:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 17 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.253689:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b000/0xf1867c21abfb16fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77d7 expref: 17 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.253701:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.253726:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985467392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.253732:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9391 00000100:00100000:0.0:1746066815.254033:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.254160:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467520 00000100:00100000:3.0:1746066815.254165:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467520 00010000:00010000:3.0:1746066815.254180:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.254200:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9392 00000100:00100000:3.0:1746066815.254204:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985467520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.254212:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.254224:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.254230:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.254331:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfb16ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d77c9 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.254339:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.254340:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.254344:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.254352:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.254368:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.254376:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129088:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.254450:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.255179:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.255203:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.255375:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467776 00000100:00100000:3.0:1746066815.255379:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467776 00000100:00100000:0.0:1746066815.255404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.255414:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985468032 00000100:00100000:3.0:1746066815.255416:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985468032 00000100:00100000:0.0:1746066815.255426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.255434:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467648 00000100:00100000:3.0:1746066815.255436:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467648 00000100:00100000:0.0:1746066815.255441:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985467904 00000100:00100000:0.0:1746066815.255444:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985467904 00000100:00100000:3.0:1746066815.255463:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20507 00000100:00100000:0.0:1746066815.255467:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20508 00000100:00100000:3.0:1746066815.255468:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985467776:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746066815.255471:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985468032:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.255480:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.255480:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.255490:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78a9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.255490:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78b7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.255502:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.255502:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.255504:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.255504:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.255508:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.255508:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.255517:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.255517:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.255525:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb400, rc 0) 00010000:00010000:0.0:1746066815.255525:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07e00, rc 0) 00000100:00100000:2.0:1746066815.255584:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20509 00000100:00100000:2.0:1746066815.255591:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985467648:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066815.255596:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066815.255620:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20510 00000100:00100000:1.0:1746066815.255636:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985467904:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066815.255642:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.255648:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb17f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78b0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.255672:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985129216:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066815.256111:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985467776:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 640us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.256116:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20507 00010000:00010000:2.0:1746066815.256183:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78a2 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.256197:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.256198:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.256203:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.256211:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.256218:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8a00, rc 0) 00000100:00100000:2.0:1746066815.256234:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985467648:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 644us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.256238:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20509 00000100:00100000:0.0:1746066815.256294:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985468032:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.256300:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20508 00000100:00100000:0.0:1746066815.256330:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.256364:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.256510:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129088:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066815.256514:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985468160 00000100:00100000:2.0:1746066815.256518:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985468160 00010000:00010000:3.0:1746066815.256521:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.256536:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20511 00000100:00100000:2.0:1746066815.256541:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985468160:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746066815.256542:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985467520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2337us (2509us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066815.256547:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066815.256550:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9392 00010000:00010000:2.0:1746066815.256553:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78be expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.256562:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.256564:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.256568:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.256576:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.256614:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8000, rc 0) 00000100:00100000:2.0:1746066815.256632:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985468160:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.256637:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20511 00000100:00100000:0.0:1746066815.257754:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.257819:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985468416 00000100:00100000:2.0:1746066815.257822:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985468416 00002000:00100000:2.0:1746066815.257847:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1355775) req@ffff880095869180 x1830882985468416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.257857:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869180 with x1830882985468416 ext(1351680->1355775) 00002000:00010000:2.0:1746066815.257861:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869180 00000100:00100000:2.0:1746066815.257906:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7707 00000100:00100000:2.0:1746066815.257912:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985468416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066815.258046:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985468416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 133us (294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.258051:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7707 00002000:00100000:2.0:1746066815.258056:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1355775) req@ffff880095869180 x1830882985468416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.258063:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869180 with x1830882985468416 ext(1351680->1355775) 00002000:00010000:2.0:1746066815.258065:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869180 00002000:00010000:1.0:1746066815.258525:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066815 -> 1746066816 00002000:00010000:1.0:1746066815.258529:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066815 -> 1746066816 00002000:00010000:1.0:1746066815.258531:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066815 -> 1746066816 00000100:00100000:1.0:1746066815.258541:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985129216:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066815.258563:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb17f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b0 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.258574:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfb17f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b0 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.258750:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70e00, rc 0) 00000100:00100000:1.0:1746066815.258832:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985467904:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3205us (3404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066815.258838:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20510 00000100:00100000:0.0:1746066815.260529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.260592:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985468672 00000100:00100000:3.0:1746066815.260599:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985468672 00000100:00100000:3.0:1746066815.260645:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17262 00000100:00100000:3.0:1746066815.260652:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+11:3420:x1830882985468672:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.260665:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.260680:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb180d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78c5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.260762:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.260775:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.260782:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.260806:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.260816:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 12 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.260825:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985129344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.261068:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.262562:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985129344:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.262578:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066815.262622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.262991:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985468800 00000100:00100000:3.0:1746066815.262996:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985468800 00010000:00010000:3.0:1746066815.263017:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 13 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.263048:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9393 00000100:00100000:3.0:1746066815.263054:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985468800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.263063:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.263068:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 13 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.263077:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 13 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.263093:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb17dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7894 expref: 13 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.263104:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.263108:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.263114:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.263120:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.263134:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.263379:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985468800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 324us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.263386:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9393 00000100:00100000:1.0:1746066815.263410:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066815.263413:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.263422:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066815.263450:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985469056 00000100:00100000:2.0:1746066815.263455:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985469056 00002000:00100000:2.0:1746066815.263482:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1933312->1937407) req@ffff8800958a5180 x1830882985469056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.263491:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882985469056 ext(1933312->1937407) 00002000:00010000:2.0:1746066815.263495:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:2.0:1746066815.263509:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7708 00000100:00100000:2.0:1746066815.263515:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985469056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066815.263797:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985469056:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 281us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.263803:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7708 00002000:00100000:2.0:1746066815.263807:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1933312->1937407) req@ffff8800958a5180 x1830882985469056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000004:00200000:3.0:1746066815.263808:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00002000:00100000:2.0:1746066815.263815:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882985469056 ext(1933312->1937407) 00002000:00010000:2.0:1746066815.263818:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5180 00010000:00010000:3.0:1746066815.263921:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb180d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78c5 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.263934:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78c5 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.263940:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.263942:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066815.263945:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba000, rc 0) 00000100:00100000:3.0:1746066815.263961:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+12:3420:x1830882985468672:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3310us (3435us total) trans 8589937737 rc 0/0 00000100:00100000:3.0:1746066815.263967:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17262 00000100:00100000:0.0:1746066815.265744:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.265803:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985469312 00000100:00100000:3.0:1746066815.265809:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985469312 00000100:00100000:3.0:1746066815.265848:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17263 00000100:00100000:3.0:1746066815.265854:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+12:3420:x1830882985469312:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.265867:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.265869:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066815.265902:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb1814 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78c5 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.265914:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.265918:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.265926:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb1822 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78cc expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.265989:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.265999:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266005:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266013:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266018:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266022:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266027:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7dbac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066815.266030:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266035:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266041:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.266043:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066815.266045:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266050:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1829 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.266072:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb1822 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78cc expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.266078:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb1822 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78cc expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.266084:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb800, rc 0) 00000100:00100000:3.0:1746066815.266126:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+11:3420:x1830882985469312:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 271us (385us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.266131:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17263 00000100:00100000:2.0:1746066815.267119:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.267177:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985469568 00000100:00100000:1.0:1746066815.267181:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985469568 00000100:00100000:1.0:1746066815.267214:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6503 00000100:00100000:1.0:1746066815.267220:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3419:x1830882985469568:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066815.267411:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3419:x1830882985469568:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 190us (293us total) trans 8589937738 rc 0/0 00000100:00100000:1.0:1746066815.267420:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6503 00000100:00100000:0.0:1746066815.270521:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.270630:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985469824 00000100:00100000:1.0:1746066815.270638:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985469824 00000100:00100000:1.0:1746066815.270683:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6504 00000100:00100000:1.0:1746066815.270690:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+11:3420:x1830882985469824:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066815.270848:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3420:x1830882985469824:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 157us (332us total) trans 8589937739 rc 0/0 00000100:00100000:1.0:1746066815.270853:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6504 00000100:00100000:0.0:1746066815.312338:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.312470:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470080 00000100:00100000:3.0:1746066815.312478:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470080 00000100:00100000:3.0:1746066815.312533:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17264 00000100:00100000:3.0:1746066815.312541:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3425:x1830882985470080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.312560:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.312574:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfb1830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78d3 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.312669:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.312681:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.312690:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066815.312699:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066815.312773:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfb1830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.312803:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.312810:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.312813:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066815.312816:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb200, rc 0) 00000100:00100000:3.0:1746066815.312858:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3425:x1830882985470080:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 318us (528us total) trans 8589937740 rc 0/0 00000100:00100000:3.0:1746066815.312864:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17264 00000100:00100000:0.0:1746066815.366626:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.366668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.366709:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.366733:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470208 00000100:00100000:0.0:1746066815.366741:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470208 00000100:00100000:2.0:1746066815.366748:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470336 00000100:00100000:2.0:1746066815.366757:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470336 00000100:00100000:0.0:1746066815.366798:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470464 00000100:00100000:0.0:1746066815.366800:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470464 00000100:00100000:2.0:1746066815.367062:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20512 00000100:00100000:2.0:1746066815.367071:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985470208:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066815.367076:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20513 00000100:00100000:0.0:1746066815.367085:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985470336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.367091:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.367102:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.367109:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8200/0xf1867c21abfb1845 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78da expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.367115:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78e1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.367137:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.367139:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.367148:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.367161:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.367170:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06e00, rc 0) 00000100:00100000:0.0:1746066815.367208:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985470336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 125us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.367215:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20513 00000100:00100000:0.0:1746066815.367230:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20514 00000100:00100000:0.0:1746066815.367235:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985470464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066815.367240:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.367248:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78e8 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.367263:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.367264:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.367268:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066815.367925:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985129472:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.367998:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0780 going to sleep for 11 seconds 00010000:00010000:0.0:1746066815.368176:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.368184:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06c00, rc 0) 00000100:00100000:0.0:1746066815.368206:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985470464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 971us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.368211:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20514 00000100:00100000:0.0:1746066815.372971:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.373300:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985129472:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066815.373330:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8200/0xf1867c21abfb1845 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78da expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.373342:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8200/0xf1867c21abfb1845 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78da expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.373382:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8200, rc 0) 00000100:00100000:2.0:1746066815.373423:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470720 00000100:00100000:2.0:1746066815.373434:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470720 00002000:00100000:2.0:1746066815.373483:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800967ab800 x1830882985470720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 504/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.373492:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab800 with x1830882985470720 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.373500:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967ab800 00000100:00100000:2.0:1746066815.373539:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7709 00000100:00100000:2.0:1746066815.373548:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985470720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.373551:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985470208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6480us (6932us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.373559:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20512 00000100:00100000:2.0:1746066815.378720:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985470720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5160us (5745us total) trans 0 rc 462848/462848 00000100:00100000:2.0:1746066815.378734:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7709 00002000:00100000:2.0:1746066815.378746:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800967ab800 x1830882985470720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 504/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 462848/462848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.378755:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab800 with x1830882985470720 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.378761:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967ab800 00000100:00100000:0.0:1746066815.386122:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.386209:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470848 00000100:00100000:3.0:1746066815.386221:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470848 00000100:00100000:3.0:1746066815.386273:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20515 00000100:00100000:3.0:1746066815.386280:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3430:x1830882985470848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.386296:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.386312:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78ef expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.386338:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.386345:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.386346:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.386349:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.386373:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.386384:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 36 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.386428:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985129600:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.386520:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.391151:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985129600:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.391184:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.392112:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb600, rc 0) 00000100:00100000:3.0:1746066815.392166:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3430:x1830882985470848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5883us (6056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.392176:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20515 00000100:00100000:0.0:1746066815.392655:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.392710:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985470976 00000100:00100000:2.0:1746066815.392718:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985470976 00002000:00100000:2.0:1746066815.392754:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1937407) req@ffff8800967aa680 x1830882985470976/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.392763:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882985470976 ext(1351680->1937407) 00010000:00010000:2.0:1746066815.392770:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 37 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.392781:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 37 pid: 11630 timeout: 883 lvb_type: 0 00002000:00010000:2.0:1746066815.392787:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:2.0:1746066815.392804:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2207 00000100:00100000:2.0:1746066815.392810:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985470976:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066815.397827:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.398613:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985471232 00000100:00100000:3.0:1746066815.398623:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985471232 00000100:00100000:3.0:1746066815.398680:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17265 00000100:00100000:3.0:1746066815.398688:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:3433:x1830882985471232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.398710:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.398726:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb1861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78f6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.398814:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.398830:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.398840:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066815.398850:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066815.398938:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb1861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.398968:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 42 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.400318:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.400321:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066815.400325:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbac00, rc 0) 00000100:00100000:3.0:1746066815.400387:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:3433:x1830882985471232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1698us (2570us total) trans 8589937741 rc 0/0 00000100:00100000:3.0:1746066815.400402:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17265 00000100:00100000:0.0:1746066815.400498:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985470976:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7687us (7843us total) trans 17179875397 rc 0/0 00000100:00100000:0.0:1746066815.400506:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2207 00002000:00100000:0.0:1746066815.400515:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1351680->1937407) req@ffff8800967aa680 x1830882985470976/t17179875397(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.400524:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882985470976 ext(1351680->1937407) 00010000:00010000:0.0:1746066815.400534:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.400551:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00002000:00010000:0.0:1746066815.400557:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066815.402639:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.402711:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985471360 00000100:00100000:3.0:1746066815.402722:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985471360 00000100:00100000:3.0:1746066815.402756:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20516 00000100:00100000:3.0:1746066815.402762:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3425:x1830882985471360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.402777:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.402793:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d78fd expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.402816:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.402821:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.402826:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066815.402829:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1400832->2080767] (req 1400832->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.402863:0:9591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.402874:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1400832->2080767] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.402904:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbae00, rc 0) 00000100:00100000:3.0:1746066815.402952:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3425:x1830882985471360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 188us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.402958:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20516 00000100:00100000:0.0:1746066815.404748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.404828:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985471488 00000100:00100000:3.0:1746066815.404836:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985471488 00010000:00010000:3.0:1746066815.404864:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.404921:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9394 00000100:00100000:3.0:1746066815.404928:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985471488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.404938:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.404958:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.404969:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.404988:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfb17e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1351680->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d789b expref: 39 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.405014:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.405016:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.405022:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.405031:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.405057:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.405068:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 18 pid: 9591 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.405079:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129856:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.407153:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.409490:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129856:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.409515:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.409573:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985471488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4644us (4829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.409584:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9394 00000100:00100000:0.0:1746066815.409952:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.410028:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985471744 00000100:00100000:1.0:1746066815.410035:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985471744 00002000:00100000:1.0:1746066815.410075:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800967ab100 x1830882985471744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.410086:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882985471744 ext(1048576->2097151) 00010000:00010000:1.0:1746066815.410095:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.410109:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00002000:00010000:1.0:1746066815.410115:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967ab100 00000100:00100000:1.0:1746066815.410140:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2208 00000100:00100000:1.0:1746066815.410147:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985471744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066815.418584:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985471744:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8428us (8624us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.418599:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2208 00002000:00100000:1.0:1746066815.418611:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800967ab100 x1830882985471744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.418619:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882985471744 ext(1048576->2097151) 00010000:00010000:1.0:1746066815.418628:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.418640:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00002000:00010000:1.0:1746066815.418646:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967ab100 00000100:00100000:0.0:1746066815.424353:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.424437:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985471872 00000100:00100000:3.0:1746066815.424446:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985471872 00010000:00010000:3.0:1746066815.424483:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.424525:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9395 00000100:00100000:3.0:1746066815.424532:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985471872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.424547:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.424566:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.424578:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.424601:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb185a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78ef expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.424628:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.424631:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.424637:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.424645:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.424675:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.424687:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129984:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.424765:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.427683:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985129984:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.427708:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.427761:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985471872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3228us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.427772:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9395 00000100:00100000:0.0:1746066815.427875:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.427934:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985472128 00000100:00100000:2.0:1746066815.427940:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985472128 00002000:00100000:2.0:1746066815.427977:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->1404927) req@ffff8800967aad80 x1830882985472128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.427987:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882985472128 ext(1400832->1404927) 00002000:00010000:2.0:1746066815.427992:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:2.0:1746066815.428338:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7710 00000100:00100000:2.0:1746066815.428345:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985472128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.428471:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985472128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 126us (597us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.428478:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7710 00002000:00100000:2.0:1746066815.428482:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->1404927) req@ffff8800967aad80 x1830882985472128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.428489:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882985472128 ext(1400832->1404927) 00002000:00010000:2.0:1746066815.428492:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:0.0:1746066815.429712:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.429747:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.430259:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985472384 00000100:00100000:2.0:1746066815.430264:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985472384 00002000:00100000:2.0:1746066815.430288:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800967a8e00 x1830882985472384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.430295:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882985472384 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.430300:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8e00 00000100:00100000:3.0:1746066815.430446:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985472640 00000100:00100000:3.0:1746066815.430450:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985472640 00002000:00100000:3.0:1746066815.430471:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800a03d5c00 x1830882985472640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.430478:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882985472640 ext(2097152->3145727) 00002000:00010000:3.0:1746066815.430481:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:2.0:1746066815.430836:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7711 00000100:00100000:2.0:1746066815.430843:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985472384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.431074:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7712 00000100:00100000:0.0:1746066815.431081:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985472640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.438568:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.439133:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985472896 00000100:00100000:1.0:1746066815.439143:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985472896 00002000:00100000:1.0:1746066815.439186:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2076672->2080767) req@ffff8800a03d6a00 x1830882985472896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.439196:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882985472896 ext(2076672->2080767) 00002000:00010000:1.0:1746066815.439202:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6a00 00000100:00100000:1.0:1746066815.439270:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7713 00000100:00100000:1.0:1746066815.439277:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985472896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.441590:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985472896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2303us (3021us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066815.441602:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7713 00002000:00100000:1.0:1746066815.441615:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2076672->2080767) req@ffff8800a03d6a00 x1830882985472896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.441631:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882985472896 ext(2076672->2080767) 00002000:00010000:1.0:1746066815.441638:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6a00 00000100:00100000:2.0:1746066815.447337:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985472640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16250us (17581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066815.447348:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7712 00002000:00100000:2.0:1746066815.447358:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800a03d5c00 x1830882985472640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.447368:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882985472640 ext(2097152->3145727) 00002000:00010000:2.0:1746066815.447373:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:3.0:1746066815.450988:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985472384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20132us (21264us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066815.451001:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7711 00002000:00100000:3.0:1746066815.451012:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800967a8e00 x1830882985472384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.451023:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882985472384 ext(2097152->4194303) 00002000:00010000:3.0:1746066815.451029:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8e00 00000100:00100000:0.0:1746066815.460965:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.461438:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473152 00000100:00100000:3.0:1746066815.461447:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473152 00002000:00100000:3.0:1746066815.461524:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a03d5500 x1830882985473152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.461534:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882985473152 ext(4194304->4861951) 00002000:00010000:3.0:1746066815.461540:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:3.0:1746066815.461570:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7714 00000100:00100000:3.0:1746066815.461578:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985473152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.467214:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985473152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5626us (6248us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066815.467225:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7714 00002000:00100000:3.0:1746066815.467237:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a03d5500 x1830882985473152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.467247:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882985473152 ext(4194304->4861951) 00002000:00010000:3.0:1746066815.467254:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:0.0:1746066815.474964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.475059:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473280 00000100:00100000:2.0:1746066815.475071:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473280 00000100:00100000:2.0:1746066815.475141:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20517 00000100:00100000:2.0:1746066815.475149:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:3433:x1830882985473280:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066815.475164:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.475178:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7904 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.475204:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.475211:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.475218:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.475224:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.475225:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.475228:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [208896->888831] (req 208896->888831) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.475254:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.475265:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 17 pid: 3528 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.475275:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.475380:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.475399:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 8 pid: 12255 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.475407:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.475434:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.475442:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.475449:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130368:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.475464:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.477546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.477612:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473408 00000100:00100000:3.0:1746066815.477621:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473408 00010000:00010000:3.0:1746066815.477651:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 9 pid: 12255 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.477692:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9396 00000100:00100000:3.0:1746066815.477698:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985473408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.477708:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.477724:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 9 pid: 12255 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.477733:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 9 pid: 12255 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.477751:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.477789:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.477800:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985473408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (260us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066815.477801:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfb17ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a2 expref: 9 pid: 12255 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.477807:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9396 00000100:00100000:2.0:1746066815.477816:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.477824:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.477842:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [208896->888831] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.477848:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9000, rc 0) 00000100:00100000:2.0:1746066815.477863:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3433:x1830882985473280:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2717us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.477868:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20517 00000100:00100000:0.0:1746066815.478641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.479136:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473536 00000100:00100000:2.0:1746066815.479143:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473536 00010000:00010000:2.0:1746066815.479170:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 18 pid: 3528 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.479203:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9397 00000100:00100000:2.0:1746066815.479210:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985473536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.479220:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.479236:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 18 pid: 3528 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.479247:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 18 pid: 3528 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.479266:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfb1757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7824 expref: 18 pid: 3528 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.479279:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.479326:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985473536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 116us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.479332:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9397 00000100:00100000:0.0:1746066815.479744:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.479793:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473664 00000100:00100000:3.0:1746066815.479801:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473664 00010000:00010000:3.0:1746066815.479826:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.479867:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9398 00000100:00100000:3.0:1746066815.479873:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985473664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.479921:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.479935:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.479945:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.481914:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfb1749 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7816 expref: 39 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.481987:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.481989:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.481997:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.482004:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.482155:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.482168:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985130496:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.482264:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.485470:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985130496:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.485484:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.485528:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985473664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5654us (5783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.485537:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9398 00000100:00100000:0.0:1746066815.485879:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.485967:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985473920 00000100:00100000:3.0:1746066815.485973:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985473920 00002000:00100000:3.0:1746066815.486304:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->212991) req@ffff8800a03d7100 x1830882985473920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.486322:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882985473920 ext(208896->212991) 00002000:00010000:3.0:1746066815.486326:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:3.0:1746066815.486443:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7715 00000100:00100000:3.0:1746066815.486451:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985473920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066815.486584:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985473920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 133us (705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066815.486594:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7715 00002000:00100000:3.0:1746066815.486600:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->212991) req@ffff8800a03d7100 x1830882985473920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.486607:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882985473920 ext(208896->212991) 00002000:00010000:3.0:1746066815.486611:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:0.0:1746066815.496266:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.496348:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474176 00000100:00100000:3.0:1746066815.496358:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474176 00002000:00100000:3.0:1746066815.496409:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (884736->888831) req@ffff8800a03d4000 x1830882985474176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.496421:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882985474176 ext(884736->888831) 00002000:00010000:3.0:1746066815.496425:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4000 00000100:00100000:3.0:1746066815.496453:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7716 00000100:00100000:3.0:1746066815.496460:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985474176:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066815.496617:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985474176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (361us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066815.496624:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7716 00002000:00100000:3.0:1746066815.496714:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (884736->888831) req@ffff8800a03d4000 x1830882985474176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.496722:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882985474176 ext(884736->888831) 00002000:00010000:3.0:1746066815.496725:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4000 00000100:00100000:0.0:1746066815.515235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.515414:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474304 00000100:00100000:2.0:1746066815.515427:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474304 00000100:00100000:2.0:1746066815.515487:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20518 00000100:00100000:2.0:1746066815.515495:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985474304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.515514:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.515532:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1884 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d790b expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.515587:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130624:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.515691:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.517444:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130624:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066815.517480:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1884 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d790b expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.517493:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1884 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d790b expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.517558:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d400, rc 0) 00000100:00100000:2.0:1746066815.517597:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985474304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2101us (2367us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066815.517605:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20518 00000100:00100000:0.0:1746066815.524859:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.526106:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474560 00000100:00100000:3.0:1746066815.526119:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474560 00002000:00100000:3.0:1746066815.526169:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a03d4700 x1830882985474560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 504/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.526180:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882985474560 ext(0->1048575) 00002000:00010000:3.0:1746066815.526186:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:3.0:1746066815.526878:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7717 00000100:00100000:3.0:1746066815.526904:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985474560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.532300:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985474560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5386us (7438us total) trans 0 rc 368640/368640 00000100:00100000:3.0:1746066815.532312:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7717 00002000:00100000:3.0:1746066815.532324:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a03d4700 x1830882985474560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 504/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.532333:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882985474560 ext(0->1048575) 00002000:00010000:3.0:1746066815.532339:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:2.0:1746066815.543040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.543293:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474688 00000100:00100000:0.0:1746066815.543303:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474688 00000100:00100000:0.0:1746066815.543354:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20519 00000100:00100000:0.0:1746066815.543361:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:3441:x1830882985474688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066815.543379:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.543408:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7912 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.543439:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.543446:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066815.543448:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066815.543451:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.543480:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.543490:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 16 pid: 9591 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746066815.543502:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130752:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066815.543580:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.546618:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.546723:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985130752:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.546748:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.546765:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07a00, rc 0) 00000100:00100000:2.0:1746066815.546811:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3441:x1830882985474688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3450us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.546818:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20519 00000100:00100000:3.0:1746066815.546915:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474816 00000100:00100000:3.0:1746066815.546921:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474816 00002000:00100000:3.0:1746066815.546954:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->2080767) req@ffff8800a03d7800 x1830882985474816/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.546961:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882985474816 ext(1400832->2080767) 00010000:00010000:3.0:1746066815.546968:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 17 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.546978:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 17 pid: 9591 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746066815.546983:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d7800 00000100:00100000:3.0:1746066815.546995:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2209 00000100:00100000:3.0:1746066815.547000:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985474816:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066815.555148:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985474816:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8140us (8529us total) trans 17179875398 rc 0/0 00000100:00100000:0.0:1746066815.555282:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2209 00002000:00100000:0.0:1746066815.555293:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->2080767) req@ffff8800a03d7800 x1830882985474816/t17179875398(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.555303:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882985474816 ext(1400832->2080767) 00010000:00010000:0.0:1746066815.555312:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.555326:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00002000:00010000:0.0:1746066815.555333:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d7800 00000100:00100000:0.0:1746066815.557561:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.557729:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985474944 00000100:00100000:3.0:1746066815.557740:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985474944 00010000:00010000:3.0:1746066815.557778:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.557820:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9399 00000100:00100000:3.0:1746066815.557827:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985474944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.557839:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.557856:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.557867:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.557911:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78fd expref: 19 pid: 9591 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.557939:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.557941:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.557947:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.557955:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.557988:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.557998:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985130880:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.558081:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.559298:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985130880:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.559314:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.559351:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985474944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1523us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.559359:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9399 00000100:00100000:0.0:1746066815.562146:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.562227:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985475200 00000100:00100000:2.0:1746066815.562235:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985475200 00002000:00100000:2.0:1746066815.562535:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a03d7b80 x1830882985475200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.562545:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7b80 with x1830882985475200 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.562551:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7b80 00000100:00100000:2.0:1746066815.562604:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7718 00000100:00100000:2.0:1746066815.562612:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985475200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.570293:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985475200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7668us (8147us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066815.570307:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7718 00002000:00100000:2.0:1746066815.570319:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a03d7b80 x1830882985475200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.570328:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7b80 with x1830882985475200 ext(1048576->2097151) 00002000:00010000:2.0:1746066815.570335:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7b80 00000100:00100000:0.0:1746066815.584473:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.584563:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985475328 00000100:00100000:3.0:1746066815.584573:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985475328 00000100:00100000:3.0:1746066815.584623:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17266 00000100:00100000:3.0:1746066815.584631:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+12:3442:x1830882985475328:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.584657:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.584676:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfb1892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7919 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.584748:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.584761:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.584773:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.584785:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.584790:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.584795:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.585609:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.585622:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.585629:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.585635:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.585664:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.585680:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 41 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.585691:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.586360:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.586368:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 23 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.586376:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.586570:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.590132:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.590174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.590242:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985475584 00000100:00100000:1.0:1746066815.590250:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985475584 00000100:00100000:1.0:1746066815.590286:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985475840 00000100:00100000:1.0:1746066815.590288:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985475840 00000100:00100000:1.0:1746066815.590302:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6505 00000100:00100000:1.0:1746066815.590308:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:19150:x1830882985475584:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066815.590526:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:19150:x1830882985475584:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 216us (404us total) trans 8589937742 rc 0/0 00000100:00100000:1.0:1746066815.590532:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6505 00000100:00100000:1.0:1746066815.590546:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6506 00000100:00100000:1.0:1746066815.590551:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:313:x1830882985475840:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066815.590605:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:313:x1830882985475840:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 53us (429us total) trans 8589937743 rc 0/0 00000100:00100000:1.0:1746066815.590610:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6506 00000100:00100000:3.0:1746066815.591372:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.591383:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.591418:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066815.593102:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.593156:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.593440:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985475968 00000100:00100000:1.0:1746066815.593449:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985475968 00010000:00010000:1.0:1746066815.593489:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 43 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.594026:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476096 00000100:00100000:1.0:1746066815.594030:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476096 00010000:00010000:1.0:1746066815.594044:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 25 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.594220:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9400 00000100:00100000:3.0:1746066815.594231:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985475968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.594245:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.594252:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 43 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594263:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 43 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594286:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1868 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78f6 expref: 43 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594305:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.594310:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594318:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594323:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594328:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.594391:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985475968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.594398:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9400 00000100:00100000:3.0:1746066815.594415:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9401 00000100:00100000:3.0:1746066815.594421:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985476096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.594427:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.594431:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 25 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594438:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 25 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594449:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb1837 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78d3 expref: 25 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.594461:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.594464:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594471:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594477:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594496:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.594511:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985476096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.594517:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9401 00010000:00010000:3.0:1746066815.594536:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.594542:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066815.595269:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066815.595275:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066815.595294:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595305:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595317:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595323:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595330:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595336:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595341:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7dbae00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066815.595345:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595351:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595359:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066815.595361:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066815.595365:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595370:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595380:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595395:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595400:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595405:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7dbb800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066815.595407:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595416:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595423:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce2a100) 00010000:00010000:3.0:1746066815.595424:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066815.595426:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595431:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb800/0xf1867c21abfb18a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.595465:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfb1892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.595476:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.595483:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.595484:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066815.595487:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea200, rc 0) 00000100:00100000:3.0:1746066815.595527:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+13:3442:x1830882985475328:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 10897us (11066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.595535:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17266 00000100:00100000:0.0:1746066815.599205:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.599263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.599332:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476224 00000100:00100000:2.0:1746066815.599340:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476224 00000100:00100000:2.0:1746066815.599382:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476352 00000100:00100000:2.0:1746066815.599393:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476352 00000100:00100000:2.0:1746066815.599407:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20520 00000100:00100000:2.0:1746066815.599413:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985476224:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066815.599430:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.599448:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb18ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7920 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.599499:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985131264:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.599568:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.599960:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20521 00000100:00100000:1.0:1746066815.599971:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985476352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066815.599979:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.599987:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7927 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.599999:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.600002:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.600010:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.600025:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.600039:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2600, rc 0) 00000100:00100000:1.0:1746066815.600067:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985476352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 100us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.600073:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20521 00002000:00010000:2.0:1746066815.601950:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066815 -> 1746066816 00002000:00010000:2.0:1746066815.601958:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066815 -> 1746066816 00002000:00010000:2.0:1746066815.601960:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066815 -> 1746066816 00000100:00100000:2.0:1746066815.601980:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985131264:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066815.602010:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb18ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7920 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.602023:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb18ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7920 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.602050:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7dc00, rc 0) 00000100:00100000:2.0:1746066815.602094:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985476224:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2680us (2898us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066815.602101:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20520 00000100:00100000:0.0:1746066815.607404:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.607559:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476608 00000100:00100000:3.0:1746066815.607566:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476608 00000100:00100000:3.0:1746066815.607607:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17267 00000100:00100000:3.0:1746066815.607614:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+13:3442:x1830882985476608:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.607632:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.607648:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb18bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d792e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.607725:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.607736:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.607742:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.607766:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.607774:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 14 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.607783:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131392:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.607853:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.610191:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985131392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.610211:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066815.611319:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.611399:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476736 00000100:00100000:3.0:1746066815.611407:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476736 00010000:00010000:3.0:1746066815.611433:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 15 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.611460:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9402 00000100:00100000:3.0:1746066815.611466:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985476736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.611477:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.611483:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 15 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.611491:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 15 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.611510:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb18a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7919 expref: 15 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.611544:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.611548:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.611556:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.611561:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.611580:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.611619:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985476736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.611625:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9402 00010000:00010000:3.0:1746066815.611645:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.611650:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066815.611664:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066815.611763:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfb18bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d792e expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.611774:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d792e expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.611780:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.611782:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066815.611784:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb600, rc 0) 00000100:00100000:3.0:1746066815.611807:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:3442:x1830882985476608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4194us (4420us total) trans 8589937744 rc 0/0 00000100:00100000:3.0:1746066815.611813:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17267 00000100:00100000:0.0:1746066815.614089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.614200:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985476992 00000100:00100000:3.0:1746066815.614209:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985476992 00000100:00100000:3.0:1746066815.614261:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17268 00000100:00100000:3.0:1746066815.614268:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:3442:x1830882985476992:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.614294:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.614297:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066815.614321:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb600/0xf1867c21abfb18c3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d792e expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.614344:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.614347:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.614359:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb18d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7935 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.614465:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.614482:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.614490:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066815.614591:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066815.614677:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb18d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.614688:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.614704:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.614706:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066815.614998:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbebc00, rc 0) 00000100:00100000:3.0:1746066815.615052:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+15:3442:x1830882985476992:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 783us (971us total) trans 8589937745 rc 0/0 00000100:00100000:3.0:1746066815.615058:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17268 00000100:00100000:0.0:1746066815.616334:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.616425:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477120 00000100:00100000:3.0:1746066815.616430:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477120 00000100:00100000:3.0:1746066815.616460:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17269 00000100:00100000:3.0:1746066815.616467:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+15:3442:x1830882985477120:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.616485:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.616498:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb18e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d793c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.616541:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb18e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d793c expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.616552:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb18e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d793c expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.616569:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.616572:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066815.616574:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb400, rc 0) 00000100:00100000:3.0:1746066815.616732:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+16:3442:x1830882985477120:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 254us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.616742:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17269 00000100:00100000:0.0:1746066815.618250:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.618280:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.618303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.618317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.618343:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477248 00000100:00100000:3.0:1746066815.618351:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477248 00000100:00100000:0.0:1746066815.618352:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.618404:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477376 00000100:00100000:3.0:1746066815.618406:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477376 00000100:00100000:3.0:1746066815.618420:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477504 00000100:00100000:3.0:1746066815.618422:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477504 00000100:00100000:3.0:1746066815.618430:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477632 00000100:00100000:3.0:1746066815.618432:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477632 00000100:00100000:3.0:1746066815.618444:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20522 00000100:00100000:3.0:1746066815.618450:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985477248:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066815.618487:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.618487:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477760 00000100:00100000:1.0:1746066815.618492:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477760 00010000:00010000:3.0:1746066815.618503:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066815.618503:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20523 00010000:00010000:3.0:1746066815.618510:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746066815.618510:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985477376:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066815.618511:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.618514:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.618522:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20524 00010000:00010000:0.0:1746066815.618526:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.618528:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985477504:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066815.618535:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618540:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 9 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.618541:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618544:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.618547:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.618548:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.618549:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.618552:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 38 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.618552:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618562:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066815.618563:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985131520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.618565:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618568:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.618573:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066815.618573:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.618581:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.618586:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.618588:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.618591:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.618629:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20525 00010000:00010000:0.0:1746066815.618633:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 9 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066815.618635:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985477632:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746066815.618642:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20526 00010000:00010000:0.0:1746066815.618642:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 9 pid: 12233 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.618646:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131776:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.618650:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985477760:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066815.618652:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618658:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.618661:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.618663:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 26 pid: 12233 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.618666:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066815.618667:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131904:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.618669:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.618671:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.618672:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.618674:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066815.618674:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00010000:00010000:2.0:1746066815.618680:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.618687:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 17 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.618688:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.618694:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.618696:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 11 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.618699:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.618700:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.618702:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.618703:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985132032:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.618725:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.618732:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.618735:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 11 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.618740:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 38 pid: 20361 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.618747:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.618748:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985132288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.618767:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.618776:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066815.618790:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 17 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.618802:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 17 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.618809:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132416:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.618860:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.618873:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 38 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.618880:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.618915:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.618924:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.618931:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.618938:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0600 going to sleep for 11 seconds 00010000:00010000:1.0:1746066815.618961:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.618967:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 9 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.618973:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.618988:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.618994:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.619000:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.619011:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.619330:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.619364:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985477888 00000100:00100000:1.0:1746066815.619368:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985477888 00000100:00100000:1.0:1746066815.619394:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20527 00000100:00100000:1.0:1746066815.619400:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985477888:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066815.619415:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619425:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619430:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.619437:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.619443:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619452:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066815.619453:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066815.619455:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 7/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619468:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619475:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.619483:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.619528:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.619535:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 10 pid: 9591 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.619542:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.619563:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.619570:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 26 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.619580:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.619598:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.619604:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.619610:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.619620:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.623167:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.623300:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985131520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.623327:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.623438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.623465:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985132032:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.623466:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.623473:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985132288:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.623481:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066815.623486:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.623499:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478400 00000100:00100000:1.0:1746066815.623499:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478144 00000100:00100000:3.0:1746066815.623504:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478400 00000100:00100000:1.0:1746066815.623504:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478144 00010000:00010000:3.0:1746066815.623534:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 11 pid: 12233 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.623554:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478656 00000100:00100000:3.0:1746066815.623557:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478656 00000100:00100000:0.0:1746066815.623561:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9403 00010000:00010000:3.0:1746066815.623565:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 12 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.623569:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985478400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066815.623577:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9404 00010000:00010000:0.0:1746066815.623580:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.623581:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985478656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.623587:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.623595:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 12 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746066815.623595:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 11 pid: 12233 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.623604:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 12 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746066815.623604:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 11 pid: 12233 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.623622:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066815.623625:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.623652:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985478656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.623652:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985478400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.623658:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9404 00000100:00100000:0.0:1746066815.623661:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9403 00000100:00100000:3.0:1746066815.623693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066815.623703:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 27 pid: 12233 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.623723:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9405 00000100:00100000:1.0:1746066815.623728:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985478144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066815.623733:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478016 00010000:00010000:1.0:1746066815.623734:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.623735:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478016 00010000:00010000:1.0:1746066815.623740:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 27 pid: 12233 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.623746:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 27 pid: 12233 timeout: 883 lvb_type: 0 00002000:00100000:3.0:1746066815.623755:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->888831) req@ffff8800a5d7c700 x1830882985478016/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066815.623758:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7e00/0xf1867c21abfb1638 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7760 expref: 27 pid: 12233 timeout: 883 lvb_type: 0 00002000:00100000:3.0:1746066815.623763:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882985478016 ext(208896->888831) 00010000:00010000:3.0:1746066815.623768:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.623776:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.623780:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746066815.623782:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7c700 00000100:00100000:3.0:1746066815.623791:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2210 00000100:00100000:1.0:1746066815.623794:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985478144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.623796:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985478016:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066815.623798:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9405 00000100:00100000:1.0:1746066815.623839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.623848:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478272 00000100:00100000:1.0:1746066815.623850:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478272 00010000:00010000:1.0:1746066815.623857:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 12 pid: 13363 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.623876:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9406 00000100:00100000:1.0:1746066815.623880:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985478272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.623902:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.623910:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 12 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.623917:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 12 pid: 13363 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.623918:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.623927:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478528 00000100:00100000:3.0:1746066815.623930:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478528 00010000:00010000:1.0:1746066815.623933:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2600/0xf1867c21abfb18b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7927 expref: 12 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.623939:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.623947:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.623951:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9407 00000100:00100000:3.0:1746066815.623955:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985478528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066815.623959:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985478272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (120us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066815.623960:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066815.623964:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9406 00010000:00010000:3.0:1746066815.623966:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.623974:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.623984:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.623986:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.623990:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.623998:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.624011:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.624013:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.624022:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985478528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.624028:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9407 00000100:00100000:1.0:1746066815.624037:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.624069:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985132928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.624085:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.624109:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.624132:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb17ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78b7 expref: 10 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.624140:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.624147:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.624153:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985132544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.624165:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.624181:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133184:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.624345:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b000/0xf1867c21abfb163f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7767 expref: 36 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.624375:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.624403:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6c00/0xf1867c21abfb1670 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7783 expref: 10 pid: 12233 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.624412:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985131776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.624442:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624456:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624463:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624486:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624492:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624499:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624505:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009718cc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066815.624508:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624516:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624529:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.624534:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718cc00/0xf1867c21abfb18f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.624596:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985477376:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 6086us (6314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.624605:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20523 00000100:00100000:1.0:1746066815.629763:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.629775:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882985133440:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.630072:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.632677:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.634417:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.634516:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.634545:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479168 00000100:00100000:1.0:1746066815.634553:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479168 00010000:00010000:1.0:1746066815.634586:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 41 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.634624:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479424 00000100:00100000:1.0:1746066815.634626:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479424 00010000:00010000:1.0:1746066815.634638:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 9 pid: 9591 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746066815.634674:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9408 00000100:00100000:1.0:1746066815.634681:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985479168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.634694:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.634712:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9409 00010000:00010000:1.0:1746066815.634712:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 41 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.634723:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 41 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.634725:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985479424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.634743:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.634744:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfb17b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7886 expref: 41 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.634763:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 9 pid: 9591 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.634769:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.634776:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 9 pid: 9591 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.634794:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfb1806 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78be expref: 9 pid: 9591 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.634813:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.634814:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985479168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 132us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.634820:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9408 00000100:00100000:3.0:1746066815.634845:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985479424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.634851:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9409 00000100:00100000:2.0:1746066815.635751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.635777:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.635797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.635798:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479296 00000100:00100000:0.0:1746066815.635805:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479296 00000100:00100000:2.0:1746066815.635811:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.635823:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066815.635828:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 26 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.635837:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.635842:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479808 00000100:00100000:0.0:1746066815.635844:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479808 00010000:00010000:0.0:1746066815.635852:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 27 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.635859:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478784 00000100:00100000:0.0:1746066815.635860:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478784 00000100:00100000:2.0:1746066815.635862:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066815.635870:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 40 pid: 20361 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746066815.635878:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479040 00000100:00100000:0.0:1746066815.635879:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479040 00010000:00010000:0.0:1746066815.635903:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.635916:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479680 00000100:00100000:0.0:1746066815.635918:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479680 00010000:00010000:0.0:1746066815.635928:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 36 pid: 11630 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746066815.635935:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985478912 00000100:00100000:0.0:1746066815.635937:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985478912 00000100:00100000:3.0:1746066815.635943:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479552 00010000:00010000:0.0:1746066815.635944:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.635947:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479552 00000100:00100000:0.0:1746066815.635952:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985479936 00000100:00100000:0.0:1746066815.635955:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985479936 00010000:00010000:0.0:1746066815.635964:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 18 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.635965:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 28 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746066815.635974:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9410 00000100:00100000:0.0:1746066815.635979:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985479296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066815.635984:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9411 00010000:00010000:0.0:1746066815.635986:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.635990:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985479808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066815.635996:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 28 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.635998:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066815.636006:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 28 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.636225:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9412 00000100:00100000:1.0:1746066815.636231:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985478784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.636238:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.636250:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 40 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.636262:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 40 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.636274:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfb188b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7912 expref: 40 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.636283:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.636284:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.636288:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.636295:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.636321:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.636343:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985478784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.636348:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9412 00000100:00100000:1.0:1746066815.636360:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9413 00000100:00100000:1.0:1746066815.636364:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985479040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.636370:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.636377:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.636396:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.636406:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb17f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78a9 expref: 8 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746066815.636413:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.636423:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985479040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.636428:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9413 00000100:00100000:1.0:1746066815.636436:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9414 00000100:00100000:1.0:1746066815.636439:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985479680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.636444:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.636481:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636488:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636502:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636508:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636513:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636519:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ec800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066815.636521:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636527:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636536:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.636541:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb1902 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.636574:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985477632:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 17940us (18256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.636581:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20525 00010000:00010000:3.0:1746066815.636770:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 28 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636778:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 28 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636790:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfb1853 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e8 expref: 28 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636798:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.636813:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985479808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 824us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.636819:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9411 00010000:00010000:0.0:1746066815.636819:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb177a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7847 expref: 27 pid: 3528 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.636831:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9415 00010000:00010000:0.0:1746066815.636840:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.636846:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985478912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.636852:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.636859:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.636864:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985479296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 885us (2349us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066815.636866:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746066815.636869:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9410 00010000:00010000:3.0:1746066815.636878:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1788 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d784e expref: 37 pid: 11630 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636903:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066815.636919:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9416 00000100:00100000:3.0:1746066815.636921:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985478912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.636924:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985479936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066815.636927:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9415 00010000:00010000:0.0:1746066815.636929:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.636939:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9417 00010000:00010000:0.0:1746066815.636940:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 18 pid: 20361 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746066815.636944:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985479552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066815.636945:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 18 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636950:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066815.636954:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb184c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d78e1 expref: 18 pid: 20361 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746066815.636956:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 24 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.636960:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.636961:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.636964:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.636965:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 24 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746066815.636969:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.636974:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb1765 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7832 expref: 24 pid: 3528 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.636982:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.636984:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.636984:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.636986:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.636993:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066815.636994:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985479936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.636998:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9416 00010000:00010000:3.0:1746066815.637008:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.637023:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985479552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (1186us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066815.637267:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 35 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.637275:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 35 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.637286:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3600/0xf1867c21abfb17c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d788d expref: 35 pid: 11630 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.637294:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.637295:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.637297:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637303:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637329:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.637341:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985479680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 901us (1529us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066815.637396:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637403:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637414:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637421:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637427:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637432:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a7dbae00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066815.637434:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637440:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637448:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.637453:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbae00/0xf1867c21abfb1910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066815.637483:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985477888:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 18083us (18153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.637489:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20527 00000100:00100000:3.0:1746066815.637539:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9417 00010000:00010000:3.0:1746066815.637557:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637563:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637573:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637578:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637583:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637587:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a3c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066815.637589:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637594:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637605:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.637611:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb18fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.637634:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985477504:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 19106us (19330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.637639:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20524 00000100:00100000:1.0:1746066815.637686:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9414 00010000:00010000:1.0:1746066815.637705:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637711:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637723:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637728:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637737:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637742:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066815.637744:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637749:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637756:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.637761:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c000/0xf1867c21abfb1909 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.637785:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985477760:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 19137us (19433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.637789:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20526 00000100:00100000:1.0:1746066815.639159:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985478016:12345-192.168.204.16@tcp:4:cat.0 Request processed in 15360us (15463us total) trans 17179875399 rc 0/0 00000100:00100000:1.0:1746066815.639168:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2210 00002000:00100000:1.0:1746066815.639176:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (208896->888831) req@ffff8800a5d7c700 x1830882985478016/t17179875399(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.639185:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882985478016 ext(208896->888831) 00010000:00010000:1.0:1746066815.639191:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.639201:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00002000:00010000:1.0:1746066815.639206:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7c700 00000100:00100000:0.0:1746066815.643119:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.643169:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480064 00000100:00100000:1.0:1746066815.643179:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480064 00010000:00010000:1.0:1746066815.643205:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.643235:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9418 00000100:00100000:1.0:1746066815.643241:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985480064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.643252:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.643269:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.643278:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.643297:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9000/0xf1867c21abfb187d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->888831) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7904 expref: 39 pid: 20361 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.643310:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.643311:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.643314:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.643326:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.643411:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.643415:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643422:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643435:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643441:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643446:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643452:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f66a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066815.643455:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.643460:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985480064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 218us (356us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066815.643462:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.643466:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9418 00010000:00010000:3.0:1746066815.643471:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.643476:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb18ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.643513:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985477248:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 25063us (25267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.643520:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20522 00000100:00100000:0.0:1746066815.645259:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.645306:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480320 00000100:00100000:3.0:1746066815.645314:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480320 00000100:00100000:3.0:1746066815.645360:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17270 00000100:00100000:3.0:1746066815.645366:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+16:3442:x1830882985480320:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746066815.645410:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.645428:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb400/0xf1867c21abfb18e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d793c expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645440:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.645443:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.645462:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.645472:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645479:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645484:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645490:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645496:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.645519:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645529:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 41 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.645541:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.645619:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645628:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 23 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.645635:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133696:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.645659:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645667:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.645674:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.645801:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.645809:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 41 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.645815:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133952:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.645831:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.647811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.647853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.647904:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480448 00000100:00100000:1.0:1746066815.647910:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480448 00010000:00010000:1.0:1746066815.647936:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.647957:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480576 00000100:00100000:1.0:1746066815.647959:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480576 00000100:00100000:3.0:1746066815.647962:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9419 00010000:00010000:1.0:1746066815.647967:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 24 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.647971:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985480448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.647986:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066815.647988:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9420 00010000:00010000:3.0:1746066815.647991:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.647994:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985480576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.648000:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648000:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.648004:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 24 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648015:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 24 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.648066:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.648070:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.648078:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066815.648084:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:0.0:1746066815.648085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066815.648088:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.648093:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066815.648103:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480832 00000100:00100000:3.0:1746066815.648105:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985480448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.648105:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480832 00000100:00100000:3.0:1746066815.648110:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9419 00000100:00100000:1.0:1746066815.648111:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985480576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.648116:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9420 00010000:00010000:0.0:1746066815.648117:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 43 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.648129:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9421 00000100:00100000:1.0:1746066815.648134:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985480832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.648139:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.648142:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746066815.648145:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfb14e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7695 expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648150:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 42 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.648157:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133568:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.648158:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.648161:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.648165:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb147f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d764f expref: 23 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648166:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.648172:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.648178:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.648178:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985480832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (94us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066815.648183:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb1391 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d75bc expref: 41 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.648184:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9421 00000100:00100000:3.0:1746066815.648190:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985133952:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.648211:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066815.648256:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.648271:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480704 00000100:00100000:1.0:1746066815.648274:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480704 00010000:00010000:1.0:1746066815.648283:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.648301:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9422 00000100:00100000:1.0:1746066815.648305:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985480704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.648311:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.648314:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648321:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648331:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2e000/0xf1867c21abfb145c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7641 expref: 23 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.648339:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.648342:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.648348:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.648353:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.648380:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.648412:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985480704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.648418:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9422 00010000:00010000:3.0:1746066815.648508:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.648514:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:3.0:1746066815.648713:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1230, 88 off115832 00000004:00080000:3.0:1746066815.648719:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783859835691ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.648792:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1236, 88 off116272 00000004:00080000:3.0:1746066815.648798:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783859915077ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648857:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1237, 88 off116360 00000004:00080000:3.0:1746066815.648861:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783859977851ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648870:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1231, 88 off115920 00000004:00080000:3.0:1746066815.648873:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783859989747ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.648907:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1232, 88 off116008 00000004:00080000:3.0:1746066815.648911:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860028242ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.648920:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1238, 88 off116448 00000004:00080000:3.0:1746066815.648923:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860039661ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648930:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1239, 88 off116536 00000004:00080000:3.0:1746066815.648933:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860049317ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648939:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1240, 88 off116624 00000004:00080000:3.0:1746066815.648941:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860058222ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648948:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1233, 88 off116096 00000004:00080000:3.0:1746066815.648952:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860068866ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.648962:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1241, 88 off116712 00000004:00080000:3.0:1746066815.648965:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860081510ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.648971:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1234, 88 off116184 00000004:00080000:3.0:1746066815.648973:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860090121ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.649314:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1242, 88 off116800 00000004:00080000:3.0:1746066815.649319:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860435987ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.649334:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1235, 88 off116272 00000004:00080000:3.0:1746066815.649337:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860453380ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.649357:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1236, 88 off116360 00000004:00080000:3.0:1746066815.649360:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860476471ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.649368:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1237, 88 off116448 00000004:00080000:3.0:1746066815.649370:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860487238ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.649380:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1238, 88 off116536 00000004:00080000:3.0:1746066815.649383:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783860499416ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.649530:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1243, 88 off116888 00000004:00080000:3.0:1746066815.649535:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783860651498ns, next at 733263917711ns, rc = 0 00000001:00080000:2.0:1746066815.653119:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937746 is committed 00000004:00080000:2.0:1746066815.653132:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1217 committed 00000004:00080000:2.0:1746066815.653206:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1214 committed 00000004:00080000:2.0:1746066815.653223:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1213 committed 00000004:00080000:2.0:1746066815.653225:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1212 committed 00000004:00080000:2.0:1746066815.653227:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1211 committed 00000004:00080000:2.0:1746066815.653228:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1216 committed 00000004:00080000:2.0:1746066815.653230:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1210 committed 00000004:00080000:2.0:1746066815.653232:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1215 committed 00000004:00080000:2.0:1746066815.653233:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1209 committed 00000004:00080000:2.0:1746066815.653235:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1214 committed 00000004:00080000:2.0:1746066815.653238:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1213 committed 00000004:00080000:2.0:1746066815.653240:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1212 committed 00000004:00080000:2.0:1746066815.653242:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1208 committed 00000004:00080000:2.0:1746066815.653243:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1207 committed 00000004:00080000:2.0:1746066815.653245:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1211 committed 00000004:00080000:2.0:1746066815.653246:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1210 committed 00000004:00080000:2.0:1746066815.653248:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1206 committed 00000001:00080000:2.0:1746066815.653258:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937743 is committed 00000001:00080000:2.0:1746066815.653262:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937742 is committed 00000100:00100000:3.0:1746066815.653327:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985134080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.653359:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985134208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.653408:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.653414:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985134336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.653433:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.653448:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985134848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.653450:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985134464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.653454:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985134592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.653462:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066815.653528:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134080 00000100:00100000:2.0:1746066815.653535:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134080 00000100:00100000:2.0:1746066815.653579:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134336 00000100:00100000:2.0:1746066815.653582:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134336 00000100:00100000:2.0:1746066815.653591:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134848 00000100:00100000:2.0:1746066815.653592:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134848 00000100:00100000:2.0:1746066815.653604:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20528 00000100:00100000:3.0:1746066815.653610:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066815.653611:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3777:x1830882985134080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.653611:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985135360:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746066815.653611:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066815.653629:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985135104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.653629:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.653635:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134592 00000100:00100000:1.0:1746066815.653638:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134592 00000100:00100000:3.0:1746066815.653646:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.653647:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985134976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.653656:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985135616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653657:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134464 00000100:00100000:1.0:1746066815.653659:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134464 00000100:00100000:0.0:1746066815.653661:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.653670:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135104 00000100:00100000:1.0:1746066815.653672:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135104 00000100:00100000:3.0:1746066815.653674:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134976 00000100:00100000:3.0:1746066815.653677:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134976 00000100:00100000:0.0:1746066815.653678:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985135488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653685:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20529 00000100:00100000:1.0:1746066815.653690:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+82:3775:x1830882985134336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.653690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066815.653694:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20530 00000100:00100000:0.0:1746066815.653697:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985136000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066815.653699:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+83:3775:x1830882985134848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.653709:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066815.653711:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135488 00000100:00100000:0.0:1746066815.653730:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136000 00000100:00100000:0.0:1746066815.653732:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136000 00000100:00100000:3.0:1746066815.653741:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135488 00000100:00100000:0.0:1746066815.653744:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20531 00000100:00100000:0.0:1746066815.653748:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3777:x1830882985134592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.653755:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3777:x1830882985134080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (346us total) trans 17179875400 rc 0/0 00000100:00100000:3.0:1746066815.653758:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20532 00000100:00100000:1.0:1746066815.653759:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+84:3775:x1830882985134336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (324us total) trans 17179875401 rc 0/0 00000100:00100000:3.0:1746066815.653766:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3776:x1830882985134464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.653770:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20528 00000100:00100000:1.0:1746066815.653773:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20529 00000100:00100000:2.0:1746066815.653783:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20533 00000100:00100000:1.0:1746066815.653786:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20534 00000100:00100000:2.0:1746066815.653787:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3777:x1830882985135104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653790:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+83:3776:x1830882985134976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066815.653796:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066815.653799:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066815.653801:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066815.653803:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066815.653805:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066815.653822:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3777:x1830882985134592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (213us total) trans 17179875402 rc 0/0 00002000:00010000:1.0:1746066815.653825:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066815.653827:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00000100:00100000:3.0:1746066815.653828:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3776:x1830882985134464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (198us total) trans 17179875403 rc 0/0 00002000:00010000:1.0:1746066815.653829:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066815.653831:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066815.653832:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:3.0:1746066815.653834:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20532 00000100:00100000:0.0:1746066815.653837:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20531 00000100:00100000:3.0:1746066815.653844:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20535 00000100:00100000:0.0:1746066815.653847:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20536 00000100:00100000:3.0:1746066815.653848:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985136000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653849:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+83:3776:x1830882985134976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (187us total) trans 17179875404 rc 0/0 00000100:00100000:0.0:1746066815.653852:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985135488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653854:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20534 00000100:00100000:2.0:1746066815.653855:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3777:x1830882985135104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (207us total) trans 21474842756 rc 0/0 00000100:00100000:2.0:1746066815.653861:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20533 00000100:00100000:1.0:1746066815.653873:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066815.653878:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134208 00000100:00100000:2.0:1746066815.653881:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134208 00000100:00100000:1.0:1746066815.653900:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985134720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.653910:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20537 00000100:00100000:2.0:1746066815.653915:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+83:3774:x1830882985134208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.653917:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066815.653918:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3776:x1830882985136000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (208us total) trans 21474842757 rc 0/0 00000100:00100000:3.0:1746066815.653924:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20535 00000100:00100000:1.0:1746066815.653930:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.653930:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3776:x1830882985135488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (238us total) trans 21474842758 rc 0/0 00000100:00100000:3.0:1746066815.653932:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985134720 00000100:00100000:3.0:1746066815.653934:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985134720 00000100:00100000:0.0:1746066815.653935:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20536 00000100:00100000:1.0:1746066815.653942:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066815.653946:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135232 00000100:00100000:3.0:1746066815.653948:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135232 00000100:00100000:0.0:1746066815.653949:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20538 00000100:00100000:1.0:1746066815.653950:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.653953:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3774:x1830882985134720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.653956:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20539 00000100:00100000:3.0:1746066815.653959:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3774:x1830882985135232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.653965:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066815.653972:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3774:x1830882985134208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (98us total) trans 17179875405 rc 0/0 00000100:00100000:2.0:1746066815.653977:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20537 00000100:00100000:2.0:1746066815.653985:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135744 00000004:00080000:1.0:1746066815.653985:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5880/2, rc 0, transno 17179875405 00000100:00100000:2.0:1746066815.653987:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135744 00000100:00100000:1.0:1746066815.653993:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985134208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.653996:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20540 00000100:00100000:0.0:1746066815.653999:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3774:x1830882985134720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (81us total) trans 17179875406 rc 0/0 00000100:00100000:2.0:1746066815.654000:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882985135744:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.654000:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a6300/2, rc 0, transno 17179875406 00000100:00100000:1.0:1746066815.654003:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985134720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.654004:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20538 00000100:00100000:1.0:1746066815.654009:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066815.654013:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066815.654014:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882985135232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (69us total) trans 21474842759 rc 0/0 00000100:00080000:0.0:1746066815.654018:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066815.654019:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20539 00000100:00100000:1.0:1746066815.654028:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066815.654029:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7100/2, rc 0, transno 17179875403 00000100:00100000:0.0:1746066815.654038:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985134464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066815.654043:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8700/2, rc 0, transno 21474842759 00000004:00080000:0.0:1746066815.654045:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7800/2, rc 0, transno 17179875404 00000100:00100000:1.0:1746066815.654046:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.654047:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985134976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.654049:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882985135744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (83us total) trans 21474842760 rc 0/0 00000004:00080000:1.0:1746066815.654052:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9880/2, rc 0, transno 21474842760 00000004:00080000:0.0:1746066815.654053:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9500/2, rc 0, transno 21474842758 00000100:00100000:2.0:1746066815.654054:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20540 00000100:00100000:1.0:1746066815.654055:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.654055:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985135488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066815.654060:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8e00/2, rc 0, transno 21474842757 00000100:00100000:2.0:1746066815.654061:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135872 00000100:00100000:0.0:1746066815.654062:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985136000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066815.654063:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135872 00000100:00100000:1.0:1746066815.654067:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066815.654073:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135360 00000100:00100000:2.0:1746066815.654075:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135360 00000100:00100000:3.0:1746066815.654076:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3775:x1830882985134848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 377us (613us total) trans 17179875407 rc 0/0 00000100:00100000:3.0:1746066815.654081:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20530 00000004:00080000:1.0:1746066815.654085:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a6680/2, rc 0, transno 17179875401 00000100:00100000:0.0:1746066815.654087:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20541 00000100:00100000:1.0:1746066815.654088:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985134336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.654090:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20542 00000100:00100000:0.0:1746066815.654091:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3774:x1830882985135872:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.654093:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5500/2, rc 0, transno 17179875407 00000100:00100000:2.0:1746066815.654094:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3775:x1830882985135360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.654096:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985134848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.654104:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.654122:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985135616 00000004:00080000:3.0:1746066815.654123:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a4700/2, rc 0, transno 17179875400 00000100:00100000:1.0:1746066815.654124:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985135616 00000100:00100000:3.0:1746066815.654127:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985134080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.654134:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985136128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.654138:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20543 00000100:00100000:1.0:1746066815.654141:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3777:x1830882985135616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066815.654143:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+72:3775:x1830882985135360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (75us total) trans 21474842761 rc 0/0 00000100:00100000:2.0:1746066815.654148:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20542 00000100:00100000:3.0:1746066815.654154:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.654154:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3774:x1830882985135872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (124us total) trans 21474842762 rc 0/0 00000100:00100000:0.0:1746066815.654160:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20541 00000100:00100000:2.0:1746066815.654165:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136128 00000100:00100000:2.0:1746066815.654167:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136128 00000004:00080000:3.0:1746066815.654171:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7480/2, rc 0, transno 17179875402 00000100:00100000:3.0:1746066815.654175:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985134592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.654180:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20544 00000004:00080000:3.0:1746066815.654181:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecb800/2, rc 0, transno 21474842756 00000100:00100000:2.0:1746066815.654183:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3777:x1830882985136128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066815.654184:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985135104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.654189:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3777:x1830882985135616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (84us total) trans 21474842763 rc 0/0 00000004:00080000:3.0:1746066815.654190:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecbb80/2, rc 0, transno 21474842763 00000100:00100000:3.0:1746066815.654193:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985135616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.654194:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20543 00000004:00080000:1.0:1746066815.654210:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096eca300/2, rc 0, transno 21474842762 00000100:00100000:1.0:1746066815.654213:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985135872:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.654222:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecaa00/2, rc 0, transno 21474842761 00000100:00100000:1.0:1746066815.654224:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985135360:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746066815.654242:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096ec8380 reply state ffff8800a7ff4400 transno 8589937746 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.654262:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066815.654270:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3777:x1830882985136128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (116us total) trans 17179875408 rc 0/0 00010000:00010000:3.0:1746066815.654271:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.654274:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066815.654275:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20544 00000100:00100000:3.0:1746066815.654277:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746066815.654287:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095801180/2, rc 0, transno 17179875408 00000100:00100000:0.0:1746066815.654290:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985136128:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746066815.654357:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066815.654379:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3442:x1830882985480320:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 9011us (9125us total) trans 8589937746 rc 0/0 00000100:00100000:3.0:1746066815.654398:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17270 00010000:00010000:1.0:1746066815.654415:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654423:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654429:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654434:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80fa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066815.654438:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654745:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654756:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.654758:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066815.654761:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.654770:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb1917 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.656077:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066815.656465:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.656546:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985480960 00000100:00100000:3.0:1746066815.656556:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985480960 00000100:00100000:3.0:1746066815.656616:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17271 00000100:00100000:3.0:1746066815.656623:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3442:x1830882985480960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.656644:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.656661:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7943 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.656707:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.656718:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.656732:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.656734:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066815.656737:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:3.0:1746066815.656800:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3442:x1830882985480960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 177us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.656807:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17271 00000100:00100000:0.0:1746066815.659761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.659848:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481088 00000100:00100000:3.0:1746066815.659855:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481088 00000100:00100000:0.0:1746066815.659971:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17272 00000100:00100000:0.0:1746066815.659980:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3442:x1830882985481088:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066815.659993:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.660007:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfb1925 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d794a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.660080:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066815.660092:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066815.660100:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066815.660122:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066815.660125:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066815.660138:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066815.660155:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfb1925 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.660188:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.660196:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066815.660198:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066815.660201:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59c00, rc 0) 00000100:00100000:0.0:1746066815.660234:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3442:x1830882985481088:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 255us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.660239:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17272 00000100:00100000:0.0:1746066815.662797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.662837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.662864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.662878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.662926:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481216 00000100:00100000:3.0:1746066815.662936:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481216 00000100:00100000:0.0:1746066815.662943:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.662973:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481472 00000100:00100000:3.0:1746066815.662975:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481472 00000100:00100000:3.0:1746066815.662985:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481728 00000100:00100000:3.0:1746066815.662987:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481728 00000100:00100000:1.0:1746066815.662988:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481344 00000100:00100000:1.0:1746066815.662993:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481344 00000100:00100000:3.0:1746066815.662996:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481600 00000100:00100000:3.0:1746066815.662998:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481600 00000100:00100000:3.0:1746066815.663015:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20545 00000100:00100000:1.0:1746066815.663021:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20546 00000100:00100000:3.0:1746066815.663022:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985481216:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066815.663027:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985481472:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.663035:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.663035:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.663049:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7951 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.663049:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d795f expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066815.663066:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd80, atime: 0x6812dd80, ctime: 0x6812dd80, blocks: 0x800 00002000:00010000:1.0:1746066815.663066:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd7f, atime: 0x6812dd7f, ctime: 0x6812dd7f, blocks: 0x800 00010000:00010000:3.0:1746066815.663080:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.663080:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.663081:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.663081:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066815.663084:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20547 00010000:00010000:3.0:1746066815.663088:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.663088:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066815.663097:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985481728:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066815.663098:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.663099:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.663107:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ec800, rc 0) 00010000:00010000:1.0:1746066815.663107:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbac00, rc 0) 00010000:00010000:2.0:1746066815.663111:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.663132:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d796d expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066815.663158:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 4860352, mtime: 0x6812dd80, atime: 0x6812dd80, ctime: 0x6812dd80, blocks: 0x1518 00010000:00010000:2.0:1746066815.663178:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.663179:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.663186:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.663198:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.663212:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c200, rc 0) 00000100:00100000:3.0:1746066815.663362:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985481216:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 339us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.663368:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20545 00000100:00100000:3.0:1746066815.663401:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20548 00000100:00100000:3.0:1746066815.663407:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985481600:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066815.663413:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.663421:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7966 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066815.663431:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd80, atime: 0x6812dd80, ctime: 0x6812dd80, blocks: 0x800 00010000:00010000:3.0:1746066815.663439:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.663440:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.663444:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.663451:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.663458:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ec000, rc 0) 00000100:00100000:1.0:1746066815.663575:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985481472:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 546us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.663576:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985481600:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 169us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.663581:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20546 00000100:00100000:3.0:1746066815.663584:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20548 00000100:00100000:2.0:1746066815.663588:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985481728:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 494us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.663593:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20549 00000100:00100000:2.0:1746066815.663598:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20547 00000100:00100000:1.0:1746066815.663599:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985481344:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066815.663606:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.663613:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7958 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066815.663623:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd7f, atime: 0x6812dd7f, ctime: 0x6812dd7f, blocks: 0x808 00010000:00010000:1.0:1746066815.663631:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.663632:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.663636:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.663644:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.663650:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba400, rc 0) 00000100:00100000:1.0:1746066815.663665:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985481344:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 67us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.663671:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20549 00000100:00100000:0.0:1746066815.663693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.663712:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985481856 00000100:00100000:1.0:1746066815.663715:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985481856 00000100:00100000:1.0:1746066815.664005:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20550 00000100:00100000:1.0:1746066815.664011:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985481856:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066815.664017:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.664025:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7974 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066815.664041:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd80, atime: 0x6812dd7f, ctime: 0x6812dd7f, blocks: 0x1000 00010000:00010000:1.0:1746066815.664050:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.664052:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.664056:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.664063:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.664070:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb000, rc 0) 00000100:00100000:1.0:1746066815.664099:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985481856:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.664103:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20550 00000100:00100000:0.0:1746066815.679337:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.679478:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985482112 00000100:00100000:3.0:1746066815.679491:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985482112 00000100:00100000:3.0:1746066815.679604:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17273 00000100:00100000:3.0:1746066815.679613:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3445:x1830882985482112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.679634:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.679655:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb195d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d797b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.679714:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679725:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679733:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679744:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679748:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679753:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679841:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679850:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.679855:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.679880:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.679916:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 8 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.679925:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136256:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.680028:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.681257:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.681262:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.681278:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066815.681330:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985482240 00000100:00100000:1.0:1746066815.681335:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985482240 00010000:00010000:1.0:1746066815.681356:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 9 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.681402:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9423 00000100:00100000:1.0:1746066815.681408:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985482240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.681417:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.681421:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 9 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.681431:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 9 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.681444:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfb18d8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7935 expref: 9 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.681468:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.681472:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.681479:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.681484:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.681503:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066815.681519:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681527:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066815.681536:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985482240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (280us total) trans 0 rc 0/0 00000004:00200000:2.0:1746066815.681538:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:1.0:1746066815.681543:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9423 00010000:00010000:2.0:1746066815.681605:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681612:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681618:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681623:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80ee00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.681627:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681633:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681640:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.681642:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066815.681645:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681649:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb1972 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681672:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681677:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681682:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681686:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681690:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80e400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.681692:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681700:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681706:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066815.681710:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.681712:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681716:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb1964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681727:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681731:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681735:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681739:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80f800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.681741:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681746:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681751:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce2a100) 00010000:00010000:2.0:1746066815.681752:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.681754:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681758:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfb196b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.681799:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb195d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d797b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.681806:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb195d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d797b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.681813:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fa00, rc 0) 00000100:00100000:2.0:1746066815.681844:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3445:x1830882985482112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2233us (2519us total) trans 8589937747 rc 301/301 00000100:00100000:2.0:1746066815.681850:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17273 00000100:00100000:1.0:1746066815.687260:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.687290:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.687396:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985482496 00000100:00100000:2.0:1746066815.687402:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985482496 00000100:00100000:0.0:1746066815.687421:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985482624 00000100:00100000:0.0:1746066815.687425:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985482624 00000100:00100000:2.0:1746066815.687444:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17274 00000100:00100000:2.0:1746066815.687449:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3448:x1830882985482496:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066815.687460:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17275 00010000:00010000:2.0:1746066815.687464:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066815.687466:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3445:x1830882985482624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066815.687473:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.687476:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7982 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.687481:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb1987 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7989 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.687516:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb1987 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7989 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.687524:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066815.687526:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb1987 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7989 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.687529:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687534:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066815.687538:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.687541:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066815.687541:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066815.687543:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06e00, rc 0) 00010000:00010000:2.0:1746066815.687545:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687548:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066815.687582:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3445:x1830882985482624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.687588:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17275 00010000:00010000:2.0:1746066815.687613:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687617:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687620:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066815.687625:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066815.687667:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687670:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687674:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687677:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.687727:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687731:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687737:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.687739:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066815.687741:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687744:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb199c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687755:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687757:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687760:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687762:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687765:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7cc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.687766:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687768:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687771:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066815.687772:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.687773:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687775:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb198e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687779:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687782:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687785:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687787:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.687788:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687790:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687792:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097014600) 00010000:00010000:2.0:1746066815.687793:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.687794:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687797:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1995 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.687817:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1980 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7982 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.687821:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7982 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.687824:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d400, rc 0) 00000100:00100000:2.0:1746066815.687846:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3448:x1830882985482496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 398us (592us total) trans 8589937748 rc 301/301 00000100:00100000:2.0:1746066815.687850:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17274 00000100:00100000:0.0:1746066815.689347:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.689409:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985482880 00000100:00100000:2.0:1746066815.689414:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985482880 00000100:00100000:0.0:1746066815.689427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.689455:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6507 00000100:00100000:2.0:1746066815.689461:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3448:x1830882985482880:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066815.689482:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483136 00000100:00100000:3.0:1746066815.689486:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483136 00000100:00100000:3.0:1746066815.689520:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17276 00000100:00100000:3.0:1746066815.689526:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3445:x1830882985483136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.689533:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.689536:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066815.689551:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb1987 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7989 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.689565:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.689568:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.689575:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb19aa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7990 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.689577:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3448:x1830882985482880:12345-192.168.204.16@tcp:35:cat.0 Request processed in 115us (231us total) trans 8589937749 rc 0/0 00000100:00100000:2.0:1746066815.689582:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6507 00010000:00010000:3.0:1746066815.689599:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.689608:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.689615:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.689621:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.689642:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.689651:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 7 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.689660:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.689715:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.689721:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 7 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746066815.689728:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136512:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.689743:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.691191:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.691725:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483264 00000100:00100000:1.0:1746066815.691731:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483264 00000100:00100000:1.0:1746066815.691778:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17277 00000100:00100000:1.0:1746066815.691785:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3448:x1830882985483264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066815.691798:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.691809:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb19b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7997 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.691869:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.691878:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.691911:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.691926:0:7243:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.691936:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066815.692022:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.692030:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985136512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.692044:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066815.692274:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.692313:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483392 00000100:00100000:1.0:1746066815.692316:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483392 00000100:00100000:0.0:1746066815.692326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066815.692331:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 8 pid: 10125 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.692465:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483520 00000100:00100000:1.0:1746066815.692468:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9424 00000100:00100000:2.0:1746066815.692470:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483520 00000100:00100000:1.0:1746066815.692475:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985483392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.692482:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.692487:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 9 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.692496:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 9 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746066815.692510:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb192c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d794a expref: 9 pid: 10125 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.692545:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:2.0:1746066815.692569:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9425 00000100:00100000:2.0:1746066815.692575:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985483520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.692581:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.692626:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.692630:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.692636:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.692649:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066815.692653:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.692657:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066815.692691:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.692695:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985483392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 220us (420us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066815.692700:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746066815.692701:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9424 00010000:00010000:2.0:1746066815.692710:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb191e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7943 expref: 8 pid: 7244 timeout: 883 lvb_type: 0 00010000:00010000:2.0:1746066815.692720:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.692723:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.692732:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.692738:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.692743:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066815.692748:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.692752:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.692772:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.692799:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066815.692803:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066815.692858:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985483520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 284us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.692863:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9425 00000040:00080000:3.0:1746066815.693344:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1239, 88 off116624 00000004:00080000:3.0:1746066815.693350:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904466210ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693404:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1244, 88 off116976 00000004:00080000:3.0:1746066815.693408:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904524612ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693421:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1245, 88 off117064 00000004:00080000:3.0:1746066815.693424:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904540498ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693431:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1240, 88 off116712 00000004:00080000:3.0:1746066815.693434:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904550371ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693440:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1241, 88 off116800 00000004:00080000:3.0:1746066815.693442:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904558435ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693448:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1246, 88 off117152 00000004:00080000:3.0:1746066815.693450:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904567220ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693457:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1247, 88 off117240 00000004:00080000:3.0:1746066815.693459:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904575780ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693465:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1248, 88 off117328 00000004:00080000:3.0:1746066815.693468:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904584375ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693474:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1242, 88 off116888 00000004:00080000:3.0:1746066815.693476:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904592555ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693482:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1249, 88 off117416 00000004:00080000:3.0:1746066815.693484:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904600636ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693490:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1243, 88 off116976 00000004:00080000:3.0:1746066815.693492:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904608770ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693499:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1250, 88 off117504 00000004:00080000:3.0:1746066815.693501:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783904617581ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066815.693507:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1244, 88 off117064 00000004:00080000:3.0:1746066815.693510:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904627280ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693517:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1245, 88 off117152 00000004:00080000:3.0:1746066815.693520:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904636400ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693526:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1246, 88 off117240 00000004:00080000:3.0:1746066815.693528:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904645312ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693535:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1247, 88 off117328 00000004:00080000:3.0:1746066815.693637:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 783904654556ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066815.693986:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1251, 88 off117592 00000004:00080000:3.0:1746066815.693989:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783905106085ns, next at 733263917711ns, rc = 0 00000001:00080000:2.0:1746066815.695166:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937750 is committed 00000004:00080000:2.0:1746066815.695174:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1225 committed 00000004:00080000:2.0:1746066815.695250:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1223 committed 00000004:00080000:2.0:1746066815.695287:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1222 committed 00000004:00080000:2.0:1746066815.695289:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1221 committed 00000004:00080000:2.0:1746066815.695290:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1220 committed 00000004:00080000:2.0:1746066815.695292:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1224 committed 00000004:00080000:2.0:1746066815.695293:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1219 committed 00000004:00080000:2.0:1746066815.695294:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1223 committed 00000004:00080000:2.0:1746066815.695296:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1218 committed 00000004:00080000:2.0:1746066815.695297:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1222 committed 00000004:00080000:2.0:1746066815.695298:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1221 committed 00000004:00080000:2.0:1746066815.695300:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1220 committed 00000004:00080000:2.0:1746066815.695302:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1217 committed 00000004:00080000:2.0:1746066815.695303:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1216 committed 00000004:00080000:2.0:1746066815.695304:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1219 committed 00000004:00080000:2.0:1746066815.695306:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1218 committed 00000004:00080000:2.0:1746066815.695307:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1215 committed 00010000:00010000:3.0:1746066815.695471:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.695480:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066815.695483:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066815.695485:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066815.695492:0:7244:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066815.695497:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066815.695521:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb19aa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 12 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066815.695535:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.695554:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05e00, rc 0) 00000100:00100000:1.0:1746066815.695710:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985136640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.695746:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.695843:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985137024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.695868:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985136896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066815.696110:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136640 00000100:00100000:2.0:1746066815.696116:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136640 00000100:00100000:2.0:1746066815.696147:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20551 00000100:00100000:2.0:1746066815.696153:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3774:x1830882985136640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066815.696241:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066815.696245:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066816 -> 1746066816 00002000:00010000:2.0:1746066815.696247:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066816 -> 1746066816 00002000:00010000:2.0:1746066815.696249:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066816 -> 1746066816 00002000:00010000:2.0:1746066815.696250:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066815.696352:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3445:x1830882985483136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6824us (6922us total) trans 8589937750 rc 0/0 00000100:00100000:3.0:1746066815.696359:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17276 00000100:00100000:2.0:1746066815.696710:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3774:x1830882985136640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 557us (963us total) trans 17179875409 rc 0/0 00000100:00100000:2.0:1746066815.696716:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20551 00000100:00100000:0.0:1746066815.696772:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696791:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985137408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.696808:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696818:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985137920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.696830:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696840:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985138432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.696851:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696871:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696896:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985137536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.696910:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696920:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985138048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.696932:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696941:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985138560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.696955:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066815.696972:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136896 00000100:00100000:0.0:1746066815.696975:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136896 00000100:00100000:0.0:1746066815.696989:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137408 00000100:00100000:0.0:1746066815.696991:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137408 00000100:00100000:0.0:1746066815.696999:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137920 00000100:00100000:0.0:1746066815.697000:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137920 00000100:00100000:0.0:1746066815.697008:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138432 00000100:00100000:0.0:1746066815.697009:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138432 00000100:00100000:0.0:1746066815.697016:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137024 00000100:00100000:0.0:1746066815.697017:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137024 00000100:00100000:0.0:1746066815.697022:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137536 00000100:00100000:0.0:1746066815.697024:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137536 00000100:00100000:0.0:1746066815.697028:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138048 00000100:00100000:0.0:1746066815.697030:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138048 00000100:00100000:0.0:1746066815.697034:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138560 00000100:00100000:0.0:1746066815.697036:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138560 00000100:00100000:0.0:1746066815.697042:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20552 00000100:00100000:0.0:1746066815.697046:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3776:x1830882985136896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066815.697097:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066815.697099:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066816 -> 1746066816 00002000:00010000:0.0:1746066815.697101:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066816 -> 1746066816 00002000:00010000:0.0:1746066815.697103:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066816 -> 1746066816 00002000:00010000:0.0:1746066815.697105:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:0.0:1746066815.697126:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+90:3776:x1830882985136896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (353us total) trans 17179875410 rc 0/0 00000100:00100000:0.0:1746066815.697131:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20552 00000100:00100000:0.0:1746066815.697142:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20553 00000100:00100000:0.0:1746066815.697146:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3776:x1830882985137408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.697192:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+90:3776:x1830882985137408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (383us total) trans 17179875411 rc 0/0 00000100:00100000:0.0:1746066815.697197:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20553 00000100:00100000:0.0:1746066815.697205:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20554 00000100:00100000:0.0:1746066815.697208:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3776:x1830882985137920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066815.697257:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066815.697259:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066816 -> 1746066816 00002000:00010000:0.0:1746066815.697261:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066815 -> 1746066815 00002000:00010000:0.0:1746066815.697262:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066815 -> 1746066815 00002000:00010000:0.0:1746066815.697264:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066815.697280:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985137920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (449us total) trans 21474842764 rc 0/0 00000100:00100000:0.0:1746066815.697285:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20554 00000100:00100000:0.0:1746066815.697294:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20555 00000100:00100000:0.0:1746066815.697298:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3776:x1830882985138432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.697343:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3776:x1830882985138432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (490us total) trans 21474842765 rc 0/0 00000100:00100000:0.0:1746066815.697347:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20555 00000100:00100000:0.0:1746066815.697355:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20556 00000100:00100000:0.0:1746066815.697359:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3777:x1830882985137024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066815.697407:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066815.697410:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066815 -> 1746066815 00002000:00010000:0.0:1746066815.697412:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066815 -> 1746066815 00002000:00010000:0.0:1746066815.697414:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066815 -> 1746066815 00002000:00010000:0.0:1746066815.697415:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066815.697432:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3777:x1830882985137024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (561us total) trans 21474842766 rc 0/0 00000100:00100000:0.0:1746066815.697436:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20556 00000100:00100000:0.0:1746066815.697524:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20557 00000100:00100000:0.0:1746066815.697528:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+89:3777:x1830882985137536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.697575:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+90:3777:x1830882985137536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (663us total) trans 17179875412 rc 0/0 00000100:00100000:0.0:1746066815.697579:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20557 00000100:00100000:0.0:1746066815.697588:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20558 00000100:00100000:0.0:1746066815.697591:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3777:x1830882985138048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.697633:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3777:x1830882985138048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (699us total) trans 21474842767 rc 0/0 00000100:00100000:0.0:1746066815.697637:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20558 00000100:00100000:0.0:1746066815.697646:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20559 00000100:00100000:0.0:1746066815.697649:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3777:x1830882985138560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066815.697693:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3777:x1830882985138560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (737us total) trans 21474842768 rc 0/0 00000100:00100000:0.0:1746066815.697697:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20559 00000004:00080000:0.0:1746066815.697733:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801c00/2, rc 0, transno 21474842766 00000100:00100000:0.0:1746066815.697737:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985137024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066815.697745:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54c700/2, rc 0, transno 17179875412 00000100:00100000:0.0:1746066815.697752:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985137536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066815.697758:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d800e00/2, rc 0, transno 21474842767 00000100:00100000:0.0:1746066815.697760:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985138048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066815.697766:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713800/2, rc 0, transno 21474842768 00000100:00100000:0.0:1746066815.697768:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985138560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066815.697781:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800700/2, rc 0, transno 17179875410 00000100:00100000:0.0:1746066815.697784:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985136896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066815.697789:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea34a80/2, rc 0, transno 17179875411 00000100:00100000:0.0:1746066815.697791:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985137408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066815.697796:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d800a80/2, rc 0, transno 21474842764 00000100:00100000:0.0:1746066815.697798:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985137920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066815.697803:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f711500/2, rc 0, transno 21474842765 00000100:00100000:0.0:1746066815.697805:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985138432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.698147:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803100/2, rc 0, transno 17179875409 00000100:00100000:1.0:1746066815.698151:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985136640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698157:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698174:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698198:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698211:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698235:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985138176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.698249:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698261:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746066815.698265:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985136768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698278:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698287:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698298:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698306:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.698318:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698326:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985138304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.698336:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066815.698359:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.698366:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066815.698408:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:1.0:1746066815.698412:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066815.698426:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066815.698453:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee2fc00/0xf1867c21abfb19b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.698466:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.698474:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066815.698477:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746066815.698480:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3c00, rc 0) 00000100:00100000:1.0:1746066815.698507:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3448:x1830882985483264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6723us (7319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.698513:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17277 00000100:00100000:1.0:1746066815.698553:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066815.698559:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985138688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698575:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066815.698592:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137152 00000100:00100000:1.0:1746066815.698596:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137152 00000100:00100000:1.0:1746066815.698612:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137664 00000100:00100000:1.0:1746066815.698613:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137664 00000100:00100000:1.0:1746066815.698622:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138176 00000100:00100000:1.0:1746066815.698624:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138176 00000100:00100000:1.0:1746066815.698631:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985136768 00000100:00100000:1.0:1746066815.698633:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985136768 00000100:00100000:1.0:1746066815.698638:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137280 00000100:00100000:1.0:1746066815.698639:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137280 00000100:00100000:1.0:1746066815.698645:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985137792 00000100:00100000:1.0:1746066815.698646:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985137792 00000100:00100000:1.0:1746066815.698651:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138304 00000100:00100000:1.0:1746066815.698652:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138304 00000100:00100000:1.0:1746066815.698657:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985138688 00000100:00100000:1.0:1746066815.698658:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985138688 00000100:00100000:1.0:1746066815.698665:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20560 00000100:00100000:1.0:1746066815.698669:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3774:x1830882985137152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.698729:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3774:x1830882985137152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (554us total) trans 17179875413 rc 0/0 00000100:00100000:1.0:1746066815.698734:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20560 00000100:00100000:1.0:1746066815.698743:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20561 00000100:00100000:1.0:1746066815.698747:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3774:x1830882985137664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066815.698781:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066815.698783:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066815.698785:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066815.698786:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066815.698788:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066815.698802:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3774:x1830882985137664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (590us total) trans 17179875414 rc 0/0 00000100:00100000:1.0:1746066815.698810:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20561 00000100:00100000:1.0:1746066815.698818:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20562 00000100:00100000:1.0:1746066815.698821:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3774:x1830882985138176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.698868:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3774:x1830882985138176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (618us total) trans 21474842769 rc 0/0 00000100:00100000:1.0:1746066815.698873:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20562 00000100:00100000:1.0:1746066815.698905:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20563 00000100:00100000:1.0:1746066815.698910:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3774:x1830882985136768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066815.698944:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066815.698946:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066816 -> 1746066816 00002000:00010000:1.0:1746066815.698948:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066816 -> 1746066816 00002000:00010000:1.0:1746066815.698950:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066816 -> 1746066816 00002000:00010000:1.0:1746066815.698951:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066815.698967:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3774:x1830882985136768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (688us total) trans 17179875415 rc 0/0 00000100:00100000:1.0:1746066815.698971:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20563 00000100:00100000:1.0:1746066815.698980:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20564 00000100:00100000:1.0:1746066815.698983:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3774:x1830882985137280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066815.699014:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:1.0:1746066815.699016:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066815.699018:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066815.699019:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066815.699021:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066815.699037:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3774:x1830882985137280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (738us total) trans 17179875416 rc 0/0 00000100:00100000:1.0:1746066815.699042:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20564 00000100:00100000:1.0:1746066815.699049:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20565 00000100:00100000:1.0:1746066815.699053:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3774:x1830882985137792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066815.699087:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066815.699089:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066815 -> 1746066815 00002000:00010000:1.0:1746066815.699091:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066815 -> 1746066815 00002000:00010000:1.0:1746066815.699093:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066815 -> 1746066815 00002000:00010000:1.0:1746066815.699094:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066815.699110:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3774:x1830882985137792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (790us total) trans 21474842770 rc 0/0 00000100:00100000:1.0:1746066815.699115:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20565 00000100:00100000:1.0:1746066815.699122:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20566 00000100:00100000:1.0:1746066815.699126:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3774:x1830882985138304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066815.699169:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3774:x1830882985138304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (831us total) trans 21474842771 rc 0/0 00000100:00100000:1.0:1746066815.699173:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20566 00000100:00100000:1.0:1746066815.699181:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20567 00000100:00100000:1.0:1746066815.699185:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3775:x1830882985138688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066815.699239:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3775:x1830882985138688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (664us total) trans 17179875417 rc 0/0 00000100:00100000:1.0:1746066815.699244:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20567 00000004:00080000:1.0:1746066815.699265:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54dc00/2, rc 0, transno 17179875417 00000100:00100000:1.0:1746066815.699269:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985138688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066815.699281:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802680/2, rc 0, transno 17179875415 00000100:00100000:1.0:1746066815.699284:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985136768:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066815.699290:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea35500/2, rc 0, transno 17179875416 00000100:00100000:1.0:1746066815.699292:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066815.699299:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d803100/2, rc 0, transno 21474842770 00000100:00100000:1.0:1746066815.699301:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.699306:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d802a00/2, rc 0, transno 21474842771 00000100:00100000:1.0:1746066815.699309:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985138304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.699314:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d803b80/2, rc 0, transno 21474842769 00000100:00100000:1.0:1746066815.699316:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985138176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066815.699322:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea37480/2, rc 0, transno 17179875413 00000100:00100000:1.0:1746066815.699324:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066815.699329:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54c380/2, rc 0, transno 17179875414 00000100:00100000:1.0:1746066815.699331:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985137664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066815.700545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.700593:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483648 00000100:00100000:2.0:1746066815.700601:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483648 00000100:00100000:2.0:1746066815.700625:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20568 00000100:00100000:2.0:1746066815.700629:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3445:x1830882985483648:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066815.700639:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.700651:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d799e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.700670:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.700682:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.700684:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.700687:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3915776->4038655] (req 3915776->4038655) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.700708:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.700718:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 9 pid: 13363 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.700727:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985138816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066815.701342:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.701366:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483904 00000100:00100000:0.0:1746066815.701372:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483904 00000100:00100000:0.0:1746066815.701427:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20569 00000100:00100000:0.0:1746066815.701434:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985483904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066815.701447:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066815.701471:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.701515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.701540:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.701564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.701630:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484160 00000100:00100000:3.0:1746066815.701634:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484160 00000100:00100000:3.0:1746066815.701655:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484416 00000100:00100000:3.0:1746066815.701656:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484416 00000100:00100000:3.0:1746066815.701665:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985483776 00000100:00100000:3.0:1746066815.701667:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985483776 00000100:00100000:3.0:1746066815.701681:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20570 00010000:00010000:0.0:1746066815.701685:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79ac expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.701686:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985484160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.701693:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.701701:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79ba expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.701705:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.701707:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.701712:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.701714:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.701715:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.701719:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.701731:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.701731:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.701740:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05a00, rc 0) 00010000:00010000:0.0:1746066815.701740:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7800, rc 0) 00000100:00100000:2.0:1746066815.701912:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20571 00000100:00100000:2.0:1746066815.701923:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985484416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.701929:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.701936:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79c8 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.701946:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.701948:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.701951:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.701960:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.701972:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:3.0:1746066815.702205:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985484160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 518us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066815.702207:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985483904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 772us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.702209:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.702212:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20570 00000100:00100000:0.0:1746066815.702216:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20569 00000100:00100000:3.0:1746066815.702227:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484032 00000100:00100000:3.0:1746066815.702229:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484032 00000100:00100000:0.0:1746066815.702231:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20572 00000100:00100000:0.0:1746066815.702238:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985483776:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066815.702246:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20573 00010000:00010000:0.0:1746066815.702246:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066815.702251:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985484032:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066815.702255:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066815.702255:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79a5 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.702256:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.702263:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79b3 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.702268:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.702269:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066815.702271:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484288 00010000:00010000:3.0:1746066815.702273:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066815.702273:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.702274:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066815.702274:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484288 00010000:00010000:3.0:1746066815.702278:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.702282:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.702287:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.702289:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6c00, rc 0) 00010000:00010000:3.0:1746066815.702294:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04a00, rc 0) 00000100:00100000:1.0:1746066815.702294:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20574 00000100:00100000:1.0:1746066815.702299:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985484288:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066815.702303:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985483776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (738us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066815.702304:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066815.702307:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20572 00000100:00100000:3.0:1746066815.702310:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985484032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 59us (101us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066815.702312:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb19f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79c1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.702315:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20573 00010000:00010000:1.0:1746066815.702322:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.702329:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb19f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c1 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.702337:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb19f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c1 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.702344:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497200, rc 0) 00000100:00100000:1.0:1746066815.702360:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985484288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 61us (105us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066815.702364:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20574 00000100:00100000:2.0:1746066815.702373:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985484416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 450us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.702378:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20571 00000100:00100000:2.0:1746066815.702905:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985138816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.702922:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3915776->4038655] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066815.702928:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066815.702931:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ed800, rc 0) 00000100:00100000:3.0:1746066815.703109:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3445:x1830882985483648:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2478us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.703115:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20568 00000100:00100000:2.0:1746066815.703222:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484544 00000100:00100000:2.0:1746066815.703225:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484544 00010000:00010000:2.0:1746066815.703239:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 10 pid: 13363 timeout: 883 lvb_type: 1 00000100:00100000:2.0:1746066815.703320:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9426 00000100:00100000:2.0:1746066815.703327:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985484544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.703335:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.703349:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 10 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.703359:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 10 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.703374:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c200/0xf1867c21abfb1941 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d796d expref: 10 pid: 13363 timeout: 883 lvb_type: 1 00010000:00010000:2.0:1746066815.703396:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.703398:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.703402:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.703409:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.703765:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.703776:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985138944:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066815.703833:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.707736:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985138944:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066815.707757:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.707816:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985484544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4488us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.707825:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9426 00000100:00100000:0.0:1746066815.708839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.708909:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985484800 00000100:00100000:1.0:1746066815.708916:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985484800 00002000:00100000:1.0:1746066815.708946:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->3919871) req@ffff88009d9b0000 x1830882985484800/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.708955:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0000 with x1830882985484800 ext(3915776->3919871) 00002000:00010000:1.0:1746066815.708958:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0000 00000100:00100000:1.0:1746066815.708985:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7719 00000100:00100000:1.0:1746066815.708992:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985484800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.709178:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985484800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 186us (340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066815.709184:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7719 00002000:00100000:1.0:1746066815.709189:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->3919871) req@ffff88009d9b0000 x1830882985484800/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.709201:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0000 with x1830882985484800 ext(3915776->3919871) 00002000:00010000:1.0:1746066815.709204:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0000 00000100:00100000:0.0:1746066815.717074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.717162:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985485056 00000100:00100000:1.0:1746066815.717171:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985485056 00002000:00100000:1.0:1746066815.717212:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4034560->4038655) req@ffff88009d9b1500 x1830882985485056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.717222:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882985485056 ext(4034560->4038655) 00002000:00010000:1.0:1746066815.717227:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:1.0:1746066815.717259:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7720 00000100:00100000:1.0:1746066815.717267:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985485056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.717416:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985485056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 150us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066815.717426:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7720 00002000:00100000:1.0:1746066815.717432:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4034560->4038655) req@ffff88009d9b1500 x1830882985485056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.717438:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882985485056 ext(4034560->4038655) 00002000:00010000:1.0:1746066815.717441:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:0.0:1746066815.718673:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.718742:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985485312 00000100:00100000:2.0:1746066815.718750:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985485312 00002000:00100000:2.0:1746066815.718772:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009d9b3480 x1830882985485312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.718780:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882985485312 ext(0->1048575) 00002000:00010000:2.0:1746066815.718783:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:2.0:1746066815.718808:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7721 00000100:00100000:2.0:1746066815.718814:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985485312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.721643:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.721679:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.721708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.721748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.721760:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985485696 00000100:00100000:3.0:1746066815.721767:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985485696 00002000:00100000:3.0:1746066815.721802:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d9b1c00 x1830882985485696/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.721811:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882985485696 ext(1048576->2097151) 00002000:00010000:3.0:1746066815.721815:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:3.0:1746066815.721830:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985485952 00000100:00100000:3.0:1746066815.721833:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985485952 00002000:00100000:3.0:1746066815.721844:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d9b1f80 x1830882985485952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.721850:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882985485952 ext(1048576->2097151) 00002000:00010000:3.0:1746066815.721853:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:3.0:1746066815.721862:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985485824 00000100:00100000:3.0:1746066815.721864:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985485824 00002000:00100000:3.0:1746066815.721878:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d9b0700 x1830882985485824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.721905:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882985485824 ext(1048576->2097151) 00002000:00010000:3.0:1746066815.721909:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:1.0:1746066815.721915:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7722 00000100:00100000:1.0:1746066815.721929:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985485696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.721940:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7723 00000100:00100000:3.0:1746066815.721946:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985485952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.721947:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7724 00000100:00100000:1.0:1746066815.721951:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985485824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.722682:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985486336 00000100:00100000:3.0:1746066815.722686:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985486336 00000100:00100000:3.0:1746066815.722708:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6508 00000100:00100000:3.0:1746066815.722712:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3445:x1830882985486336:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066815.722866:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3445:x1830882985486336:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 151us (1116us total) trans 8589937751 rc 0/0 00000100:00100000:3.0:1746066815.722872:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6508 00000100:00100000:3.0:1746066815.726145:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985485312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7323us (7467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066815.726156:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7721 00002000:00100000:3.0:1746066815.726167:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009d9b3480 x1830882985485312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.726183:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882985485312 ext(0->1048575) 00002000:00010000:3.0:1746066815.726192:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:1.0:1746066815.726224:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.726272:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985486592 00000100:00100000:0.0:1746066815.726278:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985486592 00000100:00100000:0.0:1746066815.726314:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17278 00000100:00100000:0.0:1746066815.726319:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:3450:x1830882985486592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066815.726852:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.726867:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15000/0xf1867c21abfb19f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79cf expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.726938:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.726948:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.726956:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.726965:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.726969:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.726974:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727077:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727084:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727089:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066815.727097:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066815.727149:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727154:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727159:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727163:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098496400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066815.727166:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727171:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727179:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066815.727182:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066815.727185:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.727189:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfb1a0c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728431:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728439:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728444:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728448:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728452:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098497800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066815.728455:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728459:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728467:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066815.728470:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066815.728472:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728476:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497800/0xf1867c21abfb19fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728483:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728487:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728491:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728495:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098497a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066815.728497:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728501:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728506:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5e80700) 00010000:00010000:0.0:1746066815.728508:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066815.728510:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728514:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfb1a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066815.728547:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15000/0xf1867c21abfb19f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79cf expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.728555:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15000/0xf1867c21abfb19f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79cf expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.728563:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15000, rc 0) 00000100:00100000:0.0:1746066815.728622:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3450:x1830882985486592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2302us (2398us total) trans 8589937752 rc 301/301 00000100:00100000:0.0:1746066815.728630:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17278 00000100:00100000:3.0:1746066815.733713:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985485952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11759us (12025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066815.733725:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7723 00002000:00100000:3.0:1746066815.733735:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d9b1f80 x1830882985485952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066815.733743:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985485824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11789us (12032us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746066815.733744:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882985485952 ext(1048576->2097151) 00002000:00010000:3.0:1746066815.733748:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:1.0:1746066815.733751:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7724 00002000:00100000:1.0:1746066815.733756:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d9b0700 x1830882985485824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.733764:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882985485824 ext(1048576->2097151) 00002000:00010000:1.0:1746066815.733768:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:1.0:1746066815.735617:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985485696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13683us (13975us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.735626:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7722 00002000:00100000:1.0:1746066815.735632:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d9b1c00 x1830882985485696/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.735639:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882985485696 ext(1048576->2097151) 00002000:00010000:1.0:1746066815.735642:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:0.0:1746066815.751046:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.751106:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.751188:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985486976 00000100:00100000:2.0:1746066815.751199:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985486976 00002000:00100000:2.0:1746066815.751240:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b02300 x1830882985486976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 504/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.751249:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b02300 with x1830882985486976 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.751254:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b02300 00000100:00100000:2.0:1746066815.751285:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985487104 00000100:00100000:2.0:1746066815.751287:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985487104 00000100:00100000:1.0:1746066815.751296:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7725 00002000:00100000:2.0:1746066815.751298:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5b00700 x1830882985487104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.751304:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00700 with x1830882985487104 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.751306:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b00700 00000100:00100000:1.0:1746066815.751310:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985486976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.751319:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7726 00000100:00100000:2.0:1746066815.751325:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985487104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.769956:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985487104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18623us (18842us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066815.769967:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7726 00002000:00100000:2.0:1746066815.769978:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5b00700 x1830882985487104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.769986:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00700 with x1830882985487104 ext(2097152->4194303) 00002000:00010000:2.0:1746066815.769991:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b00700 00000100:00100000:1.0:1746066815.775573:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985486976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24256us (24527us total) trans 0 rc 1974272/1974272 00000100:00100000:1.0:1746066815.775582:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7725 00002000:00100000:1.0:1746066815.775594:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5b02300 x1830882985486976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 504/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1974272/1974272 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.775601:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b02300 with x1830882985486976 ext(2097152->4194303) 00002000:00010000:1.0:1746066815.775606:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b02300 00000100:00100000:0.0:1746066815.787286:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.787506:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985487360 00000100:00100000:1.0:1746066815.787517:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985487360 00002000:00100000:1.0:1746066815.787564:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5b03800 x1830882985487360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.787574:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b03800 with x1830882985487360 ext(4194304->4861951) 00002000:00010000:1.0:1746066815.787579:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b03800 00000100:00100000:1.0:1746066815.787730:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7727 00000100:00100000:1.0:1746066815.787738:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985487360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.791832:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985487360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4081us (4543us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066815.791849:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7727 00002000:00100000:1.0:1746066815.791860:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5b03800 x1830882985487360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.791870:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b03800 with x1830882985487360 ext(4194304->4861951) 00002000:00010000:1.0:1746066815.791876:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b03800 00000100:00100000:0.0:1746066815.812021:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.812299:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985487616 00000100:00100000:2.0:1746066815.812309:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985487616 00000100:00100000:2.0:1746066815.812371:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17279 00000100:00100000:2.0:1746066815.812379:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3455:x1830882985487616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.812644:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.812663:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79d6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.812741:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812754:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812766:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812778:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812783:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812788:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812880:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812927:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.812933:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066815.812942:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066815.813010:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813016:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813022:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813028:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.813031:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813037:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813047:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.813050:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066815.813054:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813060:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813092:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813098:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813102:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813106:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813114:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.813116:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813120:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813127:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066815.813129:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.813131:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813135:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813142:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813147:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813151:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813155:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.813157:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813161:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813167:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea05000) 00010000:00010000:2.0:1746066815.813169:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.813172:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813176:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.813211:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79d6 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.813218:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79d6 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.813225:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d000, rc 0) 00000100:00100000:2.0:1746066815.813275:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3455:x1830882985487616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 897us (1266us total) trans 8589937753 rc 301/301 00000100:00100000:2.0:1746066815.813281:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17279 00000100:00100000:0.0:1746066815.821359:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.821486:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985487872 00000100:00100000:3.0:1746066815.821494:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985487872 00000100:00100000:3.0:1746066815.821540:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6509 00000100:00100000:3.0:1746066815.821548:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3455:x1830882985487872:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066815.822235:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:3455:x1830882985487872:12345-192.168.204.16@tcp:35:cat.0 Request processed in 686us (885us total) trans 8589937754 rc 0/0 00000100:00100000:3.0:1746066815.822242:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6509 00000100:00100000:0.0:1746066815.828091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.828332:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488000 00000100:00100000:2.0:1746066815.828341:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488000 00000100:00100000:2.0:1746066815.828403:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17280 00000100:00100000:2.0:1746066815.828505:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:3455:x1830882985488000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.828528:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.828546:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a3d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79dd expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.828630:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.828644:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.828655:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066815.828679:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066815.828683:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066815.828696:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.828715:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a3d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.829290:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.829299:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.829302:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066815.829305:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c400, rc 0) 00000100:00100000:2.0:1746066815.829352:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:3455:x1830882985488000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 942us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.829358:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17280 00000100:00100000:0.0:1746066815.838370:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.838426:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.838807:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.839065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.839102:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488128 00000100:00100000:3.0:1746066815.839111:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488128 00000100:00100000:2.0:1746066815.839186:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488256 00000100:00100000:2.0:1746066815.839190:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488256 00000100:00100000:0.0:1746066815.839519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.839535:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488384 00000100:00100000:3.0:1746066815.839538:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488384 00000100:00100000:3.0:1746066815.839557:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488512 00000100:00100000:3.0:1746066815.839559:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488512 00000100:00100000:3.0:1746066815.839574:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20575 00000100:00100000:3.0:1746066815.839582:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985488128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.839600:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.839618:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79e4 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.839642:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839644:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839653:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839669:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839680:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05200, rc 0) 00000100:00100000:3.0:1746066815.839723:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985488128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 142us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.839729:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20575 00000100:00100000:3.0:1746066815.839745:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20576 00000100:00100000:3.0:1746066815.839749:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985488256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.839756:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.839765:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79eb expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.839775:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839776:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839780:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839791:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839802:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04000, rc 0) 00000100:00100000:3.0:1746066815.839816:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985488256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.839821:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20576 00000100:00100000:3.0:1746066815.839832:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20577 00000100:00100000:3.0:1746066815.839836:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985488384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.839841:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.839847:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79f2 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.839855:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839856:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839859:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839867:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839873:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05800, rc 0) 00000100:00100000:3.0:1746066815.839901:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985488384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.839906:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20577 00000100:00100000:3.0:1746066815.839915:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20578 00000100:00100000:3.0:1746066815.839920:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985488512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.839928:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.839934:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d79f9 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.839942:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839943:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.839946:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839954:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.839960:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05400, rc 0) 00000100:00100000:3.0:1746066815.839973:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985488512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.839977:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20578 00000100:00100000:2.0:1746066815.840976:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488640 00000100:00100000:2.0:1746066815.840981:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488640 00000100:00100000:2.0:1746066815.841012:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20579 00000100:00100000:2.0:1746066815.841018:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985488640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.841025:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.841033:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a00 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.841070:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139072:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.841128:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.841646:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.842033:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488768 00000100:00100000:1.0:1746066815.842038:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488768 00000100:00100000:1.0:1746066815.842811:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20580 00000100:00100000:1.0:1746066815.842819:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985488768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066815.842832:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.842844:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a07 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.842861:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.842863:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.842870:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.842896:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.842907:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eac00, rc 0) 00000100:00100000:1.0:1746066815.842954:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985488768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 136us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.842960:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20580 00000100:00100000:0.0:1746066815.843420:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.843482:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139072:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066815.843505:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a67 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a00 expref: 41 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066815.843514:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a00 expref: 41 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066815.843570:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985488896 00000100:00100000:2.0:1746066815.843574:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985488896 00010000:00010000:0.0:1746066815.844301:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d400, rc 0) 00000100:00100000:0.0:1746066815.844330:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985488640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3312us (4810us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066815.844336:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20579 00000100:00100000:0.0:1746066815.844351:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20581 00000100:00100000:0.0:1746066815.844357:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:3450:x1830882985488896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066815.844364:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066815.844374:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a0e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.844406:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.844412:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066815.844413:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066815.844416:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.844439:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066815.844450:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 19 pid: 12233 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066815.844461:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139200:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066815.845209:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.845968:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.845991:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2822144->3145727] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.846005:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5400, rc 0) 00000100:00100000:1.0:1746066815.846043:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:3450:x1830882985488896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1686us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.846049:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20581 00000100:00100000:0.0:1746066815.847475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.847558:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985489024 00000100:00100000:1.0:1746066815.847565:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985489024 00002000:00100000:1.0:1746066815.847605:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->4038655) req@ffff880095801f80 x1830882985489024/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.847615:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985489024 ext(3915776->4038655) 00010000:00010000:1.0:1746066815.847623:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 20 pid: 12233 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066815.847635:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 20 pid: 12233 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746066815.847642:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095801f80 00000100:00100000:1.0:1746066815.847768:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2211 00000100:00100000:1.0:1746066815.847775:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985489024:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066815.857499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.857540:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.857566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.857647:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.857686:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985489280 00000100:00100000:0.0:1746066815.857693:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985489280 00002000:00100000:0.0:1746066815.857732:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095801500 x1830882985489280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.857742:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882985489280 ext(0->1048575) 00002000:00010000:0.0:1746066815.857749:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:1.0:1746066815.857757:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985489024:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9976us (10280us total) trans 17179875418 rc 0/0 00000100:00100000:0.0:1746066815.857765:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985489536 00000100:00100000:0.0:1746066815.857768:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985489536 00000100:00100000:1.0:1746066815.857769:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2211 00002000:00100000:1.0:1746066815.857779:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->4038655) req@ffff880095801f80 x1830882985489024/t17179875418(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.857780:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095803b80 x1830882985489536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.857787:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803b80 with x1830882985489536 ext(1048576->2097151) 00002000:00100000:1.0:1746066815.857788:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985489024 ext(3915776->4038655) 00002000:00010000:0.0:1746066815.857789:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803b80 00000100:00100000:0.0:1746066815.857798:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985489792 00000100:00100000:0.0:1746066815.857799:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985489792 00002000:00100000:0.0:1746066815.857808:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012e421880 x1830882985489792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.857814:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421880 with x1830882985489792 ext(1048576->2097151) 00002000:00010000:0.0:1746066815.857817:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421880 00000100:00100000:0.0:1746066815.857824:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490048 00000100:00100000:0.0:1746066815.857825:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490048 00002000:00100000:0.0:1746066815.857833:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012e422d80 x1830882985490048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.857839:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422d80 with x1830882985490048 ext(1048576->2097151) 00002000:00010000:0.0:1746066815.857842:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e422d80 00000100:00100000:0.0:1746066815.857870:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7728 00000100:00100000:0.0:1746066815.857877:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985489280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.857919:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7729 00000100:00100000:3.0:1746066815.857929:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985489536:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066815.858477:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066815.858490:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746066815.858497:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095801f80 00000100:00100000:1.0:1746066815.858524:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7730 00000100:00100000:1.0:1746066815.858531:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985489792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.858583:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7731 00000100:00100000:0.0:1746066815.858590:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985490048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.865677:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.869981:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490176 00000100:00100000:3.0:1746066815.869997:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490176 00010000:00010000:3.0:1746066815.870045:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066815.870082:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9427 00000100:00100000:3.0:1746066815.870090:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985490176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.870105:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.870127:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066815.870140:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066815.870163:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfb19c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d799e expref: 22 pid: 12233 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066815.870182:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.870184:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.870192:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 44 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.870200:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 44 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.870234:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 44 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.870247:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985139328:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.870337:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.870677:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985489280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12791us (13178us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066815.870690:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7728 00002000:00100000:0.0:1746066815.870701:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095801500 x1830882985489280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.870710:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882985489280 ext(0->1048575) 00002000:00010000:0.0:1746066815.870715:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:0.0:1746066815.870860:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985490048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12269us (13211us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066815.870865:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7731 00002000:00100000:0.0:1746066815.870870:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012e422d80 x1830882985490048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066815.870876:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422d80 with x1830882985490048 ext(1048576->2097151) 00002000:00010000:0.0:1746066815.870880:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e422d80 00000100:00100000:3.0:1746066815.872226:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985489536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14294us (14680us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066815.872236:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7729 00002000:00100000:3.0:1746066815.872245:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095803b80 x1830882985489536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.872260:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803b80 with x1830882985489536 ext(1048576->2097151) 00002000:00010000:3.0:1746066815.872265:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803b80 00000100:00100000:1.0:1746066815.877650:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985489792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19106us (20068us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.877661:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7730 00002000:00100000:1.0:1746066815.877671:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012e421880 x1830882985489792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.877685:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421880 with x1830882985489792 ext(1048576->2097151) 00002000:00010000:1.0:1746066815.877690:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421880 00000100:00100000:3.0:1746066815.879104:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985139328:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.879128:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.879297:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985490176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9205us (13625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.879307:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9427 00000100:00100000:0.0:1746066815.879686:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.879764:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490432 00000100:00100000:1.0:1746066815.879772:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490432 00002000:00100000:1.0:1746066815.879804:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->2826239) req@ffff88012e420e00 x1830882985490432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.879813:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882985490432 ext(2822144->2826239) 00002000:00010000:1.0:1746066815.879817:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420e00 00000100:00100000:1.0:1746066815.879843:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7732 00000100:00100000:1.0:1746066815.879850:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985490432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066815.879987:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985490432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 137us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066815.879994:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7732 00002000:00100000:1.0:1746066815.879999:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->2826239) req@ffff88012e420e00 x1830882985490432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.880006:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882985490432 ext(2822144->2826239) 00002000:00010000:1.0:1746066815.880009:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420e00 00000100:00100000:0.0:1746066815.886803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.887111:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490560 00000100:00100000:1.0:1746066815.887121:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490560 00000100:00100000:1.0:1746066815.887175:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20582 00000100:00100000:1.0:1746066815.887182:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:3450:x1830882985490560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066815.887199:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066815.887212:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a15 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.887236:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887244:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887250:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887256:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.887257:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.887260:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.887285:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887296:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 25 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.887307:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.887409:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887416:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.887425:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139584:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.887449:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.887456:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 7 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.887473:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139712:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.888184:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.892090:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.892102:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139584:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066815.892109:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985139712:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066815.892137:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.892153:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eae00, rc 0) 00000100:00100000:1.0:1746066815.892219:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:3450:x1830882985490560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5037us (5423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066815.892227:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20582 00000100:00100000:0.0:1746066815.892740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.892769:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.892801:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.892856:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490688 00000100:00100000:1.0:1746066815.892862:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490688 00010000:00010000:1.0:1746066815.892906:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.892935:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490944 00000100:00100000:1.0:1746066815.892938:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490944 00010000:00010000:1.0:1746066815.892948:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.892958:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985490816 00000100:00100000:1.0:1746066815.892960:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985490816 00010000:00010000:1.0:1746066815.892966:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.892978:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9428 00000100:00100000:1.0:1746066815.892984:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985490688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.892994:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066815.893010:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893019:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893036:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb19db lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79c8 expref: 26 pid: 1893 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893053:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.893070:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985490688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.893079:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9429 00000100:00100000:3.0:1746066815.893095:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985490944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066815.893108:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066815.893123:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9428 00010000:00010000:3.0:1746066815.893128:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.893136:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9430 00010000:00010000:3.0:1746066815.893140:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066815.893141:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985490816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066815.893147:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.893160:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb000/0xf1867c21abfb1956 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7974 expref: 8 pid: 1893 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893191:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893202:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893213:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb1a6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a07 expref: 38 pid: 9590 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066815.893221:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.893223:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066815.893228:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.893236:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.893260:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066815.893270:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985139840:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066815.893309:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00010000:00010000:3.0:1746066815.893424:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.893478:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985490944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 388us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.893485:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9429 00000100:00100000:0.0:1746066815.895649:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.895729:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985491200 00000100:00100000:1.0:1746066815.895739:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985491200 00002000:00100000:1.0:1746066815.895777:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2822143) req@ffff88011f713480 x1830882985491200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.895787:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713480 with x1830882985491200 ext(2097152->2822143) 00002000:00010000:1.0:1746066815.895792:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f713480 00000100:00100000:2.0:1746066815.895808:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985139840:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066815.895826:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7733 00010000:00010000:2.0:1746066815.895829:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066815.895832:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985491200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.895863:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985490816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2721us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.895872:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9430 00000100:00100000:0.0:1746066815.899071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.899213:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985491456 00000100:00100000:3.0:1746066815.899223:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985491456 00002000:00100000:3.0:1746066815.899271:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2547712->2551807) req@ffff880094370e00 x1830882985491456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.899286:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370e00 with x1830882985491456 ext(2547712->2551807) 00002000:00010000:3.0:1746066815.899291:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094370e00 00000100:00100000:3.0:1746066815.899311:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7734 00000100:00100000:3.0:1746066815.899318:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985491456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.899466:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985491456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 148us (406us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066815.899472:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7734 00002000:00100000:3.0:1746066815.899478:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2547712->2551807) req@ffff880094370e00 x1830882985491456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.899483:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370e00 with x1830882985491456 ext(2547712->2551807) 00002000:00010000:3.0:1746066815.899486:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094370e00 00000100:00100000:1.0:1746066815.900662:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985491200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4823us (5015us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746066815.900673:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7733 00002000:00100000:1.0:1746066815.900683:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2822143) req@ffff88011f713480 x1830882985491200/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.900692:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713480 with x1830882985491200 ext(2097152->2822143) 00002000:00010000:1.0:1746066815.900697:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f713480 00000100:00100000:0.0:1746066815.902337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.902555:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985491712 00000100:00100000:3.0:1746066815.902563:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985491712 00000100:00100000:3.0:1746066815.902609:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6510 00000100:00100000:3.0:1746066815.902616:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:3450:x1830882985491712:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066815.902812:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3450:x1830882985491712:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 195us (482us total) trans 8589937755 rc 0/0 00000100:00100000:3.0:1746066815.902818:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6510 00000100:00100000:0.0:1746066815.910731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.910811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.910846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.910871:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985492096 00000100:00100000:2.0:1746066815.910879:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985492096 00000100:00100000:1.0:1746066815.910913:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985492224 00000100:00100000:1.0:1746066815.910918:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985492224 00002000:00100000:2.0:1746066815.910932:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2551808->3145727) req@ffff880094372300 x1830882985492096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.910937:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011d856680 x1830882985492224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.910939:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372300 with x1830882985492096 ext(2551808->3145727) 00002000:00010000:2.0:1746066815.910942:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372300 00002000:00100000:1.0:1746066815.910945:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856680 with x1830882985492224 ext(3145728->4194303) 00002000:00010000:1.0:1746066815.910948:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d856680 00000100:00100000:3.0:1746066815.910958:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985492480 00000100:00100000:2.0:1746066815.910962:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7735 00000100:00100000:2.0:1746066815.910967:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985492096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066815.910969:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985492480 00000100:00100000:1.0:1746066815.910969:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7736 00000100:00100000:1.0:1746066815.910974:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985492224:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746066815.911011:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011d854000 x1830882985492480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.911027:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854000 with x1830882985492480 ext(3145728->4194303) 00002000:00010000:3.0:1746066815.911032:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d854000 00000100:00100000:3.0:1746066815.911065:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7737 00000100:00100000:3.0:1746066815.911071:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985492480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066815.918033:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985492096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7053us (7297us total) trans 0 rc 593920/593920 00000100:00100000:2.0:1746066815.918045:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7735 00002000:00100000:2.0:1746066815.918058:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2551808->3145727) req@ffff880094372300 x1830882985492096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.918068:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372300 with x1830882985492096 ext(2551808->3145727) 00002000:00010000:2.0:1746066815.918074:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372300 00000100:00100000:1.0:1746066815.922322:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985492224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11334us (11498us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066815.922336:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7736 00002000:00100000:1.0:1746066815.922349:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011d856680 x1830882985492224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066815.922358:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856680 with x1830882985492224 ext(3145728->4194303) 00002000:00010000:1.0:1746066815.922363:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d856680 00000100:00100000:3.0:1746066815.925971:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985492480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14887us (15110us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066815.925983:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7737 00002000:00100000:3.0:1746066815.925995:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011d854000 x1830882985492480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.926004:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854000 with x1830882985492480 ext(3145728->4194303) 00002000:00010000:3.0:1746066815.926010:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d854000 00000100:00100000:1.0:1746066815.926073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.926247:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985492736 00000100:00100000:2.0:1746066815.926255:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985492736 00000100:00100000:2.0:1746066815.926294:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17281 00000100:00100000:2.0:1746066815.926301:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3459:x1830882985492736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.926324:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.926343:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a1c expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.926427:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926441:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926453:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926467:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926472:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926478:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926573:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926581:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926587:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066815.926594:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066815.926659:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926665:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926671:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926676:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.926680:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926686:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926697:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.926699:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066815.926703:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926709:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb1a98 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926740:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926746:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926751:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926755:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926763:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.926765:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926770:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926776:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066815.926778:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.926784:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926788:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb1a8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926795:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926798:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926802:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926805:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.926807:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926812:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926817:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea05000) 00010000:00010000:2.0:1746066815.926819:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.926821:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926825:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb1a91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.926855:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1a83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a1c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.926862:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a1c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.926868:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:2.0:1746066815.927227:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3459:x1830882985492736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 926us (1153us total) trans 8589937756 rc 301/301 00000100:00100000:2.0:1746066815.927233:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17281 00000100:00100000:0.0:1746066815.928740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.928813:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985492992 00000100:00100000:2.0:1746066815.928821:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985492992 00000100:00100000:2.0:1746066815.928861:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6511 00000100:00100000:2.0:1746066815.928868:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3459:x1830882985492992:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066815.929281:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3459:x1830882985492992:12345-192.168.204.16@tcp:35:cat.0 Request processed in 412us (544us total) trans 8589937757 rc 0/0 00000100:00100000:2.0:1746066815.929288:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6511 00000100:00100000:0.0:1746066815.930780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.930858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.930951:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985493376 00000100:00100000:3.0:1746066815.930957:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985493376 00002000:00100000:3.0:1746066815.930997:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011d855c00 x1830882985493376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066815.931008:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855c00 with x1830882985493376 ext(4194304->4861951) 00002000:00010000:3.0:1746066815.931014:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d855c00 00000100:00100000:3.0:1746066815.931038:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7738 00000100:00100000:3.0:1746066815.931045:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985493376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066815.931496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066815.931560:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985493120 00000100:00100000:1.0:1746066815.931564:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985493120 00000100:00100000:1.0:1746066815.931586:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985493504 00000100:00100000:1.0:1746066815.931588:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985493504 00000100:00100000:1.0:1746066815.931603:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20583 00000100:00100000:3.0:1746066815.931609:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20584 00000100:00100000:1.0:1746066815.931609:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985493120:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066815.931614:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985493504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066815.931619:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.931620:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.931635:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1aa6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a2a expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066815.931636:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfb1aad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a23 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.931678:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985140096:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066815.931678:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139968:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066815.931746:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066815.931746:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00002000:00010000:3.0:1746066815.935237:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066815 -> 1746066816 00002000:00010000:3.0:1746066815.935244:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066815 -> 1746066816 00000100:00100000:1.0:1746066815.935252:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985139968:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066815.935254:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985140096:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066815.935282:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1aa6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a2a expref: 26 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.935282:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfb1aad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a23 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.935295:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1aa6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a2a expref: 26 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066815.935296:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfb1aad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a23 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.935318:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00010000:00010000:1.0:1746066815.935319:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d400, rc 0) 00000100:00100000:1.0:1746066815.935363:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985493120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3752us (4586us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066815.935371:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20583 00000100:00100000:3.0:1746066815.935448:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985493504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3830us (3948us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.935454:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20584 00000100:00100000:2.0:1746066815.935466:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985493376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4419us (4605us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066815.935475:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7738 00002000:00100000:2.0:1746066815.935484:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011d855c00 x1830882985493376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.935499:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855c00 with x1830882985493376 ext(4194304->4861951) 00002000:00010000:2.0:1746066815.935503:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d855c00 00000100:00100000:0.0:1746066815.943409:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.943509:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.944443:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985493632 00000100:00100000:3.0:1746066815.944454:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985493632 00000100:00100000:3.0:1746066815.944509:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985493760 00000100:00100000:3.0:1746066815.944511:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985493760 00000100:00100000:3.0:1746066815.944530:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20585 00000100:00100000:3.0:1746066815.944537:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985493632:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066815.944545:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20586 00010000:00010000:3.0:1746066815.944557:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066815.944557:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985493760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.944565:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.944575:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8600/0xf1867c21abfb1ab4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a31 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.944576:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb1abb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a38 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.944625:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140224:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066815.944626:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985140352:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066815.945166:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.945169:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.948645:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140224:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066815.948688:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb1abb lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a38 expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.948702:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb1abb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a38 expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066815.948729:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8a00, rc 0) 00000100:00100000:3.0:1746066815.948863:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985140352:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066815.948907:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8600/0xf1867c21abfb1ab4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a31 expref: 22 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.948920:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8600/0xf1867c21abfb1ab4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a31 expref: 22 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.948938:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8600, rc 0) 00000100:00100000:2.0:1746066815.949112:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985493760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4556us (5599us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.949238:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985493632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4700us (5838us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066815.949247:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20585 00000100:00100000:2.0:1746066815.949308:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20586 00000100:00100000:0.0:1746066815.950214:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.952172:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494016 00000100:00100000:2.0:1746066815.952184:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494016 00000100:00100000:1.0:1746066815.952213:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.952230:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17282 00000100:00100000:2.0:1746066815.952239:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3461:x1830882985494016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066815.952269:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.952287:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a3f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.952374:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952399:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952410:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952424:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952430:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952435:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952530:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952539:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952545:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066815.952553:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066815.952618:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952625:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952631:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952637:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.952640:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952647:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952657:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066815.952660:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066815.952664:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952669:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb1ad7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952682:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952687:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952691:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952695:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952699:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.952702:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952707:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952712:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066815.952714:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.952717:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952721:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfb1ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952727:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952731:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952735:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952738:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066815.952740:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952743:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952747:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea05000) 00010000:00010000:2.0:1746066815.952749:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066815.952751:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952760:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb1ad0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066815.952792:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1ac2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a3f expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.952799:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb1ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a3f expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.952806:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9400, rc 0) 00000100:00100000:2.0:1746066815.952865:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3461:x1830882985494016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 626us (2651us total) trans 8589937758 rc 301/301 00000100:00100000:2.0:1746066815.952871:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17282 00000100:00100000:2.0:1746066815.952912:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494144 00000100:00100000:2.0:1746066815.952916:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494144 00000100:00100000:2.0:1746066815.952936:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20587 00000100:00100000:2.0:1746066815.952941:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3459:x1830882985494144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066815.952950:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066815.952962:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a46 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.952981:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.952988:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.952990:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066815.952993:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.953020:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.953031:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 40 pid: 1893 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066815.953044:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985140480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.953114:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.956315:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985140480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066815.956349:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.956367:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66a00, rc 0) 00000100:00100000:2.0:1746066815.956429:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3459:x1830882985494144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3486us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.956438:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20587 00000100:00100000:0.0:1746066815.957845:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.957905:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494272 00000100:00100000:2.0:1746066815.957913:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494272 00002000:00100000:2.0:1746066815.957950:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->3145727) req@ffff88011d854a80 x1830882985494272/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.957960:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854a80 with x1830882985494272 ext(2822144->3145727) 00010000:00010000:2.0:1746066815.957968:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 41 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.957984:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 41 pid: 1893 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066815.957990:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011d854a80 00000100:00100000:2.0:1746066815.958018:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2212 00000100:00100000:2.0:1746066815.958024:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985494272:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066815.960795:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.961004:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494400 00000100:00100000:3.0:1746066815.961012:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494400 00000100:00100000:3.0:1746066815.961050:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20588 00000100:00100000:3.0:1746066815.961057:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3461:x1830882985494400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066815.961074:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.961091:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a4d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.961119:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 6 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961131:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961138:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961143:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.961144:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.961147:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1609728->1789951] (req 1609728->1789951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.961175:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961184:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066815.961195:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.961533:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961541:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 36 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066815.961550:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140736:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.961582:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 6 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066815.961590:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 6 pid: 11630 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066815.961598:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140864:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.961616:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066815.962650:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985494272:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4622us (4805us total) trans 17179875419 rc 0/0 00000100:00100000:2.0:1746066815.962659:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2212 00002000:00100000:2.0:1746066815.962669:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2822144->3145727) req@ffff88011d854a80 x1830882985494272/t17179875419(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.962677:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854a80 with x1830882985494272 ext(2822144->3145727) 00010000:00010000:2.0:1746066815.962684:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.962694:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066815.962699:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011d854a80 00000100:00100000:3.0:1746066815.963318:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.963324:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140736:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066815.963329:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985140864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.963348:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1609728->1789951] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.963359:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8a00, rc 0) 00000100:00100000:3.0:1746066815.963375:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3461:x1830882985494400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2320us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.963393:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20588 00000100:00100000:0.0:1746066815.965869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.965927:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066815.965980:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494528 00000100:00100000:3.0:1746066815.965988:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494528 00000100:00100000:2.0:1746066815.965996:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494784 00000100:00100000:2.0:1746066815.966000:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494784 00010000:00010000:3.0:1746066815.966017:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746066815.966017:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 37 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066815.966045:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9431 00000100:00100000:3.0:1746066815.966051:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985494528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066815.966054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066815.966062:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.966082:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066815.966093:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066815.966114:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7800/0xf1867c21abfb19cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ac expref: 26 pid: 12255 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066815.966129:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494656 00000100:00100000:2.0:1746066815.966131:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494656 00010000:00010000:3.0:1746066815.966132:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066815.966142:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066815.966156:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9432 00000100:00100000:2.0:1746066815.966161:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985494784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.966167:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066815.966168:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985494528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 116us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.966175:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9431 00010000:00010000:2.0:1746066815.966175:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 37 pid: 12233 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746066815.966183:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 37 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066815.966190:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9433 00000100:00100000:3.0:1746066815.966195:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985494656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.966200:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb1a52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79eb expref: 37 pid: 12233 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066815.966201:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066815.966208:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746066815.966212:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066815.966216:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066815.966227:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb194f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7958 expref: 7 pid: 11630 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066815.966229:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985494784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066815.966235:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9432 00010000:00010000:3.0:1746066815.966241:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.966243:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066815.966250:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.966258:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.966287:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066815.966299:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985140992:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066815.966403:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066815.966905:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.966975:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985494912 00000100:00100000:2.0:1746066815.966979:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985494912 00010000:00010000:2.0:1746066815.966995:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066815.967019:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9434 00000100:00100000:2.0:1746066815.967025:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985494912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066815.967032:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066815.967043:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.967050:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.967062:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb1a75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a0e expref: 43 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.967071:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.967072:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066815.967075:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.967081:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066815.967159:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066815.967167:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985141120:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066815.967214:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.967485:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985140992:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066815.967497:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066815.967533:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985494656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1336us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.967540:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9433 00000100:00100000:0.0:1746066815.968341:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.968433:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985495168 00000100:00100000:2.0:1746066815.968438:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985495168 00002000:00100000:2.0:1746066815.968470:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1613823) req@ffff88011d855880 x1830882985495168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066815.968479:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985141120:192.168.204.16@tcp:105: 00002000:00100000:2.0:1746066815.968480:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855880 with x1830882985495168 ext(1609728->1613823) 00002000:00010000:2.0:1746066815.968484:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855880 00010000:00010000:3.0:1746066815.968490:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066815.968511:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7739 00000100:00100000:2.0:1746066815.968517:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985495168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066815.968525:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985494912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1499us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.968532:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9434 00000100:00100000:2.0:1746066815.968637:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985495168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 119us (295us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.968643:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7739 00002000:00100000:2.0:1746066815.968647:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1613823) req@ffff88011d855880 x1830882985495168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.968654:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855880 with x1830882985495168 ext(1609728->1613823) 00002000:00010000:2.0:1746066815.968657:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855880 00000100:00100000:0.0:1746066815.970255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.970314:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985495424 00000100:00100000:2.0:1746066815.970319:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985495424 00002000:00100000:2.0:1746066815.970342:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88011d854700 x1830882985495424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.970348:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854700 with x1830882985495424 ext(2097152->3145727) 00002000:00010000:2.0:1746066815.970353:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d854700 00000100:00100000:2.0:1746066815.970366:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7740 00000100:00100000:2.0:1746066815.970371:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985495424:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066815.971906:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.972593:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985495680 00000100:00100000:2.0:1746066815.972602:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985495680 00002000:00100000:2.0:1746066815.972643:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1785856->1789951) req@ffff88012c4a0000 x1830882985495680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.972653:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0000 with x1830882985495680 ext(1785856->1789951) 00002000:00010000:2.0:1746066815.972659:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a0000 00000100:00100000:2.0:1746066815.972697:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7741 00000100:00100000:2.0:1746066815.972704:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985495680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066815.972825:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985495680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (943us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066815.972832:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7741 00002000:00100000:2.0:1746066815.972838:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1785856->1789951) req@ffff88012c4a0000 x1830882985495680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/4536 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.972844:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0000 with x1830882985495680 ext(1785856->1789951) 00002000:00010000:2.0:1746066815.972847:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a0000 00000100:00100000:2.0:1746066815.977476:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985495424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7094us (7215us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066815.977487:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7740 00002000:00100000:2.0:1746066815.977499:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88011d854700 x1830882985495424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:221/0 lens 488/440 e 0 to 0 dl 1746066826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.977508:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854700 with x1830882985495424 ext(2097152->3145727) 00002000:00010000:2.0:1746066815.977514:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011d854700 00000100:00100000:0.0:1746066815.981658:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066815.981736:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.981754:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985495936 00000100:00100000:2.0:1746066815.981763:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985495936 00000100:00100000:2.0:1746066815.981816:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6512 00000100:00100000:2.0:1746066815.981824:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3461:x1830882985495936:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066815.981920:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985496064 00000100:00100000:3.0:1746066815.981926:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985496064 00000100:00100000:3.0:1746066815.981952:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20589 00000100:00100000:3.0:1746066815.981957:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3459:x1830882985496064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066815.981968:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066815.981985:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a54 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.982012:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.982019:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.982021:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066815.982024:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.982054:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.982065:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 35 pid: 1893 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066815.982077:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985141248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066815.982668:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3461:x1830882985495936:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 843us (1020us total) trans 8589937759 rc 0/0 00000100:00100000:2.0:1746066815.982677:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6512 00000100:00100000:3.0:1746066815.982683:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066815.987320:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985141248:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066815.987351:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066815.987373:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04800, rc 0) 00000100:00100000:3.0:1746066815.987447:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3459:x1830882985496064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5487us (5709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066815.987456:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20589 00000100:00100000:0.0:1746066815.987700:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066815.987924:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985496192 00000100:00100000:2.0:1746066815.987931:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985496192 00002000:00100000:2.0:1746066815.987973:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2551807) req@ffff88012c4a0e00 x1830882985496192/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/0 e 0 to 0 dl 1746066826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.987981:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0e00 with x1830882985496192 ext(2097152->2551807) 00010000:00010000:2.0:1746066815.987988:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 36 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.988001:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 36 pid: 1893 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066815.988008:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c4a0e00 00000100:00100000:2.0:1746066815.988038:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2213 00000100:00100000:2.0:1746066815.988044:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985496192:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066815.995656:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985496192:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7597us (7943us total) trans 21474842772 rc 0/0 00000100:00100000:2.0:1746066815.995671:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2213 00002000:00100000:2.0:1746066815.995684:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2551807) req@ffff88012c4a0e00 x1830882985496192/t21474842772(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:221/0 lens 488/448 e 0 to 0 dl 1746066826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066815.995694:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0e00 with x1830882985496192 ext(2097152->2551807) 00010000:00010000:2.0:1746066815.995706:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066815.995725:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066815.995732:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c4a0e00 00000100:00100000:0.0:1746066816.000742:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.000946:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985496320 00000100:00100000:3.0:1746066816.000956:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985496320 00010000:00010000:3.0:1746066816.000992:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066816.001019:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9435 00000100:00100000:3.0:1746066816.001027:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985496320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.001042:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.001061:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.001073:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.001097:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb1a7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a15 expref: 38 pid: 1893 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.001117:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.001119:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.001127:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.001141:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.001175:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.001188:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985141376:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066816.001277:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066816.003581:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985141376:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066816.003601:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.003647:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985496320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2620us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.003657:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9435 00000100:00100000:0.0:1746066816.008456:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.008562:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985496576 00000100:00100000:2.0:1746066816.008573:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985496576 00002000:00100000:2.0:1746066816.008634:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012c4a3800 x1830882985496576/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.008644:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3800 with x1830882985496576 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.008649:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3800 00000100:00080000:0.0:1746066816.008723:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066816.008778:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7742 00000100:00100000:2.0:1746066816.008787:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985496576:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066816.010586:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.010996:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985496832 00000100:00100000:3.0:1746066816.011004:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985496832 00002000:00100000:3.0:1746066816.011245:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c4a0380 x1830882985496832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.011255:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0380 with x1830882985496832 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.011260:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0380 00000100:00100000:3.0:1746066816.011286:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7743 00000100:00100000:3.0:1746066816.011294:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985496832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00080000:1.0:1746066816.011513:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066816.023533:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985496576:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14735us (15077us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066816.023545:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7742 00002000:00100000:2.0:1746066816.023557:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012c4a3800 x1830882985496576/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.023566:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a3800 with x1830882985496576 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.023572:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c4a3800 00000100:00100000:3.0:1746066816.027302:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985496832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15997us (16711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066816.027318:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7743 00002000:00100000:3.0:1746066816.027332:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012c4a0380 x1830882985496832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.027341:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a0380 with x1830882985496832 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.027347:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a0380 00000100:00100000:0.0:1746066816.033352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.033431:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985497088 00000100:00100000:3.0:1746066816.033441:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985497088 00002000:00100000:3.0:1746066816.033491:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012c4a1880 x1830882985497088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.033500:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1880 with x1830882985497088 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.033506:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a1880 00000100:00100000:3.0:1746066816.033537:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7744 00000100:00100000:3.0:1746066816.033545:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985497088:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.039289:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985497088:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5733us (5935us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066816.039302:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7744 00002000:00100000:3.0:1746066816.039314:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012c4a1880 x1830882985497088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.039324:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1880 with x1830882985497088 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.039331:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a1880 00000100:00100000:0.0:1746066816.109611:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.110063:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985497344 00000100:00100000:3.0:1746066816.110075:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985497344 00000100:00100000:3.0:1746066816.110659:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17283 00000100:00100000:3.0:1746066816.110668:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3466:x1830882985497344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.110694:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.110711:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04000/0xf1867c21abfb1afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a5b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.110784:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110796:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110806:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110817:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110822:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110826:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110934:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110941:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.110945:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.110952:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.111008:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111014:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111019:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111024:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.111027:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111032:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111040:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.111043:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066816.111046:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111049:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb1b0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111076:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111081:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111085:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111088:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111091:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ecf200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.111094:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111098:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111102:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.111104:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.111106:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111109:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb1b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111115:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111118:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111122:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111125:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7cc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.111127:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111130:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111134:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34e400) 00010000:00010000:3.0:1746066816.111136:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.111137:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111144:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.111176:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04000/0xf1867c21abfb1afa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a5b expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.111182:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04000/0xf1867c21abfb1afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a5b expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.111188:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04000, rc 0) 00000100:00100000:3.0:1746066816.111258:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3466:x1830882985497344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 590us (2443us total) trans 8589937760 rc 301/301 00000100:00100000:3.0:1746066816.111264:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17283 00000100:00100000:0.0:1746066816.131496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.132332:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985497600 00000100:00100000:2.0:1746066816.132343:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985497600 00000100:00100000:2.0:1746066816.132544:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17284 00000100:00100000:2.0:1746066816.132553:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:3468:x1830882985497600:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066816.132582:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.132764:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a62 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.132846:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.132860:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.132870:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.132897:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.132903:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.132908:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133001:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133009:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133014:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066816.133023:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066816.133089:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133099:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133105:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133111:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575ae00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.133114:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133121:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133131:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066816.133133:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066816.133137:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133142:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ae00/0xf1867c21abfb1b32 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133172:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133177:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133181:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133185:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133189:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.133192:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133197:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133202:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066816.133204:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.133206:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133211:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133218:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133222:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133226:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133228:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.133230:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133233:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133237:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cda900) 00010000:00010000:2.0:1746066816.133239:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.133240:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133248:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.133280:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a62 expref: 34 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.133287:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a62 expref: 34 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.133293:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:2.0:1746066816.133357:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:3468:x1830882985497600:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 806us (1872us total) trans 8589937761 rc 301/301 00000100:00100000:2.0:1746066816.133364:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17284 00000100:00100000:0.0:1746066816.160070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.160219:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985497856 00000100:00100000:2.0:1746066816.160229:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985497856 00000100:00100000:2.0:1746066816.160389:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17285 00000100:00100000:2.0:1746066816.160399:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:3473:x1830882985497856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.160468:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.160489:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a69 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.160566:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160578:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160588:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160605:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160610:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160615:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160709:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160718:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160724:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066816.160734:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066816.160799:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160806:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160812:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160817:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.160821:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160828:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160838:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066816.160841:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066816.160845:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.160850:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162192:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162205:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162212:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162217:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162222:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.162225:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162231:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162245:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066816.162248:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.162251:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162256:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162269:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162274:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162278:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162282:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.162284:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162288:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162293:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cdae00) 00010000:00010000:2.0:1746066816.162294:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.162296:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162300:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.162348:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a69 expref: 35 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.162355:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a69 expref: 35 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.162362:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b400, rc 0) 00000100:00100000:2.0:1746066816.162442:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:3473:x1830882985497856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2044us (2383us total) trans 8589937762 rc 301/301 00000100:00100000:2.0:1746066816.162450:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17285 00000100:00100000:0.0:1746066816.165754:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.165851:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985498112 00000100:00100000:2.0:1746066816.165861:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985498112 00000100:00100000:2.0:1746066816.166079:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6513 00000100:00100000:2.0:1746066816.166087:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:3473:x1830882985498112:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066816.166286:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:3473:x1830882985498112:12345-192.168.204.16@tcp:35:cat.0 Request processed in 199us (542us total) trans 8589937763 rc 0/0 00000100:00100000:2.0:1746066816.166293:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6513 00000100:00100000:0.0:1746066816.168809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.168921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.168944:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.168971:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.168990:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985498368 00000100:00100000:1.0:1746066816.168996:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985498368 00000100:00100000:1.0:1746066816.169029:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985498752 00000100:00100000:1.0:1746066816.169031:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985498752 00000100:00100000:1.0:1746066816.169041:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985498624 00000100:00100000:1.0:1746066816.169043:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985498624 00000100:00100000:1.0:1746066816.169058:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20590 00000100:00100000:1.0:1746066816.169063:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985498368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.169078:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.169094:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1b63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a70 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.169145:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141504:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066816.169217:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.169237:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20591 00000100:00100000:1.0:1746066816.169243:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985498752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.169249:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.169256:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a85 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.169267:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.169270:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.169282:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 40 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.169297:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 40 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.169306:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae400, rc 0) 00000100:00100000:3.0:1746066816.169312:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20592 00000100:00100000:3.0:1746066816.169320:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985498624:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066816.169326:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985498752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066816.169328:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066816.169332:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20591 00010000:00010000:3.0:1746066816.169339:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a7e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.169351:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.169353:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.169357:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.169366:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.169390:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:3.0:1746066816.169408:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985498624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.169413:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20592 00000100:00100000:2.0:1746066816.169507:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985498496 00000100:00100000:2.0:1746066816.169511:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985498496 00000100:00100000:2.0:1746066816.169553:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17286 00000100:00100000:2.0:1746066816.169559:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3474:x1830882985498496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.169571:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.169583:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a77 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.169655:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169666:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169676:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169687:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169696:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169701:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169797:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169805:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169811:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066816.169819:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066816.169878:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169915:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169921:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169926:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.169930:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169937:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.169946:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066816.169949:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066816.169953:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170059:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb1b8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170075:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170080:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170084:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170089:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170093:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.170096:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170111:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170117:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066816.170119:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.170122:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170126:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb1b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170133:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170138:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170143:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170146:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.170149:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170154:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170159:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cda900) 00010000:00010000:2.0:1746066816.170161:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.170163:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170167:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb1b86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066816.170198:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a77 expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.170204:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb1b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a77 expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.170210:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b400, rc 0) 00000100:00100000:2.0:1746066816.170243:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3474:x1830882985498496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 683us (1440us total) trans 8589937764 rc 301/301 00000100:00100000:2.0:1746066816.170248:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17286 00002000:00010000:1.0:1746066816.171916:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066815 -> 1746066817 00002000:00010000:1.0:1746066816.171922:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066815 -> 1746066817 00002000:00010000:1.0:1746066816.171924:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066815 -> 1746066817 00000100:00100000:1.0:1746066816.171940:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141504:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066816.171964:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1b63 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a70 expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.171975:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb1b63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a70 expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.171991:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf800, rc 0) 00000100:00100000:1.0:1746066816.172029:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985498368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2965us (3108us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.172036:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20590 00000100:00100000:0.0:1746066816.172801:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.172848:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499008 00000100:00100000:2.0:1746066816.172855:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499008 00000100:00100000:2.0:1746066816.172907:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6514 00000100:00100000:2.0:1746066816.172917:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3474:x1830882985499008:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066816.173075:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3474:x1830882985499008:12345-192.168.204.16@tcp:35:cat.0 Request processed in 158us (341us total) trans 8589937765 rc 0/0 00000100:00100000:2.0:1746066816.173082:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6514 00000100:00100000:0.0:1746066816.176210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.176300:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499136 00000100:00100000:1.0:1746066816.176310:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499136 00000100:00100000:1.0:1746066816.176362:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20593 00000100:00100000:1.0:1746066816.176370:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3473:x1830882985499136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.176400:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.176424:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a8c expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.176456:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.176464:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.176466:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.176470:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.176499:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.176511:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 25 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.176523:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141632:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.177211:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.182204:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.182259:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499392 00000100:00100000:3.0:1746066816.182268:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499392 00002000:00100000:3.0:1746066816.182312:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5767100 x1830882985499392/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 504/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.182322:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767100 with x1830882985499392 ext(1048576->2097151) 00010000:00010000:3.0:1746066816.182331:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 26 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.182345:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 26 pid: 9590 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.182351:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5767100 00000100:00100000:1.0:1746066816.182611:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141632:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.182639:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.182656:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae000, rc 0) 00000100:00100000:1.0:1746066816.182698:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3473:x1830882985499136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6328us (6499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.182705:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20593 00000100:00100000:3.0:1746066816.182755:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2214 00000100:00100000:3.0:1746066816.182763:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985499392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.182925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.183256:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499520 00000100:00100000:1.0:1746066816.183260:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499520 00002000:00100000:1.0:1746066816.183278:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1789951) req@ffff8800a5765880 x1830882985499520/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.183286:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765880 with x1830882985499520 ext(1609728->1789951) 00010000:00010000:1.0:1746066816.183291:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 28 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.183301:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 28 pid: 9590 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746066816.183307:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5765880 00000100:00100000:1.0:1746066816.184050:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2215 00000100:00100000:1.0:1746066816.184057:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985499520:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066816.198050:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985499392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15274us (15845us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746066816.198062:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2214 00002000:00100000:3.0:1746066816.198075:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5767100 x1830882985499392/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 504/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.198089:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767100 with x1830882985499392 ext(1048576->2097151) 00010000:00010000:3.0:1746066816.198101:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 30 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.198116:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 30 pid: 9590 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.198123:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5767100 00000100:00100000:0.0:1746066816.198470:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.198497:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499648 00000100:00100000:0.0:1746066816.198503:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499648 00000100:00100000:1.0:1746066816.198603:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882985499520:12345-192.168.204.16@tcp:4:cat.0 Request processed in 14546us (15677us total) trans 21474842773 rc 0/0 00000100:00100000:1.0:1746066816.198611:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2215 00002000:00100000:1.0:1746066816.198617:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1789951) req@ffff8800a5765880 x1830882985499520/t21474842773(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.198624:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765880 with x1830882985499520 ext(1609728->1789951) 00010000:00010000:1.0:1746066816.198629:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 29 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.198643:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 29 pid: 9590 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746066816.198649:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5765880 00000100:00100000:0.0:1746066816.198961:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20594 00000100:00100000:0.0:1746066816.198969:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3466:x1830882985499648:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066816.198983:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066816.198997:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a93 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.199022:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 29 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.199031:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066816.199036:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.199038:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.199041:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.199071:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066816.199081:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 38 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746066816.199097:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141760:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066816.199159:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 29 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.199167:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 29 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.199175:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141888:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066816.199191:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.200766:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.200777:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985141888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.200804:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.200819:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575a200, rc 0) 00000100:00100000:1.0:1746066816.200860:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3466:x1830882985499648:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1891us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.200868:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20594 00000001:00080000:2.0:1746066816.201594:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842773 is committed 00000001:00080000:2.0:1746066816.201605:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842772 is committed 00000001:00080000:2.0:1746066816.201611:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842771 is committed 00000100:00100000:0.0:1746066816.206283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.207102:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.207144:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.207171:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499776 00000100:00100000:0.0:1746066816.207243:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499776 00010000:00010000:0.0:1746066816.207283:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 19 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746066816.207310:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500032 00000100:00100000:0.0:1746066816.207312:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500032 00010000:00010000:0.0:1746066816.207322:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 9 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.207333:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985499904 00000100:00100000:0.0:1746066816.207335:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985499904 00010000:00010000:0.0:1746066816.207344:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.207362:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9436 00000100:00100000:0.0:1746066816.207369:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985499776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066816.207396:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066816.207421:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 19 pid: 1893 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746066816.207431:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 19 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066816.207444:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9437 00010000:00010000:0.0:1746066816.207452:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae400/0xf1867c21abfb1b6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a85 expref: 19 pid: 1893 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066816.207453:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985500032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.207461:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.207471:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.207480:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.207540:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9438 00000100:00100000:1.0:1746066816.207548:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985499904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.207556:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.207570:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.207579:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.207592:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1aec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a4d expref: 10 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.207613:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.207615:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.207626:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.207635:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.207669:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.207682:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985142016:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.207763:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.207855:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.207875:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500160 00000100:00100000:1.0:1746066816.207878:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500160 00000100:00100000:1.0:1746066816.207918:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20595 00000100:00100000:1.0:1746066816.207922:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3474:x1830882985500160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.207936:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.207945:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7a9a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.209190:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066816.209203:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04800/0xf1867c21abfb1af3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a54 expref: 11 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.209223:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.209224:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.209229:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066816.209230:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882985499776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1860us (2958us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066816.209237:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066816.209238:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9436 00010000:00010000:3.0:1746066816.209264:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.209275:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985142144:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.209294:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.209302:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.209304:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.209307:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.209313:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066816.209327:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.209337:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.209346:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985142272:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.209423:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.210776:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985142272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.210796:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.210808:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae200, rc 0) 00000100:00100000:3.0:1746066816.210986:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985142144:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066816.210997:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.211231:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985500032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3778us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.211232:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3474:x1830882985500160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3307us (3376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.211240:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9437 00000100:00100000:1.0:1746066816.211411:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20595 00000100:00100000:0.0:1746066816.212034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.212700:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985142016:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066816.212756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066816.212808:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.212836:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985499904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5289us (5692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.212844:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9438 00000100:00100000:1.0:1746066816.212868:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500544 00000100:00100000:1.0:1746066816.212875:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500544 00000100:00100000:2.0:1746066816.213035:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500416 00000100:00100000:2.0:1746066816.213040:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500416 00002000:00100000:2.0:1746066816.213073:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->3850239) req@ffff8800a5765f80 x1830882985500416/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.213087:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765f80 with x1830882985500416 ext(3846144->3850239) 00010000:00010000:2.0:1746066816.213096:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.213108:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066816.213114:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5765f80 00000100:00100000:1.0:1746066816.213556:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20596 00000100:00100000:1.0:1746066816.213563:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:3468:x1830882985500544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066816.213576:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.213590:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7aa1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.213614:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.213622:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.213630:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.213636:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.213637:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.213645:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1400832->2080767] (req 1400832->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.213673:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.213683:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 21 pid: 9592 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066816.213693:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142400:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.213760:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2216 00000100:00100000:2.0:1746066816.213773:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2013:x1830882985500416:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066816.213845:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.213859:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066816.213870:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.213872:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2013:x1830882985500416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 103us (1839us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066816.213906:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2216 00002000:00100000:2.0:1746066816.213913:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->3850239) req@ffff8800a5765f80 x1830882985500416/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.213919:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765f80 with x1830882985500416 ext(3846144->3850239) 00010000:00010000:2.0:1746066816.213926:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.213931:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.213935:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.213939:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 8 pid: 3528 timeout: 884 lvb_type: 1 00002000:00010000:2.0:1746066816.213941:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5765f80 00000100:00100000:1.0:1746066816.213947:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142656:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.213964:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.214752:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.214975:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500800 00000100:00100000:2.0:1746066816.214981:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500800 00002000:00100000:2.0:1746066816.215002:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5764000 x1830882985500800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.215009:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764000 with x1830882985500800 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.215012:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5764000 00000100:00100000:2.0:1746066816.215034:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7745 00000100:00100000:2.0:1746066816.215040:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985500800:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066816.223436:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142400:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.223448:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142528:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066816.223448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.223494:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.223512:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142656:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.223542:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1400832->2080767] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.223557:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf000, rc 0) 00000100:00100000:2.0:1746066816.223558:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985500928 00000100:00100000:2.0:1746066816.223564:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985500928 00000100:00100000:0.0:1746066816.223565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066816.223589:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 22 pid: 9592 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746066816.223590:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501056 00000100:00100000:0.0:1746066816.223594:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501056 00000100:00100000:1.0:1746066816.223597:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:3468:x1830882985500544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10034us (10840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.223606:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20596 00000100:00100000:2.0:1746066816.223611:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501184 00000100:00100000:2.0:1746066816.223613:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501184 00010000:00010000:2.0:1746066816.223622:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.223634:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9439 00000100:00100000:2.0:1746066816.223639:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985500928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.223649:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066816.223660:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9440 00010000:00010000:2.0:1746066816.223663:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 22 pid: 9592 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066816.223668:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985501184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.223672:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 22 pid: 9592 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.223676:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066816.223689:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfb19d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79ba expref: 22 pid: 9592 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746066816.223727:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 9 pid: 3528 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746066816.223743:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9441 00000100:00100000:0.0:1746066816.223747:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985501056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.223761:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1746066816.223761:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746066816.223763:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.223772:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.223779:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985500928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (332us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066816.223784:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfb1a60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f9 expref: 44 pid: 12233 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.223785:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9439 00010000:00010000:3.0:1746066816.223796:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066816.223855:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066816.223863:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 9 pid: 3528 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746066816.223870:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 9 pid: 3528 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.223909:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985500800:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8869us (9157us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066816.223920:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7745 00002000:00100000:2.0:1746066816.223928:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5764000 x1830882985500800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.223936:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764000 with x1830882985500800 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.223940:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5764000 00000100:00100000:3.0:1746066816.224006:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985501184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.224013:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9440 00010000:00010000:0.0:1746066816.224052:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec000/0xf1867c21abfb1948 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7966 expref: 9 pid: 3528 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746066816.224072:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.224074:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.224080:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.224087:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.224111:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066816.224120:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985142784:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066816.224186:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.225305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.225359:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501440 00000100:00100000:2.0:1746066816.225362:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501440 00002000:00100000:2.0:1746066816.225393:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->4194303) req@ffff8800a5767b80 x1830882985501440/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.225403:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767b80 with x1830882985501440 ext(3846144->4194303) 00010000:00010000:2.0:1746066816.225409:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.225418:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066816.225424:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5767b80 00000100:00100000:2.0:1746066816.225444:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2217 00000100:00100000:2.0:1746066816.225449:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985501440:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066816.227597:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985142784:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.227615:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.227650:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985501056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3899us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.227678:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9441 00000100:00100000:0.0:1746066816.227961:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.228025:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.228307:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501696 00000100:00100000:3.0:1746066816.228317:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501696 00002000:00100000:3.0:1746066816.228342:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->1404927) req@ffff8800a5766d80 x1830882985501696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.228351:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766d80 with x1830882985501696 ext(1400832->1404927) 00002000:00010000:3.0:1746066816.228355:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5766d80 00000100:00100000:3.0:1746066816.228421:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7746 00000100:00100000:1.0:1746066816.228423:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501824 00000100:00100000:1.0:1746066816.228427:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501824 00000100:00100000:3.0:1746066816.228428:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985501696:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066816.228453:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20597 00000100:00100000:1.0:1746066816.228457:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3466:x1830882985501824:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066816.228465:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.228478:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7aa8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.228496:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.228502:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.228507:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.228509:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.228511:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.228531:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066816.228534:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985501696:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 107us (574us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.228540:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7746 00010000:00010000:1.0:1746066816.228541:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 884 lvb_type: 1 00002000:00100000:3.0:1746066816.228545:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->1404927) req@ffff8800a5766d80 x1830882985501696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746066816.228550:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142912:192.168.204.16@tcp:104: 00002000:00100000:3.0:1746066816.228551:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766d80 with x1830882985501696 ext(1400832->1404927) 00002000:00010000:3.0:1746066816.228554:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5766d80 00010000:00010000:1.0:1746066816.228601:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.228608:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.228614:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.228630:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066816.229773:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985501440:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4321us (4465us total) trans 21474842774 rc 0/0 00000100:00100000:3.0:1746066816.229780:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2217 00002000:00100000:3.0:1746066816.229786:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->4194303) req@ffff8800a5767b80 x1830882985501440/t21474842774(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.229793:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767b80 with x1830882985501440 ext(3846144->4194303) 00010000:00010000:3.0:1746066816.229800:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.229809:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.229815:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5767b80 00000100:00100000:1.0:1746066816.230111:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985142912:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.230119:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143040:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.230137:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.230147:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf800, rc 0) 00000100:00100000:1.0:1746066816.230414:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3466:x1830882985501824:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1954us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.230420:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20597 00000100:00100000:0.0:1746066816.231007:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.231092:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502080 00000100:00100000:1.0:1746066816.231097:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502080 00010000:00010000:1.0:1746066816.231117:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.231149:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9442 00000100:00100000:1.0:1746066816.231155:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985502080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.231164:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066816.231175:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066816 -> 1746066817 00002000:00010000:1.0:1746066816.231177:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066816 -> 1746066817 00010000:00010000:1.0:1746066816.231181:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.231188:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.231206:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb1ba2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a93 expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.231228:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.231230:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.231236:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.231243:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.231264:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.231277:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985143168:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.231336:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.231754:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.231792:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985501952 00000100:00100000:3.0:1746066816.231795:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985501952 00010000:00010000:3.0:1746066816.231809:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066816.231834:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9443 00000100:00100000:3.0:1746066816.231839:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985501952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.231846:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.231857:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.231864:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.231876:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb1b71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a7e expref: 43 pid: 9591 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.231909:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.231938:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985501952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.231944:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9443 00000100:00100000:1.0:1746066816.232292:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985143168:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.232304:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.232335:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985502080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1179us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.232340:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9442 00000100:00100000:0.0:1746066816.232584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.232647:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502336 00000100:00100000:3.0:1746066816.232650:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502336 00002000:00100000:3.0:1746066816.232673:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1400831) req@ffff8800a5767480 x1830882985502336/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.232680:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767480 with x1830882985502336 ext(1048576->1400831) 00002000:00010000:3.0:1746066816.232684:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5767480 00000100:00100000:3.0:1746066816.232696:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7747 00000100:00100000:3.0:1746066816.232701:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985502336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066816.233517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.234026:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502464 00000100:00100000:1.0:1746066816.234030:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502464 00010000:00010000:1.0:1746066816.234044:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.234073:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9444 00000100:00100000:1.0:1746066816.234078:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985502464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.234085:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.234096:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.234105:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.234119:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66a00/0xf1867c21abfb1ae5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a46 expref: 22 pid: 9590 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.234134:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.234136:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.234139:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.234146:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.234165:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.234173:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143296:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.234211:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.234346:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.234398:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.234427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.234446:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.234457:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.234464:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985503104 00000100:00100000:2.0:1746066816.234468:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985503104 00000100:00100000:0.0:1746066816.234484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.234504:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502976 00000100:00100000:2.0:1746066816.234507:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502976 00000100:00100000:2.0:1746066816.234518:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985503232 00000100:00100000:2.0:1746066816.234520:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985503232 00000100:00100000:3.0:1746066816.234524:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502848 00000100:00100000:3.0:1746066816.234527:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502848 00000100:00100000:3.0:1746066816.234553:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:3.0:1746066816.234557:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985502848:12345-192.168.204.16@tcp:400:kworker.0 00000100:00080000:1.0:1746066816.234632:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746066816.234968:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1009 00000100:00100000:3.0:1746066816.234969:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985502848:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 409us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.234975:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 233 00000100:00100000:2.0:1746066816.234975:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985503104:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066816.235001:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985503104:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.235003:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985502720 00000100:00100000:3.0:1746066816.235006:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985502720 00000100:00100000:2.0:1746066816.235006:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1009 00000100:00100000:2.0:1746066816.235015:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1010 00000100:00100000:2.0:1746066816.235020:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985502976:12345-192.168.204.16@tcp:400:kworker.0 00002000:00100000:3.0:1746066816.235022:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (2076672->2080767) req@ffff880093c6b100 x1830882985502720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.235030:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b100 with x1830882985502720 ext(2076672->2080767) 00002000:00010000:3.0:1746066816.235033:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b100 00000100:00100000:2.0:1746066816.235036:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985502976:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 16us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.235041:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1010 00000100:00100000:3.0:1746066816.235044:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985503488 00000100:00100000:3.0:1746066816.235046:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985503488 00000100:00100000:2.0:1746066816.235048:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1011 00000100:00100000:2.0:1746066816.235052:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985503232:12345-192.168.204.16@tcp:400:kworker.0 00002000:00100000:3.0:1746066816.235058:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880093c69c00 x1830882985503488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066816.235066:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985503232:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 14us (607us total) trans 0 rc 0/0 00002000:00100000:3.0:1746066816.235068:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69c00 with x1830882985503488 ext(2097152->3145727) 00002000:00010000:3.0:1746066816.235070:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c69c00 00000100:00100000:2.0:1746066816.235070:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1011 00000100:00100000:1.0:1746066816.235138:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7748 00000100:00100000:1.0:1746066816.235144:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985502720:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066816.235367:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985502720:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 76us (874us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066816.235385:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7748 00002000:00100000:1.0:1746066816.235391:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (2076672->2080767) req@ffff880093c6b100 x1830882985502720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.235396:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b100 with x1830882985502720 ext(2076672->2080767) 00002000:00010000:1.0:1746066816.235399:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b100 00000100:00100000:1.0:1746066816.235411:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7749 00000100:00100000:1.0:1746066816.235416:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985503488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066816.237664:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143296:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.237681:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.237717:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985502464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3638us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.237725:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9444 00000100:00100000:3.0:1746066816.238686:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985502336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5982us (6099us total) trans 0 rc 352256/352256 00000100:00100000:3.0:1746066816.238693:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7747 00002000:00100000:3.0:1746066816.238700:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1400831) req@ffff8800a5767480 x1830882985502336/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 352256/352256 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.238708:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767480 with x1830882985502336 ext(1048576->1400831) 00002000:00010000:3.0:1746066816.238712:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5767480 00000100:00100000:0.0:1746066816.239035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.239144:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985503744 00000100:00100000:3.0:1746066816.239150:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985503744 00002000:00100000:3.0:1746066816.239172:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4476928->4481023) req@ffff880093c69880 x1830882985503744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.239180:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69880 with x1830882985503744 ext(4476928->4481023) 00002000:00010000:3.0:1746066816.239183:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69880 00000100:00100000:3.0:1746066816.239206:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7750 00000100:00100000:3.0:1746066816.239212:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985503744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.239288:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985503744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 77us (255us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.239294:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7750 00002000:00100000:3.0:1746066816.239298:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4476928->4481023) req@ffff880093c69880 x1830882985503744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.239304:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69880 with x1830882985503744 ext(4476928->4481023) 00002000:00010000:3.0:1746066816.239307:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c69880 00000100:00100000:1.0:1746066816.239425:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985503488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4008us (4940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066816.239431:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7749 00002000:00100000:1.0:1746066816.239436:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880093c69c00 x1830882985503488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.239442:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69c00 with x1830882985503488 ext(2097152->3145727) 00002000:00010000:1.0:1746066816.239445:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c69c00 00000100:00100000:0.0:1746066816.239733:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.239928:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985504000 00000100:00100000:3.0:1746066816.239931:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985504000 00000100:00100000:3.0:1746066816.239953:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6515 00000100:00100000:3.0:1746066816.239958:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:3468:x1830882985504000:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066816.240093:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:3468:x1830882985504000:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 134us (360us total) trans 8589937766 rc 0/0 00000100:00100000:3.0:1746066816.240099:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6515 00000100:00100000:2.0:1746066816.240339:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.240466:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985504256 00000100:00100000:3.0:1746066816.240469:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985504256 00002000:00100000:3.0:1746066816.240484:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (2080768->2097151) req@ffff8800967abb80 x1830882985504256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.240491:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882985504256 ext(2080768->2097151) 00002000:00010000:3.0:1746066816.240495:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:3.0:1746066816.240659:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7751 00000100:00100000:3.0:1746066816.240664:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985504256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.240927:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985504256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 262us (588us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1746066816.240933:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7751 00002000:00100000:3.0:1746066816.240938:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (2080768->2097151) req@ffff8800967abb80 x1830882985504256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/16824 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 16384/16384 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.240945:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882985504256 ext(2080768->2097151) 00002000:00010000:3.0:1746066816.240948:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:0.0:1746066816.241682:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.241765:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985504512 00000100:00100000:2.0:1746066816.241770:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985504512 00000100:00100000:2.0:1746066816.241804:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6516 00000100:00100000:2.0:1746066816.241810:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3466:x1830882985504512:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066816.242051:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3466:x1830882985504512:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 240us (369us total) trans 8589937767 rc 0/0 00000100:00100000:2.0:1746066816.242057:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6516 00000100:00100000:0.0:1746066816.242953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.242986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.243009:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985504640 00000100:00100000:1.0:1746066816.243014:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985504640 00000100:00100000:3.0:1746066816.243031:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985504768 00000100:00100000:3.0:1746066816.243035:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985504768 00000100:00100000:1.0:1746066816.243041:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20598 00000100:00100000:1.0:1746066816.243046:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985504640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.243055:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066816.243056:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20599 00000100:00100000:3.0:1746066816.243061:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985504768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.243068:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.243069:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfb1bbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7aaf expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.243077:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ab6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.243089:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.243090:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.243096:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066816.243106:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143424:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066816.243109:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.243116:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00000100:00100000:1.0:1746066816.243176:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066816.243303:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985504768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 240us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.243308:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20599 00002000:00010000:1.0:1746066816.244707:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066816 -> 1746066817 00002000:00010000:1.0:1746066816.244712:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066816 -> 1746066817 00002000:00010000:1.0:1746066816.244715:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066816 -> 1746066817 00000100:00100000:1.0:1746066816.244729:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143424:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066816.244754:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfb1bbe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aaf expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.244763:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfb1bbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aaf expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.244775:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf200, rc 0) 00000100:00100000:1.0:1746066816.244816:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985504640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1769us (1864us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.244822:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20598 00000100:00100000:0.0:1746066816.246099:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.246295:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505024 00000100:00100000:3.0:1746066816.246302:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505024 00002000:00100000:3.0:1746066816.246332:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e1180 x1830882985505024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.246341:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882985505024 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.246346:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1180 00000100:00100000:3.0:1746066816.246360:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7752 00000100:00100000:3.0:1746066816.246366:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985505024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.246833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.246876:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505152 00000100:00100000:1.0:1746066816.246904:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505152 00000100:00100000:1.0:1746066816.246937:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20600 00000100:00100000:1.0:1746066816.246943:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:3473:x1830882985505152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.246950:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.246962:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7abd expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.246980:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.246986:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.246988:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.246990:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.247015:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.247026:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 22 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.247035:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.247096:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.249847:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985143552:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.249880:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.249918:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafc00, rc 0) 00000100:00100000:1.0:1746066816.249957:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:3473:x1830882985505152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3013us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.249965:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20600 00000100:00100000:2.0:1746066816.252299:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.252343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.252394:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.252449:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505280 00000100:00100000:3.0:1746066816.252458:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505280 00000100:00100000:0.0:1746066816.252461:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505536 00000100:00100000:0.0:1746066816.252468:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505536 00002000:00100000:3.0:1746066816.252495:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4481023) req@ffff8800967a9f80 x1830882985505280/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.252505:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882985505280 ext(4194304->4481023) 00000100:00100000:0.0:1746066816.252508:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20601 00010000:00010000:3.0:1746066816.252512:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.252516:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3474:x1830882985505536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.252526:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.252532:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967a9f80 00000100:00100000:3.0:1746066816.252554:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505664 00000100:00100000:3.0:1746066816.252557:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505664 00000100:00100000:2.0:1746066816.252566:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2218 00002000:00100000:3.0:1746066816.252571:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800967a8380 x1830882985505664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066816.252574:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985505280:12345-192.168.204.16@tcp:4:cat.0 00002000:00100000:3.0:1746066816.252578:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882985505664 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.252581:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:3.0:1746066816.252593:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7753 00000100:00100000:3.0:1746066816.252600:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985505664:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066816.252624:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066816.252640:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ac4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.252664:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066816.252667:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066816.252671:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.252680:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.252691:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c800, rc 0) 00000100:00100000:0.0:1746066816.252710:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3474:x1830882985505536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066816.252716:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20601 00000100:00100000:3.0:1746066816.254173:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985505024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7802us (8071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066816.254182:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7752 00002000:00100000:3.0:1746066816.254189:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e1180 x1830882985505024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.254201:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882985505024 ext(3145728->4194303) 00010000:00010000:3.0:1746066816.254207:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.254218:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.254224:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e1180 00000100:00100000:3.0:1746066816.257572:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985505280:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4992us (5277us total) trans 17179875420 rc 0/0 00000100:00100000:3.0:1746066816.257584:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2218 00002000:00100000:3.0:1746066816.257593:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4481023) req@ffff8800967a9f80 x1830882985505280/t17179875420(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.257602:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882985505280 ext(4194304->4481023) 00010000:00010000:3.0:1746066816.257610:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.257623:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 24 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.257629:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967a9f80 00000100:00100000:3.0:1746066816.258443:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985505664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5841us (6045us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066816.258450:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7753 00002000:00100000:3.0:1746066816.258457:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800967a8380 x1830882985505664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.258464:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882985505664 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.258467:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000001:00080000:2.0:1746066816.259212:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875420 is committed 00000001:00080000:2.0:1746066816.259222:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875419 is committed 00000001:00080000:2.0:1746066816.259229:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875417 is committed 00000100:00100000:0.0:1746066816.261185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.261247:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985505792 00000100:00100000:1.0:1746066816.261256:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985505792 00010000:00010000:1.0:1746066816.261287:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.261325:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9445 00000100:00100000:1.0:1746066816.261332:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985505792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.261343:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.261359:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.261370:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.261403:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf800/0xf1867c21abfb1bb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa8 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.261424:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.261425:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.261431:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.261438:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.261446:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.261447:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.261450:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.261456:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.261545:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.261556:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143680:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.261784:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.261792:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143808:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.261813:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.262863:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143680:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.262873:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985143808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.262914:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.262949:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985505792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1616us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.262956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9445 00000100:00100000:0.0:1746066816.264588:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.265125:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985506048 00000100:00100000:3.0:1746066816.265135:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985506048 00002000:00100000:3.0:1746066816.265170:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e0e00 x1830882985506048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.265179:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0e00 with x1830882985506048 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.265184:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0e00 00000100:00100000:3.0:1746066816.265214:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7754 00000100:00100000:3.0:1746066816.265220:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985506048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.271216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.271252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.271406:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985506304 00000100:00100000:3.0:1746066816.271414:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985506304 00002000:00100000:3.0:1746066816.271449:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800966e2680 x1830882985506304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.271458:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882985506304 ext(2097152->4194303) 00002000:00010000:3.0:1746066816.271463:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2680 00000100:00100000:3.0:1746066816.271479:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985506560 00000100:00100000:3.0:1746066816.271481:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985506560 00002000:00100000:3.0:1746066816.271492:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800966e2d80 x1830882985506560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.271498:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882985506560 ext(2097152->4194303) 00002000:00010000:3.0:1746066816.271501:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2d80 00000100:00100000:3.0:1746066816.271511:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7755 00000100:00100000:3.0:1746066816.271518:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985506304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066816.271531:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7756 00000100:00100000:2.0:1746066816.271539:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985506560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.272130:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985506048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6908us (7550us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066816.272137:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7754 00002000:00100000:0.0:1746066816.272153:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e0e00 x1830882985506048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066816.272160:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0e00 with x1830882985506048 ext(3145728->4194303) 00002000:00010000:0.0:1746066816.272164:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0e00 00000100:00100000:0.0:1746066816.280798:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.280821:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985506688 00000100:00100000:0.0:1746066816.280828:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985506688 00000100:00100000:1.0:1746066816.281004:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.281021:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985506816 00000100:00100000:2.0:1746066816.281025:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985506816 00000100:00100000:2.0:1746066816.281053:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20602 00000100:00100000:2.0:1746066816.281060:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985506688:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066816.281061:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985506304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9541us (9849us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066816.281070:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7755 00010000:00010000:2.0:1746066816.281074:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746066816.281078:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800966e2680 x1830882985506304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.281088:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882985506304 ext(2097152->4194303) 00010000:00010000:2.0:1746066816.281089:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7acb expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066816.281092:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2680 00010000:00010000:2.0:1746066816.281108:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.281109:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.281116:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066816.281123:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20603 00010000:00010000:2.0:1746066816.281128:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066816.281130:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985506816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.281138:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.281138:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779e00, rc 0) 00010000:00010000:3.0:1746066816.281146:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfb1be1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ad2 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.281155:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985506688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.281161:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20602 00000100:00100000:3.0:1746066816.281189:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985143936:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066816.281479:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00002000:00010000:3.0:1746066816.283243:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066816 -> 1746066817 00002000:00010000:3.0:1746066816.283249:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066816 -> 1746066817 00002000:00010000:3.0:1746066816.283251:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066816 -> 1746066817 00000100:00100000:3.0:1746066816.283267:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985143936:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066816.283291:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfb1be1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ad2 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.283302:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfb1be1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ad2 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.283328:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:3.0:1746066816.283371:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985506816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2240us (2366us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066816.283390:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20603 00000100:00100000:2.0:1746066816.285690:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985506560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14145us (14429us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066816.285705:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7756 00002000:00100000:2.0:1746066816.285714:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800966e2d80 x1830882985506560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.285723:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882985506560 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.285728:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2d80 00000100:00100000:0.0:1746066816.288343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.288429:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507072 00000100:00100000:2.0:1746066816.288440:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507072 00002000:00100000:2.0:1746066816.288482:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800966e1f80 x1830882985507072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.288492:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882985507072 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.288497:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:2.0:1746066816.288532:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7757 00000100:00100000:2.0:1746066816.288540:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985507072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.292735:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.293036:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985507072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4494us (4701us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066816.293046:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7757 00002000:00100000:2.0:1746066816.293056:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800966e1f80 x1830882985507072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.293064:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882985507072 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.293068:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:2.0:1746066816.293086:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507328 00000100:00100000:2.0:1746066816.293091:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507328 00002000:00100000:2.0:1746066816.293113:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800966e1880 x1830882985507328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.293118:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985507328 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.293121:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:2.0:1746066816.293143:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7758 00000100:00100000:2.0:1746066816.293147:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985507328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.297217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.297777:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507456 00000100:00100000:3.0:1746066816.297786:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507456 00000100:00100000:0.0:1746066816.297879:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20604 00000100:00100000:0.0:1746066816.298087:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2013:x1830882985507456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066816.298109:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066816.298127:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009575bc00/0xf1867c21abfb1be8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ad9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.298169:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985507328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5012us (5432us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066816.298180:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7758 00000100:00100000:0.0:1746066816.298180:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144064:192.168.204.16@tcp:106: 00002000:00100000:2.0:1746066816.298191:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800966e1880 x1830882985507328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.298200:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985507328 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.298204:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:0.0:1746066816.298354:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.299310:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144064:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066816.299336:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009575bc00/0xf1867c21abfb1be8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ad9 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.299347:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009575bc00/0xf1867c21abfb1be8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ad9 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.299475:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575bc00, rc 0) 00000100:00100000:2.0:1746066816.299651:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2013:x1830882985507456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1566us (2723us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066816.299657:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20604 00000100:00100000:0.0:1746066816.302177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.302266:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507584 00000100:00100000:2.0:1746066816.302274:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507584 00000100:00100000:2.0:1746066816.302325:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20605 00000100:00100000:2.0:1746066816.302333:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985507584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.302382:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.302400:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1bef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ae0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.302454:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144192:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066816.302747:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.305121:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144192:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066816.305150:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1bef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ae0 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.305164:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1bef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ae0 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.305185:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778a00, rc 0) 00000100:00100000:2.0:1746066816.305234:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985507584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2900us (3065us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066816.305241:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20605 00000100:00100000:0.0:1746066816.360513:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.360959:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507840 00000100:00100000:3.0:1746066816.360968:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507840 00000100:00100000:3.0:1746066816.361029:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17287 00000100:00100000:3.0:1746066816.361037:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3480:x1830882985507840:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.361062:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.361080:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ae7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.361159:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361171:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361182:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361195:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361199:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361204:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361298:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361306:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361312:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.361320:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.361395:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361401:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361406:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361412:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.361416:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361422:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361432:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.361434:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066816.361438:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361443:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfb1c0b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361479:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361484:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361488:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361492:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361495:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.361497:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361501:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361506:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.361508:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.361510:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361513:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361521:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361525:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361528:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361532:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.361534:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361538:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361542:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34e400) 00010000:00010000:3.0:1746066816.361544:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.361546:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361549:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.361584:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1bf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ae7 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.361590:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ae7 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.361596:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8800, rc 0) 00000100:00100000:3.0:1746066816.361660:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3480:x1830882985507840:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 624us (1159us total) trans 8589937768 rc 301/301 00000100:00100000:3.0:1746066816.361667:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17287 00000100:00100000:0.0:1746066816.441558:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.442173:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985507968 00000100:00100000:2.0:1746066816.442182:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985507968 00000100:00100000:2.0:1746066816.442243:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20606 00000100:00100000:2.0:1746066816.442251:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3480:x1830882985507968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066816.442270:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.442289:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7aee expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.442320:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.442330:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 18 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.442335:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.442337:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.442340:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.442382:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 18 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.442394:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 18 pid: 13726 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.442406:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985144320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.442516:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.442523:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.442531:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985144448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.442548:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.446355:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985144320:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.446383:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985144448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.446415:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.446440:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778400, rc 0) 00000100:00100000:2.0:1746066816.446500:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3480:x1830882985507968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4249us (4953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.446508:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20606 00000100:00100000:0.0:1746066816.448703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.448750:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.448778:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508096 00000100:00100000:1.0:1746066816.448788:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508096 00010000:00010000:1.0:1746066816.448826:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.448868:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508224 00000100:00100000:1.0:1746066816.448871:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508224 00010000:00010000:1.0:1746066816.448910:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746066816.449067:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9446 00000100:00100000:2.0:1746066816.449074:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9447 00000100:00100000:1.0:1746066816.449075:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985508096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066816.449083:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882985508224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.449090:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.449090:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066816.449108:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066816.449109:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.449120:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066816.449133:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.449195:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfb1bc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ab6 expref: 19 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746066816.449201:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfb1ba9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a9a expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.449218:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.449220:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.449227:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.449236:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.449293:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066816.449314:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.449327:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985144576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066816.449332:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985508224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 250us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.449339:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9447 00000100:00100000:1.0:1746066816.449640:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.450777:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985144576:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.450795:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.450828:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985508096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1754us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.450835:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9446 00000100:00100000:0.0:1746066816.451099:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.451544:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508480 00000100:00100000:3.0:1746066816.451556:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508480 00002000:00100000:3.0:1746066816.451599:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3080191) req@ffff8800966e3800 x1830882985508480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.451615:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985508480 ext(3076096->3080191) 00002000:00010000:3.0:1746066816.451620:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3800 00000100:00100000:3.0:1746066816.452109:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7759 00000100:00100000:3.0:1746066816.452117:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985508480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.452258:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985508480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 141us (1159us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.452264:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7759 00002000:00100000:3.0:1746066816.452270:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3080191) req@ffff8800966e3800 x1830882985508480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.452277:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985508480 ext(3076096->3080191) 00002000:00010000:3.0:1746066816.452281:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3800 00000100:00100000:2.0:1746066816.456581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.456636:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508608 00000100:00100000:0.0:1746066816.456644:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508608 00000100:00100000:0.0:1746066816.456700:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20607 00000100:00100000:0.0:1746066816.456707:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:3480:x1830882985508608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066816.457007:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066816.457022:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7af5 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457048:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457056:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457062:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.457063:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066816.457066:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->3833855] (req 3145728->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457090:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457099:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.457109:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066816.457203:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.457210:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 26 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746066816.457217:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066816.457234:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.458048:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.458447:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508864 00000100:00100000:3.0:1746066816.458452:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508864 00000100:00100000:3.0:1746066816.458485:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17288 00000100:00100000:3.0:1746066816.458491:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:3482:x1830882985508864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.458504:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.458516:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7afc expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.458568:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458577:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458585:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458595:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458599:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458604:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458963:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458970:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.458975:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.458982:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:1.0:1746066816.459043:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.459052:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985144832:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.459072:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->3833855] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.459083:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b600, rc 0) 00010000:00010000:3.0:1746066816.459300:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459307:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459312:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066816.459346:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3480:x1830882985508608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2638us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.459352:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20607 00010000:00010000:3.0:1746066816.459402:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.459406:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459412:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459421:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.459424:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066816.459427:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459432:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c3c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459605:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459610:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459614:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459619:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459622:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.459625:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459629:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459636:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.459638:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.459640:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459644:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfb1c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459652:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459656:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459660:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459663:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.459665:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459668:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459673:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34e700) 00010000:00010000:3.0:1746066816.459675:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.459677:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459680:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfb1c35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.459710:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1c27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7afc expref: 38 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.459715:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfb1c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7afc expref: 38 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.459721:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8a00, rc 0) 00000100:00100000:3.0:1746066816.460208:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3482:x1830882985508864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1716us (2161us total) trans 8589937769 rc 301/301 00000100:00100000:3.0:1746066816.460214:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17288 00000100:00100000:0.0:1746066816.464835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.464944:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985508992 00000100:00100000:1.0:1746066816.464953:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985508992 00010000:00010000:1.0:1746066816.464983:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.465023:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9448 00000100:00100000:1.0:1746066816.465030:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985508992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.465040:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.465056:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.465066:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.465084:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfb1bcc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7abd expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.465110:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.465160:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985508992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.465167:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9448 00000100:00100000:0.0:1746066816.466690:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.467115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.467145:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985509120 00000100:00100000:1.0:1746066816.467151:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985509120 00010000:00010000:1.0:1746066816.467176:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.467186:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985509248 00000100:00100000:2.0:1746066816.467193:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985509248 00000100:00100000:1.0:1746066816.467230:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9449 00000100:00100000:1.0:1746066816.467236:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985509120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.467245:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.467259:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.467270:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.467286:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfb1bd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ac4 expref: 8 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.467297:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.467299:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.467305:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.467313:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.467343:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.467347:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20608 00000100:00100000:2.0:1746066816.467352:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:3482:x1830882985509248:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746066816.467355:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985144960:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066816.467363:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.467385:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b03 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.467400:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.467405:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066816.467407:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746066816.467430:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00010000:00010000:2.0:1746066816.467507:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3915776->4038655] (req 3915776->4038655) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.467524:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.467533:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.467541:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985145088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.467571:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.468844:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985145088:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066816.468862:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3915776->4038655] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.468870:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985144960:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066816.468873:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778000, rc 0) 00010000:00010000:1.0:1746066816.468880:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.468923:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985509120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1687us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066816.468923:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:3482:x1830882985509248:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1570us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066816.468929:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20608 00000100:00100000:1.0:1746066816.468930:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9449 00000100:00100000:0.0:1746066816.474927:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.475034:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985509504 00000100:00100000:2.0:1746066816.475043:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985509504 00002000:00100000:2.0:1746066816.475099:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3829760->3833855) req@ffff8800a5826a00 x1830882985509504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.475114:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5826a00 with x1830882985509504 ext(3829760->3833855) 00010000:00010000:2.0:1746066816.475123:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.475137:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066816.475143:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5826a00 00000100:00100000:2.0:1746066816.475179:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2219 00000100:00100000:2.0:1746066816.475186:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2014:x1830882985509504:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066816.475382:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2014:x1830882985509504:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 182us (494us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066816.475389:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2219 00002000:00100000:2.0:1746066816.475395:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3829760->3833855) req@ffff8800a5826a00 x1830882985509504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.475402:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5826a00 with x1830882985509504 ext(3829760->3833855) 00010000:00010000:2.0:1746066816.475406:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.475415:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066816.475421:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5826a00 00000100:00100000:0.0:1746066816.478212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.478260:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.478387:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985510016 00000100:00100000:3.0:1746066816.478397:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985510016 00000100:00100000:2.0:1746066816.478422:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985509888 00000100:00100000:2.0:1746066816.478427:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985509888 00000100:00100000:2.0:1746066816.478476:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6517 00000100:00100000:2.0:1746066816.478484:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3480:x1830882985509888:12345-192.168.204.16@tcp:35:multiop.0 00002000:00100000:3.0:1746066816.478551:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3833855) req@ffff8800a5827480 x1830882985510016/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.478560:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827480 with x1830882985510016 ext(3145728->3833855) 00010000:00010000:3.0:1746066816.478568:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.478580:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 7 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.478586:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5827480 00000100:00100000:3.0:1746066816.478602:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2220 00000100:00100000:3.0:1746066816.478607:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985510016:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066816.478690:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3480:x1830882985509888:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 206us (485us total) trans 8589937770 rc 0/0 00000100:00100000:2.0:1746066816.478696:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6517 00000100:00100000:3.0:1746066816.484393:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985510016:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5759us (6106us total) trans 17179875421 rc 0/0 00000100:00100000:3.0:1746066816.484409:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2220 00002000:00100000:3.0:1746066816.484422:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3833855) req@ffff8800a5827480 x1830882985510016/t17179875421(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.484434:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827480 with x1830882985510016 ext(3145728->3833855) 00010000:00010000:3.0:1746066816.484446:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.484465:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.484472:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5827480 00000100:00100000:0.0:1746066816.486066:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.486138:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985510144 00000100:00100000:1.0:1746066816.486146:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985510144 00010000:00010000:1.0:1746066816.486179:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.486218:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9450 00000100:00100000:1.0:1746066816.486226:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985510144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.486237:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.486254:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.486265:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.486288:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfb1c20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7af5 expref: 9 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.486317:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.486319:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.486324:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.486331:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.486358:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.486380:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985145216:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.486470:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.488039:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985145216:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066816.488041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066816.488056:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.488093:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985510400 00000100:00100000:1.0:1746066816.488099:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985510144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1874us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.488102:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985510400 00000100:00100000:1.0:1746066816.488107:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9450 00002000:00100000:3.0:1746066816.488133:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->3919871) req@ffff8800a5825500 x1830882985510400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.488141:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825500 with x1830882985510400 ext(3915776->3919871) 00002000:00010000:3.0:1746066816.488144:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5825500 00000100:00100000:3.0:1746066816.488177:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7760 00000100:00100000:3.0:1746066816.488182:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985510400:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.488501:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985510400:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 317us (466us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.488509:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7760 00002000:00100000:3.0:1746066816.488514:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->3919871) req@ffff8800a5825500 x1830882985510400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.488520:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825500 with x1830882985510400 ext(3915776->3919871) 00002000:00010000:3.0:1746066816.488523:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5825500 00000100:00100000:0.0:1746066816.490145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.490223:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985510656 00000100:00100000:3.0:1746066816.490230:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985510656 00002000:00100000:3.0:1746066816.490258:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4034560->4038655) req@ffff8800a5825c00 x1830882985510656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.490270:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825c00 with x1830882985510656 ext(4034560->4038655) 00002000:00010000:3.0:1746066816.490274:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5825c00 00000100:00100000:3.0:1746066816.490328:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7761 00000100:00100000:3.0:1746066816.490335:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985510656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.490513:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985510656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 177us (372us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.490519:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7761 00002000:00100000:3.0:1746066816.490525:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4034560->4038655) req@ffff8800a5825c00 x1830882985510656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.490531:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5825c00 with x1830882985510656 ext(4034560->4038655) 00002000:00010000:3.0:1746066816.490534:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5825c00 00000100:00100000:0.0:1746066816.492854:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.492916:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985510912 00000100:00100000:2.0:1746066816.492924:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985510912 00000100:00100000:2.0:1746066816.492976:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6518 00000100:00100000:2.0:1746066816.492983:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3482:x1830882985510912:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066816.493144:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3482:x1830882985510912:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 161us (295us total) trans 8589937771 rc 0/0 00000100:00100000:2.0:1746066816.493150:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6518 00000100:00100000:0.0:1746066816.515979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.516035:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985511168 00000100:00100000:3.0:1746066816.516044:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985511168 00000100:00100000:3.0:1746066816.516098:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17289 00000100:00100000:3.0:1746066816.516105:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3488:x1830882985511168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.516123:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.516138:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b0a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.516197:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516209:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516219:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516233:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516238:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516243:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516321:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516329:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516335:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.516342:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.516411:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516417:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516422:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516427:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.516431:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516436:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516446:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.516449:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066816.516452:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516457:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516485:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516490:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516494:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516499:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516502:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.516504:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516509:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516515:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.516517:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.516519:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516523:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516531:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516535:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516540:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516544:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.516546:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516550:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516556:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34ed00) 00010000:00010000:3.0:1746066816.516558:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.516560:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516564:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.516599:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b0a expref: 40 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.516606:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b0a expref: 40 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.516613:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9c00, rc 0) 00000100:00100000:3.0:1746066816.516663:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:3488:x1830882985511168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 558us (691us total) trans 8589937772 rc 301/301 00000100:00100000:3.0:1746066816.516669:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17289 00000100:00100000:0.0:1746066816.517876:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.517972:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985511424 00000100:00100000:2.0:1746066816.517978:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985511424 00000100:00100000:2.0:1746066816.518007:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6519 00000100:00100000:2.0:1746066816.518012:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:3488:x1830882985511424:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066816.518138:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:3488:x1830882985511424:12345-192.168.204.16@tcp:35:cat.0 Request processed in 125us (266us total) trans 8589937773 rc 0/0 00000100:00100000:2.0:1746066816.518144:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6519 00000100:00100000:0.0:1746066816.519572:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.519644:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985511552 00000100:00100000:2.0:1746066816.519650:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985511552 00000100:00100000:2.0:1746066816.519694:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20609 00000100:00100000:2.0:1746066816.519700:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985511552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.519712:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.519726:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xf1867c21abfb1c74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b11 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.519773:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985145344:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066816.519861:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.521097:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.521154:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985511808 00000100:00100000:3.0:1746066816.521164:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985511808 00000100:00100000:3.0:1746066816.521220:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17290 00000100:00100000:3.0:1746066816.521227:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3490:x1830882985511808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.521248:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.521263:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b18 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.521345:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521358:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521381:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521395:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521401:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521406:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521497:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521505:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521511:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.521520:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.521583:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521589:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521595:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521601:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.521605:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521611:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521621:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.521623:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066816.521626:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521631:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfb1c90 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521666:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521672:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521680:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521684:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521688:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.521690:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521694:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521699:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.521701:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.521703:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521707:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb1c82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521713:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521717:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521721:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521725:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.521727:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521734:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521740:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34e600) 00010000:00010000:3.0:1746066816.521741:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.521743:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521746:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb1c89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.521776:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b18 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.521782:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb1c7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b18 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.521788:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00000100:00100000:3.0:1746066816.521841:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3490:x1830882985511808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 614us (746us total) trans 8589937774 rc 301/301 00000100:00100000:3.0:1746066816.521847:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17290 00002000:00010000:3.0:1746066816.521914:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066816 -> 1746066817 00000100:00100000:3.0:1746066816.521930:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985145344:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066816.521952:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xf1867c21abfb1c74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b11 expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.521961:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xf1867c21abfb1c74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b11 expref: 19 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.521973:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779600, rc 0) 00000100:00100000:3.0:1746066816.521998:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985511552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2298us (2430us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066816.522004:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20609 00000100:00100000:0.0:1746066816.523713:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.523794:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512064 00000100:00100000:2.0:1746066816.523802:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512064 00000100:00100000:2.0:1746066816.523835:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6520 00000100:00100000:2.0:1746066816.523841:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3490:x1830882985512064:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066816.524030:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3490:x1830882985512064:12345-192.168.204.16@tcp:35:cat.0 Request processed in 187us (321us total) trans 8589937775 rc 0/0 00000100:00100000:2.0:1746066816.524037:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6520 00000100:00100000:0.0:1746066816.529111:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.529172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.529218:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512192 00000100:00100000:1.0:1746066816.529227:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512320 00000100:00100000:3.0:1746066816.529229:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512192 00000100:00100000:1.0:1746066816.529232:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512320 00000100:00100000:3.0:1746066816.529300:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20610 00000100:00100000:3.0:1746066816.529307:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985512320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.529321:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.529336:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1c9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b26 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.529354:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20611 00000100:00100000:1.0:1746066816.529361:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985512192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.529384:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.529392:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356be00/0xf1867c21abfb1ca5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b1f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.529393:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985145472:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066816.529416:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985145600:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066816.529494:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.529501:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.531224:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.531305:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512576 00000100:00100000:3.0:1746066816.531315:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512576 00002000:00100000:3.0:1746066816.531347:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880094305880 x1830882985512576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.531355:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830882985512576 ext(2097152->3145727) 00002000:00010000:3.0:1746066816.531359:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:3.0:1746066816.531398:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7762 00000100:00100000:3.0:1746066816.531404:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985512576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066816.531902:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985145472:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066816.531905:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985145600:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066816.531928:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1c9e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b26 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.531928:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356be00/0xf1867c21abfb1ca5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b1f expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.531938:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778a00/0xf1867c21abfb1c9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b26 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.531938:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356be00/0xf1867c21abfb1ca5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b1f expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.531964:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356be00, rc 0) 00010000:00010000:2.0:1746066816.531965:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778a00, rc 0) 00000100:00100000:2.0:1746066816.531992:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985512320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2685us (2820us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.531996:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985512192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2635us (2896us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066816.532000:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20610 00000100:00100000:1.0:1746066816.532003:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20611 00000100:00100000:3.0:1746066816.535131:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985512576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3720us (3903us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066816.535144:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7762 00002000:00100000:3.0:1746066816.535154:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880094305880 x1830882985512576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.535162:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830882985512576 ext(2097152->3145727) 00002000:00010000:3.0:1746066816.535166:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:0.0:1746066816.538092:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.538149:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.538227:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512704 00000100:00100000:2.0:1746066816.538228:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985512960 00000100:00100000:2.0:1746066816.538237:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512960 00000100:00100000:1.0:1746066816.538237:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985512704 00002000:00100000:2.0:1746066816.538273:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5827100 x1830882985512960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.538283:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827100 with x1830882985512960 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.538287:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5827100 00000100:00100000:1.0:1746066816.538288:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20612 00000100:00100000:1.0:1746066816.538296:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+18:3488:x1830882985512704:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066816.538301:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7763 00000100:00100000:2.0:1746066816.538306:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985512960:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066816.538308:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.538323:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b2d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.538348:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.538355:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.538356:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.538359:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.538396:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.538406:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 10 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.538417:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985145728:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.538502:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.541095:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.541168:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985145728:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.541194:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.541208:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c000, rc 0) 00000100:00100000:3.0:1746066816.541263:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513088 00000100:00100000:3.0:1746066816.541269:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513088 00002000:00100000:3.0:1746066816.541298:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3145727) req@ffff8800a5d82300 x1830882985513088/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.541306:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882985513088 ext(3076096->3145727) 00010000:00010000:3.0:1746066816.541312:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.541322:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.541328:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d82300 00000100:00100000:3.0:1746066816.541347:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2221 00000100:00100000:1.0:1746066816.541349:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+19:3488:x1830882985512704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3053us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.541353:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985513088:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066816.541357:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20612 00000100:00100000:2.0:1746066816.544750:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985512960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6436us (6593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066816.544761:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7763 00002000:00100000:2.0:1746066816.544769:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5827100 x1830882985512960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.544778:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5827100 with x1830882985512960 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.544783:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5827100 00000100:00100000:3.0:1746066816.545591:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985513088:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4236us (4500us total) trans 21474842775 rc 0/0 00000100:00100000:3.0:1746066816.545598:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2221 00002000:00100000:3.0:1746066816.545604:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3145727) req@ffff8800a5d82300 x1830882985513088/t21474842775(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.545616:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882985513088 ext(3076096->3145727) 00010000:00010000:3.0:1746066816.545623:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.545634:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.545640:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d82300 00000100:00100000:0.0:1746066816.547295:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.547354:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513216 00000100:00100000:1.0:1746066816.547362:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513216 00010000:00010000:1.0:1746066816.547402:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.547436:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9451 00000100:00100000:1.0:1746066816.547441:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985513216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.547452:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.547467:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.547477:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.547493:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb1c19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aee expref: 12 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.547515:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.547516:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.547526:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.547533:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.547561:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.547570:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985145856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.547634:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.548998:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985145856:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.549016:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.549039:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985513216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1597us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.549046:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9451 00000100:00100000:0.0:1746066816.549788:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.549968:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513344 00000100:00100000:1.0:1746066816.549972:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513344 00000100:00100000:1.0:1746066816.550068:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20613 00000100:00100000:1.0:1746066816.550074:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3490:x1830882985513344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.550087:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.550101:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b34 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.550124:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.550131:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.550133:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.550136:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.550156:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.550166:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 26 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.550179:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985145984:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.550229:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.551467:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985145984:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.551486:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.551496:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d600, rc 0) 00000100:00100000:1.0:1746066816.551534:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3490:x1830882985513344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1459us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.551539:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20613 00000100:00100000:0.0:1746066816.551962:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.552027:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513472 00000100:00100000:3.0:1746066816.552032:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513472 00002000:00100000:3.0:1746066816.552060:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->2080767) req@ffff8800a5d83100 x1830882985513472/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.552068:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830882985513472 ext(1400832->2080767) 00010000:00010000:3.0:1746066816.552074:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.552085:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 27 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.552092:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83100 00000100:00100000:3.0:1746066816.552118:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2222 00000100:00100000:3.0:1746066816.552124:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985513472:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066816.554061:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.554105:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.554151:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513984 00000100:00100000:1.0:1746066816.554157:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513984 00000100:00100000:3.0:1746066816.554170:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985513856 00000100:00100000:3.0:1746066816.554174:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985513856 00002000:00100000:1.0:1746066816.554187:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880094371180 x1830882985513984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 504/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.554191:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011d855f80 x1830882985513856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.554196:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371180 with x1830882985513984 ext(3145728->4194303) 00002000:00100000:3.0:1746066816.554199:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855f80 with x1830882985513856 ext(2097152->4194303) 00002000:00010000:1.0:1746066816.554200:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371180 00002000:00010000:3.0:1746066816.554202:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855f80 00000100:00100000:3.0:1746066816.554247:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7764 00000100:00100000:3.0:1746066816.554255:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985513984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.554310:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7765 00000100:00100000:0.0:1746066816.554317:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985513856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.560192:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985513472:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8060us (8223us total) trans 17179875422 rc 0/0 00000100:00100000:3.0:1746066816.560203:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2222 00002000:00100000:3.0:1746066816.560215:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1400832->2080767) req@ffff8800a5d83100 x1830882985513472/t17179875422(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.560226:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830882985513472 ext(1400832->2080767) 00010000:00010000:3.0:1746066816.560236:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.560249:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746066816.560255:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83100 00000100:00100000:3.0:1746066816.564113:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985513984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9850us (10048us total) trans 0 rc 925696/925696 00000100:00100000:3.0:1746066816.564235:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7764 00002000:00100000:3.0:1746066816.564247:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880094371180 x1830882985513984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 504/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.564255:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371180 with x1830882985513984 ext(3145728->4194303) 00002000:00010000:3.0:1746066816.564261:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371180 00000100:00100000:0.0:1746066816.565481:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.565550:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985514112 00000100:00100000:1.0:1746066816.565558:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985514112 00010000:00010000:1.0:1746066816.565584:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.565595:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985513856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11277us (11488us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066816.565603:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7765 00002000:00100000:2.0:1746066816.565609:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011d855f80 x1830882985513856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.565616:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855f80 with x1830882985513856 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.565619:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d855f80 00000100:00100000:1.0:1746066816.565619:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9452 00000100:00100000:1.0:1746066816.565626:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985514112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.565636:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.565651:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.565661:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.565679:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf000/0xf1867c21abfb1bb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7aa1 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.566013:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.566015:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.566021:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.566030:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.566062:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.566072:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146112:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.566132:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.567036:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146112:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.567064:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.567097:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985514112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1471us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.567107:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9452 00000100:00100000:0.0:1746066816.570056:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.570099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.570124:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985514368 00000100:00100000:2.0:1746066816.570133:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985514368 00000100:00100000:3.0:1746066816.570155:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985514624 00000100:00100000:3.0:1746066816.570160:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985514624 00002000:00100000:2.0:1746066816.570169:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830882985514368/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.570178:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5d80e00 x1830882985514624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.570178:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830882985514368 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.570182:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80700 00002000:00100000:3.0:1746066816.570186:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882985514624 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.570190:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:2.0:1746066816.570212:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7766 00000100:00100000:2.0:1746066816.570218:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985514368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.570223:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7767 00000100:00100000:3.0:1746066816.570229:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882985514624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.573537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.573666:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985514752 00000100:00100000:1.0:1746066816.573678:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985514752 00000100:00100000:1.0:1746066816.573744:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20614 00000100:00100000:1.0:1746066816.573750:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882985514752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.573767:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.573783:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b3b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.573806:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.573809:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.573817:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.573832:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.573843:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0cc00, rc 0) 00000100:00100000:1.0:1746066816.573930:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985514752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.573936:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20614 00000100:00100000:3.0:1746066816.576975:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882985514624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6739us (6868us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066816.576983:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7767 00002000:00100000:3.0:1746066816.576992:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5d80e00 x1830882985514624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.576998:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882985514624 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.577002:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:2.0:1746066816.577940:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985514368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7720us (7889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066816.577947:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7766 00002000:00100000:2.0:1746066816.577952:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830882985514368/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.577960:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830882985514368 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.577964:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80700 00000100:00100000:0.0:1746066816.581533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.581575:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.581622:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985514880 00000100:00100000:3.0:1746066816.581628:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985514880 00000100:00100000:1.0:1746066816.581646:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515008 00000100:00100000:1.0:1746066816.581650:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515008 00000100:00100000:3.0:1746066816.581668:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20615 00000100:00100000:1.0:1746066816.581673:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20616 00000100:00100000:3.0:1746066816.581674:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985514880:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066816.581678:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985515008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.581687:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.581687:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.581700:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b49 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.581701:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1cc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b42 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.581748:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146240:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066816.581811:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00010000:00010000:1.0:1746066816.581938:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.581941:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.581948:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.581961:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.581971:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c800, rc 0) 00000100:00100000:1.0:1746066816.581993:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985515008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 315us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.581999:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20616 00000100:00100000:3.0:1746066816.583249:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146240:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066816.583266:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1cc8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b42 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.583273:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1cc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b42 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.583289:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5800, rc 0) 00000100:00100000:3.0:1746066816.583314:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985514880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1641us (1788us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066816.583318:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20615 00000100:00100000:0.0:1746066816.584780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.584856:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515136 00000100:00100000:3.0:1746066816.584860:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515136 00000100:00100000:3.0:1746066816.584951:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20617 00000100:00100000:3.0:1746066816.584956:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3490:x1830882985515136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.584964:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.584972:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b50 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.584989:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.584993:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066816.584994:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066816.584996:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.585014:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.585021:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 28 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066816.585028:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.585256:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066816.586155:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.586172:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.586183:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5c00, rc 0) 00000100:00100000:3.0:1746066816.586206:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3490:x1830882985515136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1249us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.586211:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20617 00000100:00100000:0.0:1746066816.586609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.586737:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515264 00000100:00100000:2.0:1746066816.586742:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515264 00002000:00100000:2.0:1746066816.586768:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->4038655) req@ffff88009c776d80 x1830882985515264/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.586780:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776d80 with x1830882985515264 ext(3915776->4038655) 00010000:00010000:2.0:1746066816.586786:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746066816.586796:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 29 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746066816.586802:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c776d80 00000100:00100000:2.0:1746066816.586825:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2223 00000100:00100000:2.0:1746066816.586831:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985515264:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066816.588749:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985515264:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1913us (2136us total) trans 17179875423 rc 0/0 00000100:00100000:0.0:1746066816.588758:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2223 00002000:00100000:0.0:1746066816.588765:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3915776->4038655) req@ffff88009c776d80 x1830882985515264/t17179875423(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066816.588773:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776d80 with x1830882985515264 ext(3915776->4038655) 00010000:00010000:0.0:1746066816.588780:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746066816.588792:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00002000:00010000:0.0:1746066816.588797:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c776d80 00000100:00100000:0.0:1746066816.592840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.592923:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515392 00000100:00100000:1.0:1746066816.592932:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515392 00010000:00010000:1.0:1746066816.592964:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.593001:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9453 00000100:00100000:1.0:1746066816.593008:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985515392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.593019:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.593035:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.593045:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.593070:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb1c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4038655) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b03 expref: 31 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746066816.593094:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.593096:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.593102:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.593109:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.593136:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.593146:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146496:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.593274:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.594403:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146496:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.594417:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.594447:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985515392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1439us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.594453:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9453 00000100:00100000:0.0:1746066816.602100:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.602163:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515776 00000100:00100000:2.0:1746066816.602172:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515776 00000100:00100000:0.0:1746066816.602182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066816.602210:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009c776a00 x1830882985515776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.602229:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776a00 with x1830882985515776 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.602234:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776a00 00000100:00100000:2.0:1746066816.602253:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985515904 00000100:00100000:2.0:1746066816.602256:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985515904 00002000:00100000:2.0:1746066816.602268:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c777b80 x1830882985515904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066816.602270:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7768 00002000:00100000:2.0:1746066816.602274:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c777b80 with x1830882985515904 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.602276:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c777b80 00000100:00100000:3.0:1746066816.602279:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985515776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066816.602302:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7769 00000100:00100000:2.0:1746066816.602306:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985515904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.612007:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985515776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9721us (9904us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066816.612017:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7768 00002000:00100000:3.0:1746066816.612026:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009c776a00 x1830882985515776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.612040:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776a00 with x1830882985515776 ext(2097152->4194303) 00002000:00010000:3.0:1746066816.612045:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776a00 00000100:00100000:2.0:1746066816.613381:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985515904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11070us (11195us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066816.613389:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7769 00002000:00100000:2.0:1746066816.613397:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c777b80 x1830882985515904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.613403:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c777b80 with x1830882985515904 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.613407:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c777b80 00000100:00100000:0.0:1746066816.619126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.619166:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985516160 00000100:00100000:2.0:1746066816.619175:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985516160 00002000:00100000:2.0:1746066816.619212:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c774e00 x1830882985516160/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.619221:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774e00 with x1830882985516160 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.619225:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774e00 00000100:00100000:2.0:1746066816.619254:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7770 00000100:00100000:2.0:1746066816.619261:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985516160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066816.622605:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985516160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3337us (3477us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066816.622615:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7770 00002000:00100000:2.0:1746066816.622624:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009c774e00 x1830882985516160/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.622635:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774e00 with x1830882985516160 ext(4194304->4861951) 00002000:00010000:2.0:1746066816.622641:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c774e00 00010000:00010000:2.0:1746066816.658104:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066816.667685:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.667786:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985516416 00000100:00100000:2.0:1746066816.667794:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985516416 00000100:00080000:1.0:1746066816.667864:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066816.667870:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6521 00000100:00100000:2.0:1746066816.667878:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+6:3442:x1830882985516416:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066816.668063:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3442:x1830882985516416:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 185us (384us total) trans 8589937776 rc 0/0 00000100:00100000:2.0:1746066816.668069:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6521 00000100:00100000:0.0:1746066816.669531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.670574:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985516672 00000100:00100000:3.0:1746066816.670596:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985516672 00000100:00100000:3.0:1746066816.670658:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6522 00000100:00100000:3.0:1746066816.670664:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+7:3442:x1830882985516672:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066816.671362:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+8:3442:x1830882985516672:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 696us (1842us total) trans 8589937777 rc 0/0 00000100:00100000:3.0:1746066816.671379:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6522 00000100:00100000:0.0:1746066816.692114:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.692195:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985516928 00000100:00100000:3.0:1746066816.692204:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985516928 00000100:00100000:3.0:1746066816.692258:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17291 00000100:00100000:3.0:1746066816.692264:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3496:x1830882985516928:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.692282:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.692295:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b57 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.692349:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692358:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692380:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692392:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692397:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692402:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692484:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692492:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692497:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.692505:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.692571:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692577:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692581:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692585:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692590:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c5600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.692592:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692597:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692609:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.692611:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.692614:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692618:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692640:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692648:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692652:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692655:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c4400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.692657:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692661:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692667:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b2281800) 00010000:00010000:3.0:1746066816.692668:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.692670:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692674:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1ce4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.692703:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.692712:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.692717:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.692719:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066816.692721:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5800, rc 0) 00000100:00100000:3.0:1746066816.692807:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3496:x1830882985516928:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 542us (705us total) trans 8589937778 rc 0/0 00000100:00100000:3.0:1746066816.692813:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17291 00000100:00100000:0.0:1746066816.705057:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.705123:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517056 00000100:00100000:3.0:1746066816.705132:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517056 00000100:00100000:3.0:1746066816.705349:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20618 00000100:00100000:3.0:1746066816.705357:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3496:x1830882985517056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.705384:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.705402:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b5e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.705428:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.705434:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.705436:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.705439:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3698688->4001791] (req 3698688->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.705465:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.705476:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066816.705487:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.705577:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.709187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.709283:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985146624:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066816.709312:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3698688->4001791] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066816.709327:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c4c00, rc 0) 00000100:00100000:3.0:1746066816.709582:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517312 00000100:00100000:3.0:1746066816.709588:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517312 00000100:00100000:3.0:1746066816.709629:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17292 00000100:00100000:3.0:1746066816.709636:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:3498:x1830882985517312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.709652:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.709665:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b65 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.709719:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709729:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709737:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709747:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709752:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709756:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709828:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfb1d15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709835:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfb1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066816.709837:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3496:x1830882985517056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4479us (4787us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066816.709839:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfb1d15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066816.709845:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20618 00000004:00200000:3.0:1746066816.709846:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.709920:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709925:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.709930:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711196:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711205:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c5600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.711209:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711216:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711227:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066816.711229:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.711232:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711240:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711260:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711265:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711273:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711277:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093507e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066816.711280:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711284:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711290:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b2281f00) 00010000:00010000:3.0:1746066816.711292:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066816.711293:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.711297:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066816.711457:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.711478:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517440 00000100:00100000:1.0:1746066816.711482:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517440 00010000:00010000:1.0:1746066816.711504:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746066816.711532:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9454 00000100:00100000:1.0:1746066816.711538:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985517440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.711547:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.711549:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b65 expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.711561:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfb1d15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b65 expref: 42 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.711562:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.711571:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066816.711572:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.711573:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066816.711574:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507a00, rc 0) 00010000:00010000:1.0:1746066816.711586:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5c00/0xf1867c21abfb1ccf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b50 expref: 11 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066816.711612:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:3498:x1830882985517312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1976us (2433us total) trans 8589937779 rc 0/0 00000100:00100000:3.0:1746066816.711618:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17292 00010000:00010000:1.0:1746066816.712083:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.712085:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.712091:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.712100:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.712125:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.712136:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.712318:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.713250:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.713300:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517568 00000100:00100000:3.0:1746066816.713305:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517568 00000100:00100000:1.0:1746066816.713340:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985146752:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066816.713344:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 945 00000100:00100000:3.0:1746066816.713349:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985517568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.713355:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.713356:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066816.713380:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfb1d15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b65 expref: 42 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.713391:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:1.0:1746066816.713391:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985517440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1853us (1935us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066816.713394:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.713398:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9454 00000100:00100000:3.0:1746066816.713409:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985517568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.713414:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 945 00000100:00100000:0.0:1746066816.713947:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.713981:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517824 00000100:00100000:2.0:1746066816.713985:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517824 00002000:00100000:2.0:1746066816.714006:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->3702783) req@ffff880095dd5880 x1830882985517824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.714013:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5880 with x1830882985517824 ext(3698688->3702783) 00002000:00010000:2.0:1746066816.714015:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5880 00000100:00100000:2.0:1746066816.714034:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7771 00000100:00100000:2.0:1746066816.714038:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985517824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066816.714120:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985517824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 82us (180us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066816.714124:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7771 00002000:00100000:2.0:1746066816.714127:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->3702783) req@ffff880095dd5880 x1830882985517824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.714131:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5880 with x1830882985517824 ext(3698688->3702783) 00002000:00010000:2.0:1746066816.714133:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5880 00000100:00100000:0.0:1746066816.716696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.716754:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985517952 00000100:00100000:2.0:1746066816.716761:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985517952 00000100:00100000:2.0:1746066816.716803:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20619 00000100:00100000:2.0:1746066816.716809:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:3498:x1830882985517952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066816.716823:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.716836:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b6c expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.716858:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.716866:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066816.716869:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066816.716875:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.716877:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.716880:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1609728->1789951] (req 1609728->1789951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.717003:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985518208 00000100:00100000:3.0:1746066816.717008:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985518208 00002000:00100000:3.0:1746066816.717031:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3997696->4001791) req@ffff880095dd5c00 x1830882985518208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.717039:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882985518208 ext(3997696->4001791) 00002000:00010000:3.0:1746066816.717043:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:3.0:1746066816.717056:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7772 00010000:00010000:2.0:1746066816.717056:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066816.717061:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985518208:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:2.0:1746066816.717068:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 11 pid: 13726 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746066816.717079:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985146880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.717148:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.717155:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746066816.717156:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985518208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 94us (287us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066816.717162:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985147008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.717163:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7772 00002000:00100000:3.0:1746066816.717168:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3997696->4001791) req@ffff880095dd5c00 x1830882985518208/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.717175:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882985518208 ext(3997696->4001791) 00002000:00010000:3.0:1746066816.717178:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:2.0:1746066816.717179:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.718834:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985146880:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.718850:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985147008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.718874:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1609728->1789951] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.718918:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326de00, rc 0) 00000100:00100000:2.0:1746066816.718968:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:3498:x1830882985517952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2158us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.718976:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20619 00000100:00100000:0.0:1746066816.719834:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.719946:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985518336 00000100:00100000:3.0:1746066816.719953:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985518336 00010000:00010000:3.0:1746066816.719979:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 12 pid: 13726 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746066816.720011:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9455 00000100:00100000:3.0:1746066816.720017:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985518336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.720027:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.720043:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 12 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.720053:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 12 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.720071:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779e00/0xf1867c21abfb1bda lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7acb expref: 12 pid: 13726 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746066816.720087:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.720127:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985518336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.720137:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9455 00000100:00100000:0.0:1746066816.720564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.720599:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.720633:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985518464 00000100:00100000:3.0:1746066816.720636:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985518464 00010000:00010000:3.0:1746066816.720648:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.720654:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985518720 00000100:00100000:2.0:1746066816.720659:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985518720 00000100:00100000:3.0:1746066816.720669:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9456 00000100:00100000:3.0:1746066816.720674:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985518464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.720680:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066816.720681:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6523 00010000:00010000:3.0:1746066816.720687:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746066816.720687:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3496:x1830882985518720:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:3.0:1746066816.720695:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.720705:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfb1b9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7a8c expref: 20 pid: 11630 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746066816.720713:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.720715:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.720719:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.720730:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.720754:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.720764:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985147136:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066816.720814:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.721029:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3496:x1830882985518720:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 341us (428us total) trans 8589937780 rc 0/0 00000100:00100000:2.0:1746066816.721035:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6523 00000100:00100000:2.0:1746066816.723090:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985147136:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066816.723108:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066816.723136:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.723180:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985518976 00000100:00100000:3.0:1746066816.723187:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985518976 00002000:00100000:3.0:1746066816.723215:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1613823) req@ffff8800a5961880 x1830882985518976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.723224:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961880 with x1830882985518976 ext(1609728->1613823) 00002000:00010000:3.0:1746066816.723227:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961880 00000100:00100000:3.0:1746066816.723249:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7773 00000100:00100000:3.0:1746066816.723255:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985518976:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066816.723280:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985518464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2603us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.723288:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9456 00000100:00100000:3.0:1746066816.723517:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985518976:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 261us (387us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.723523:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7773 00002000:00100000:3.0:1746066816.723528:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1613823) req@ffff8800a5961880 x1830882985518976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.723534:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961880 with x1830882985518976 ext(1609728->1613823) 00002000:00010000:3.0:1746066816.723537:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961880 00000100:00100000:0.0:1746066816.726114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.726228:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985519232 00000100:00100000:3.0:1746066816.726237:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985519232 00002000:00100000:3.0:1746066816.726279:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1785856->1789951) req@ffff8800a5960700 x1830882985519232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.726289:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960700 with x1830882985519232 ext(1785856->1789951) 00002000:00010000:3.0:1746066816.726294:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960700 00000100:00100000:3.0:1746066816.726313:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7774 00000100:00100000:3.0:1746066816.726321:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882985519232:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.726496:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882985519232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 175us (392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.726503:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7774 00002000:00100000:3.0:1746066816.726508:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1785856->1789951) req@ffff8800a5960700 x1830882985519232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.726515:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960700 with x1830882985519232 ext(1785856->1789951) 00002000:00010000:3.0:1746066816.726518:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5960700 00000100:00100000:0.0:1746066816.728799:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.728953:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985519488 00000100:00100000:2.0:1746066816.728964:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985519488 00000100:00100000:2.0:1746066816.729017:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6524 00000100:00100000:2.0:1746066816.729025:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:3498:x1830882985519488:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066816.729211:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:3498:x1830882985519488:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 186us (423us total) trans 8589937781 rc 0/0 00000100:00100000:2.0:1746066816.729217:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6524 00000100:00100000:0.0:1746066816.796626:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.796708:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985519616 00000100:00100000:2.0:1746066816.796720:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985519616 00000100:00100000:2.0:1746066816.796785:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20620 00000100:00100000:2.0:1746066816.796793:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985519616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.796808:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.796823:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfb1d2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b73 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.796869:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985147264:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066816.796985:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.798056:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985147264:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066816.798085:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfb1d2a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b73 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.798098:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfb1d2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b73 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.798206:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326dc00, rc 0) 00000100:00100000:2.0:1746066816.798442:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985519616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1648us (1824us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066816.798451:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20620 00000100:00100000:0.0:1746066816.805584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.805631:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.805673:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985519872 00000100:00100000:3.0:1746066816.805686:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985519872 00002000:00100000:3.0:1746066816.805730:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5961180 x1830882985519872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 504/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.805739:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961180 with x1830882985519872 ext(1048576->2097151) 00000100:00100000:1.0:1746066816.805740:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520128 00002000:00010000:3.0:1746066816.805744:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961180 00000100:00100000:1.0:1746066816.805747:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520128 00000100:00100000:3.0:1746066816.805784:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7775 00002000:00100000:1.0:1746066816.805788:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5961c00 x1830882985520128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066816.805792:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882985519872:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066816.805797:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961c00 with x1830882985520128 ext(1048576->2097151) 00002000:00010000:1.0:1746066816.805802:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5961c00 00000100:00100000:1.0:1746066816.805830:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7776 00000100:00100000:1.0:1746066816.805837:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985520128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.811547:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882985519872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5737us (5952us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746066816.811561:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7775 00002000:00100000:3.0:1746066816.811574:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5961180 x1830882985519872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 504/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.811584:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961180 with x1830882985519872 ext(1048576->2097151) 00002000:00010000:3.0:1746066816.811591:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961180 00000100:00100000:1.0:1746066816.813227:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985520128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7380us (7585us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066816.813237:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7776 00002000:00100000:1.0:1746066816.813246:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5961c00 x1830882985520128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.813254:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961c00 with x1830882985520128 ext(1048576->2097151) 00002000:00010000:1.0:1746066816.813260:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5961c00 00000100:00100000:0.0:1746066816.820244:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.821116:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520256 00000100:00100000:2.0:1746066816.821129:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520256 00000100:00100000:2.0:1746066816.821192:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20621 00000100:00100000:2.0:1746066816.821201:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3503:x1830882985520256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.821218:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.821236:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b7a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.821266:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.821273:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066816.821274:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066816.821277:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.821305:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.821316:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 9 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066816.821326:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985147392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.821431:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.824479:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.824564:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985147392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.824575:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520384 00000100:00100000:1.0:1746066816.824582:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520384 00010000:00010000:2.0:1746066816.824591:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.824608:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47400, rc 0) 00002000:00100000:1.0:1746066816.824620:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->4001791) req@ffff8800a5961f80 x1830882985520384/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066816.824627:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961f80 with x1830882985520384 ext(3698688->4001791) 00010000:00010000:1.0:1746066816.824634:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 10 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066816.824645:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3503:x1830882985520256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3446us (4411us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066816.824645:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 10 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746066816.824651:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5961f80 00000100:00100000:2.0:1746066816.824652:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20621 00000100:00100000:1.0:1746066816.824679:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2224 00000100:00100000:1.0:1746066816.824684:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985520384:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066816.829232:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985520384:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4534us (4751us total) trans 17179875424 rc 0/0 00000100:00100000:0.0:1746066816.829245:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2224 00002000:00100000:0.0:1746066816.829259:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->4001791) req@ffff8800a5961f80 x1830882985520384/t17179875424(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066816.829269:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961f80 with x1830882985520384 ext(3698688->4001791) 00010000:00010000:0.0:1746066816.829279:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066816.829294:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746066816.829300:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5961f80 00000100:00100000:0.0:1746066816.832111:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.832405:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520512 00000100:00100000:2.0:1746066816.832414:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520512 00010000:00010000:2.0:1746066816.832570:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066816.832723:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9457 00000100:00100000:2.0:1746066816.832731:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985520512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.832746:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066816.832770:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.832783:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.832808:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c4c00/0xf1867c21abfb1cf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b5e expref: 12 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.832838:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.832840:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.832847:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.832855:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.832989:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.833006:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985147520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066816.833611:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.835129:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985147520:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066816.835143:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066816.835270:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985520512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2539us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.835279:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9457 00000100:00100000:0.0:1746066816.841794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.842014:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520640 00000100:00100000:2.0:1746066816.842024:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520640 00000100:00100000:0.0:1746066816.842127:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.842545:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985520768 00000100:00100000:2.0:1746066816.842556:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985520768 00000100:00100000:1.0:1746066816.842560:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20622 00000100:00100000:1.0:1746066816.842571:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985520640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.842588:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066816.842596:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20623 00000100:00100000:2.0:1746066816.842602:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985520768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.842603:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1d38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b81 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.842610:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.842619:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b88 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.842637:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.842639:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.842646:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066816.842651:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985147648:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066816.842658:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.842666:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46e00, rc 0) 00000100:00100000:2.0:1746066816.842712:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985520768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 110us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.842717:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20623 00000100:00100000:1.0:1746066816.842722:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.842853:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.842923:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521024 00000100:00100000:2.0:1746066816.842927:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521024 00002000:00100000:2.0:1746066816.842949:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c03800 x1830882985521024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.842957:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03800 with x1830882985521024 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.842960:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03800 00000100:00100000:2.0:1746066816.842989:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7777 00000100:00100000:2.0:1746066816.843990:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985521024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066816.844383:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985147648:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066816.844407:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1d38 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b81 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.844418:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6600/0xf1867c21abfb1d38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b81 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.844432:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6600, rc 0) 00000100:00100000:1.0:1746066816.844460:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985520640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1892us (2676us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.844466:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20622 00000100:00100000:0.0:1746066816.852660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.852731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.852896:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521408 00000100:00100000:3.0:1746066816.852905:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521408 00000100:00100000:3.0:1746066816.852945:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17293 00000100:00100000:3.0:1746066816.852952:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:3508:x1830882985521408:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066816.852970:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.852984:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093506600/0xf1867c21abfb1d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b96 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853072:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.853085:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853091:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853098:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853104:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 6/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.853134:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853144:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.853155:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985147776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.853233:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853240:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 43 pid: 7243 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.853247:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985147904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.853268:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.853274:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 25 pid: 7243 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.853280:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985148032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.853293:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.853389:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521152 00000100:00100000:1.0:1746066816.853393:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521152 00000100:00100000:1.0:1746066816.853416:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20624 00000100:00100000:1.0:1746066816.853421:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3507:x1830882985521152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.853428:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.853437:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b8f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.853582:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.853589:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.853591:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066816.853593:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.853607:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.853614:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 18 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066816.853621:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985148160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066816.854300:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.854545:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985521024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11550us (11691us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066816.854554:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7777 00002000:00100000:2.0:1746066816.854561:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c03800 x1830882985521024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.854570:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03800 with x1830882985521024 ext(2097152->4194303) 00002000:00010000:2.0:1746066816.854574:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03800 00000100:00100000:0.0:1746066816.855349:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.855391:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.855428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.855518:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985147776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.855526:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985147904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.855533:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985148032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.855552:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066816.855579:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521664 00000100:00100000:3.0:1746066816.855584:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521664 00010000:00010000:3.0:1746066816.855602:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 26 pid: 7243 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.855618:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521536 00000100:00100000:3.0:1746066816.855620:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521536 00010000:00010000:3.0:1746066816.855625:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 27 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.855635:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521792 00000100:00100000:3.0:1746066816.855636:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521792 00010000:00010000:3.0:1746066816.855643:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 44 pid: 7243 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.855654:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9458 00000100:00100000:3.0:1746066816.855659:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985521664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.855667:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.855671:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 27 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855679:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 27 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855697:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfb19bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7997 expref: 27 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855716:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.855720:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855726:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855731:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.855752:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985521664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.855757:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9458 00000100:00100000:3.0:1746066816.855770:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9459 00000100:00100000:3.0:1746066816.855774:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985521536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.855779:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.855783:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855789:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855797:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5800/0xf1867c21abfb1ceb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b57 expref: 25 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855804:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.855807:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855812:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855816:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.855829:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985521536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.855834:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9459 00000100:00100000:3.0:1746066816.855864:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9460 00000100:00100000:3.0:1746066816.855868:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985521792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.855873:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.855877:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 44 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855903:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 44 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855912:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb1a44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79dd expref: 44 pid: 7243 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.855920:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.855922:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855928:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855933:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855946:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.855960:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985521792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.855965:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9460 00010000:00010000:3.0:1746066816.855980:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066816.855986:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066816.855999:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066816.856095:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093506600/0xf1867c21abfb1d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 44 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.856105:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.856110:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.856112:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066816.856114:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507e00, rc 0) 00000100:00100000:3.0:1746066816.856134:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:3508:x1830882985521408:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3183us (3404us total) trans 8589937782 rc 0/0 00000100:00100000:3.0:1746066816.856140:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17293 00000100:00100000:1.0:1746066816.856769:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985148160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066816.856789:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.856800:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7600, rc 0) 00000100:00100000:1.0:1746066816.856832:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3507:x1830882985521152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3411us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.856839:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20624 00000100:00100000:0.0:1746066816.857163:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.857342:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985521920 00000100:00100000:2.0:1746066816.857348:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985521920 00002000:00100000:2.0:1746066816.857382:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1789951) req@ffff880097c01c00 x1830882985521920/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.857393:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01c00 with x1830882985521920 ext(1609728->1789951) 00010000:00010000:2.0:1746066816.857398:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.857413:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066816.857419:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c01c00 00000100:00100000:2.0:1746066816.857443:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2225 00000100:00100000:2.0:1746066816.857449:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985521920:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066816.859320:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.859569:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985522048 00000100:00100000:3.0:1746066816.859579:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985522048 00000100:00100000:3.0:1746066816.859625:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17294 00000100:00100000:3.0:1746066816.859631:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:3503:x1830882985522048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.859654:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.859672:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7b9d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.859733:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 44 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.859745:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 44 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.859761:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066816.859764:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066816.859768:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5600, rc 0) 00000100:00100000:3.0:1746066816.861238:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:3503:x1830882985522048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1602us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.861246:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17294 00000100:00100000:0.0:1746066816.861324:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985521920:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3871us (4156us total) trans 21474842776 rc 0/0 00000100:00100000:0.0:1746066816.861334:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2225 00002000:00100000:0.0:1746066816.861342:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1609728->1789951) req@ffff880097c01c00 x1830882985521920/t21474842776(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/448 e 0 to 0 dl 1746066827 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066816.861351:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01c00 with x1830882985521920 ext(1609728->1789951) 00010000:00010000:0.0:1746066816.861359:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066816.861386:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746066816.861393:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c01c00 00000100:00100000:0.0:1746066816.863836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.863948:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985522176 00000100:00100000:1.0:1746066816.863956:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985522176 00010000:00010000:1.0:1746066816.863984:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066816.864018:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9461 00000100:00100000:1.0:1746066816.864025:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985522176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066816.864036:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066816.864050:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066816.864060:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066816.864078:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfb1d23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->1789951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b6c expref: 21 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066816.864100:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.864102:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066816.864107:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.864114:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.864138:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.864146:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985148288:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.864211:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.867645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.867996:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985148288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066816.868032:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.868203:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985522176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4177us (4370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.868226:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9461 00000100:00100000:2.0:1746066816.869118:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985522304 00000100:00100000:2.0:1746066816.869124:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985522304 00000100:00100000:2.0:1746066816.869208:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20625 00000100:00100000:2.0:1746066816.869214:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985522304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066816.869228:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.869241:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ba4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.869259:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.869260:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.869266:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 21 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.869277:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 21 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.869286:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47e00, rc 0) 00000100:00100000:2.0:1746066816.869319:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985522304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.869326:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20625 00000100:00100000:0.0:1746066816.872588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.872725:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985522560 00000100:00100000:2.0:1746066816.872733:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985522560 00002000:00100000:2.0:1746066816.872769:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009677fb80 x1830882985522560/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066816.872778:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882985522560 ext(1048576->2097151) 00002000:00010000:2.0:1746066816.872782:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677fb80 00000100:00100000:2.0:1746066816.872813:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7778 00000100:00100000:2.0:1746066816.872820:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985522560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.878846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.878977:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985522816 00000100:00100000:3.0:1746066816.878989:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985522816 00002000:00100000:3.0:1746066816.879033:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009677e680 x1830882985522816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.879042:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e680 with x1830882985522816 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.879047:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677e680 00000100:00100000:3.0:1746066816.879212:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7779 00000100:00100000:3.0:1746066816.879219:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985522816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.881061:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985522560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8236us (8472us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066816.881068:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7778 00002000:00100000:3.0:1746066816.881074:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009677fb80 x1830882985522560/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.881084:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882985522560 ext(1048576->2097151) 00002000:00010000:3.0:1746066816.881088:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677fb80 00000100:00100000:3.0:1746066816.883403:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985522816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4177us (4563us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066816.883411:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7779 00002000:00100000:3.0:1746066816.883418:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009677e680 x1830882985522816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.883427:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e680 with x1830882985522816 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.883431:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677e680 00000100:00100000:0.0:1746066816.893635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.893732:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523072 00000100:00100000:3.0:1746066816.893744:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523072 00002000:00100000:3.0:1746066816.893793:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009677c380 x1830882985523072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.893804:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c380 with x1830882985523072 ext(2097152->4194303) 00002000:00010000:3.0:1746066816.893809:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c380 00000100:00100000:3.0:1746066816.893852:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7780 00000100:00100000:3.0:1746066816.893860:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985523072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066816.902049:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985523072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8181us (8418us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066816.902059:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7780 00002000:00100000:3.0:1746066816.902070:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009677c380 x1830882985523072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.902079:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c380 with x1830882985523072 ext(2097152->4194303) 00002000:00010000:3.0:1746066816.902084:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c380 00000100:00100000:1.0:1746066816.908116:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28b87956-2543-42c1-b799-d011d2dfefc7:3775:1830882985148416:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908128:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882985148672:0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908140:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985148544:0@lo:400:kworker.0 00000100:00100000:0.0:1746066816.908197:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985148800:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908271:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066816.908271:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066816.908312:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066816.908318:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3776:1830882985149056:0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908331:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985148928:0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908337:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066816.908341:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882985149184:0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908348:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066816.908349:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985149568:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066816.908374:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3775:1830882985149440:0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908378:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066816.908386:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985149696:0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908390:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066816.908402:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066816.908404:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3775:1830882985149952:0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908411:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985148544 00000100:00100000:2.0:1746066816.908416:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985148544 00000100:00100000:1.0:1746066816.908417:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066816.908424:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985148672 00000100:00100000:3.0:1746066816.908427:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985148672 00000100:00100000:1.0:1746066816.908434:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985148416 00000100:00100000:1.0:1746066816.908436:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985148416 00000100:00100000:3.0:1746066816.908447:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149056 00000100:00100000:3.0:1746066816.908448:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149056 00000100:00100000:1.0:1746066816.908457:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746066816.908464:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3775:x1830882985148416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908465:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149184 00000100:00100000:3.0:1746066816.908466:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149184 00000100:00100000:3.0:1746066816.908474:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149440 00000100:00100000:3.0:1746066816.908476:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149440 00000100:00100000:3.0:1746066816.908489:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149952 00000100:00100000:3.0:1746066816.908491:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149952 00000100:00100000:1.0:1746066816.908497:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3775:x1830882985148416:12345-0@lo:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.908499:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1746066816.908502:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882985148672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908503:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1746066816.908529:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882985148672:12345-0@lo:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.908529:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1746066816.908533:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3776:x1830882985149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908534:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1746066816.908545:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1746066816.908549:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882985149184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908554:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3776:x1830882985149056:12345-0@lo:400:kworker.0 Request processed in 22us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.908564:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1746066816.908565:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882985149184:12345-0@lo:400:kworker.0 Request processed in 17us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.908569:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1746066816.908576:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1746066816.908579:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1746066816.908580:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3775:x1830882985149440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908583:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3775:x1830882985149952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908597:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3775:x1830882985149440:12345-0@lo:400:kworker.0 Request processed in 17us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.908600:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3775:x1830882985149952:12345-0@lo:400:kworker.0 Request processed in 17us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.908601:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1746066816.908605:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00080000:1.0:1746066816.908613:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746066816.908616:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066816.908618:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985148928 00000100:00100000:3.0:1746066816.908620:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985148928 00000100:00100000:3.0:1746066816.908638:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149696 00000100:00100000:3.0:1746066816.908639:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149696 00000100:00100000:1.0:1746066816.908647:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3775:1830882985149952:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908650:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1746066816.908653:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28b87956-2543-42c1-b799-d011d2dfefc7:3775:1830882985148416:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908654:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985148928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.908659:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3775:1830882985149440:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908675:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985148928:12345-0@lo:400:kworker.0 Request processed in 21us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.908679:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1746066816.908683:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985148928:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908687:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1746066816.908690:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985149696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908691:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149568 00000100:00100000:2.0:1746066816.908693:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149568 00000100:00100000:1.0:1746066816.908695:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1746066816.908699:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985148544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.908703:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1746066816.908707:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985149568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908708:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985149696:12345-0@lo:400:kworker.0 Request processed in 17us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.908712:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1746066816.908723:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985148544:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.908726:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985149568:12345-0@lo:400:kworker.0 Request processed in 19us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.908728:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1746066816.908730:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1746066816.908738:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882985148672:0@lo:400:kworker.0 00000100:00080000:1.0:1746066816.908739:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066816.908745:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985148544:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908746:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882985149184:0@lo:400:kworker.0 00000100:00100000:3.0:1746066816.908752:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842771 gen 2 00000100:00100000:2.0:1746066816.908752:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3776:1830882985149056:0@lo:400:kworker.0 00000004:00080000:3.0:1746066816.908756:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1f6680, transno 21474842680 00000100:00100000:2.0:1746066816.908758:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985149568:0@lo:400:kworker.0 00000004:00080000:3.0:1746066816.908763:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbfb80, transno 21474842681 00000004:00080000:3.0:1746066816.908765:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801180, transno 21474842685 00000004:00080000:3.0:1746066816.908767:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0dc00, transno 21474842686 00000004:00080000:3.0:1746066816.908769:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c00a80, transno 21474842687 00000100:00100000:0.0:1746066816.908823:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066816.908840:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3774:1830882985149312:0@lo:400:kworker.0 00000100:00100000:0.0:1746066816.908858:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066816.908878:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985149824:0@lo:400:kworker.0 00000100:00100000:0.0:1746066816.908910:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066816.908932:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149312 00000100:00100000:2.0:1746066816.908935:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149312 00000100:00100000:2.0:1746066816.908954:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1746066816.908957:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830882985149312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066816.909032:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830882985149312:12345-0@lo:400:kworker.0 Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.909037:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:2.0:1746066816.909049:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1746066816.909052:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03100, transno 21474842688 00000004:00080000:3.0:1746066816.909055:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800380, transno 21474842689 00000004:00080000:3.0:1746066816.909057:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801500, transno 21474842690 00000004:00080000:3.0:1746066816.909059:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03480, transno 21474842691 00000004:00080000:3.0:1746066816.909061:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c02a00, transno 21474842692 00000004:00080000:3.0:1746066816.909063:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5962a00, transno 21474842693 00000004:00080000:3.0:1746066816.909064:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5962d80, transno 21474842694 00000004:00080000:3.0:1746066816.909066:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963480, transno 21474842695 00000004:00080000:3.0:1746066816.909068:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963b80, transno 21474842696 00000004:00080000:3.0:1746066816.909070:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5961500, transno 21474842697 00000004:00080000:3.0:1746066816.909072:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963800, transno 21474842698 00000004:00080000:3.0:1746066816.909073:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963100, transno 21474842699 00000004:00080000:3.0:1746066816.909075:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5962680, transno 21474842700 00000004:00080000:3.0:1746066816.909077:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c491f80, transno 21474842703 00000004:00080000:3.0:1746066816.909079:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0e00, transno 21474842704 00000004:00080000:3.0:1746066816.909082:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f2680, transno 21474842705 00000100:00100000:0.0:1746066816.909095:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3774:1830882985149312:0@lo:400:kworker.0 00000004:00080000:3.0:1746066816.909131:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1f80, transno 21474842706 00000004:00080000:3.0:1746066816.909134:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c493480, transno 21474842707 00000004:00080000:3.0:1746066816.909136:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f2a00, transno 21474842708 00000004:00080000:3.0:1746066816.909139:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c492d80, transno 21474842709 00000004:00080000:3.0:1746066816.909141:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c491880, transno 21474842710 00000004:00080000:3.0:1746066816.909201:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711f80, transno 21474842711 00000004:00080000:3.0:1746066816.909204:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3800, transno 21474842712 00000004:00080000:3.0:1746066816.909206:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710a80, transno 21474842713 00000004:00080000:3.0:1746066816.909209:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713100, transno 21474842714 00000004:00080000:3.0:1746066816.909211:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711c00, transno 21474842715 00000004:00080000:3.0:1746066816.909213:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f712d80, transno 21474842716 00000004:00080000:3.0:1746066816.909215:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f712680, transno 21474842717 00000004:00080000:3.0:1746066816.909217:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1500, transno 21474842718 00000004:00080000:3.0:1746066816.909219:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c02d80, transno 21474842719 00000004:00080000:3.0:1746066816.909221:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c01880, transno 21474842720 00000004:00080000:3.0:1746066816.909223:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677d180, transno 21474842721 00000004:00080000:3.0:1746066816.909225:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c00380, transno 21474842722 00000004:00080000:3.0:1746066816.909227:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c02680, transno 21474842723 00000004:00080000:3.0:1746066816.909229:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c03b80, transno 21474842724 00000004:00080000:3.0:1746066816.909231:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ed80, transno 21474842725 00000004:00080000:3.0:1746066816.909233:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097c01500, transno 21474842726 00000004:00080000:3.0:1746066816.909235:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68380, transno 21474842729 00000004:00080000:3.0:1746066816.909237:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cd180, transno 21474842730 00000004:00080000:3.0:1746066816.909239:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36300, transno 21474842731 00000004:00080000:3.0:1746066816.909240:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800986cca80, transno 21474842732 00000004:00080000:3.0:1746066816.909242:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68e00, transno 21474842733 00000004:00080000:3.0:1746066816.909244:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68700, transno 21474842734 00000004:00080000:3.0:1746066816.909246:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68000, transno 21474842735 00000004:00080000:3.0:1746066816.909248:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c69f80, transno 21474842736 00000004:00080000:3.0:1746066816.909250:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a2680, transno 21474842737 00000004:00080000:3.0:1746066816.909252:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a1c00, transno 21474842738 00000004:00080000:3.0:1746066816.909254:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a1180, transno 21474842739 00000004:00080000:3.0:1746066816.909256:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34380, transno 21474842740 00000004:00080000:3.0:1746066816.909258:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a0700, transno 21474842741 00000004:00080000:3.0:1746066816.909260:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a2d80, transno 21474842742 00000004:00080000:3.0:1746066816.909261:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a2300, transno 21474842743 00000004:00080000:3.0:1746066816.909263:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a1f80, transno 21474842744 00000004:00080000:3.0:1746066816.909265:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecb800, transno 21474842756 00000004:00080000:3.0:1746066816.909268:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8e00, transno 21474842757 00000004:00080000:3.0:1746066816.909269:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9500, transno 21474842758 00000004:00080000:3.0:1746066816.909271:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8700, transno 21474842759 00000004:00080000:3.0:1746066816.909273:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9880, transno 21474842760 00000004:00080000:3.0:1746066816.909274:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecaa00, transno 21474842761 00000004:00080000:3.0:1746066816.909276:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096eca300, transno 21474842762 00000004:00080000:3.0:1746066816.909278:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecbb80, transno 21474842763 00000004:00080000:3.0:1746066816.909280:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800a80, transno 21474842764 00000004:00080000:3.0:1746066816.909282:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711500, transno 21474842765 00000004:00080000:3.0:1746066816.909285:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801c00, transno 21474842766 00000004:00080000:3.0:1746066816.909287:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d800e00, transno 21474842767 00000004:00080000:3.0:1746066816.909289:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713800, transno 21474842768 00000004:00080000:3.0:1746066816.909291:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803b80, transno 21474842769 00000004:00080000:3.0:1746066816.909293:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803100, transno 21474842770 00000004:00080000:3.0:1746066816.909296:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d802a00, transno 21474842771 00000100:00100000:3.0:1746066816.909300:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985149696:0@lo:400:kworker.0 00000004:00080000:1.0:1746066816.909427:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 70 in progress, 0 in flight, 4 done 00000004:00080000:1.0:1746066816.909643:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 70 done 00000100:00100000:1.0:1746066816.909652:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985148800 00000100:00100000:1.0:1746066816.909655:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985148800 00000100:00100000:1.0:1746066816.909695:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985149824 00000100:00100000:1.0:1746066816.909697:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985149824 00000100:00100000:1.0:1746066816.909709:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1746066816.909714:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882985148800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.909748:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882985148800:12345-0@lo:400:kworker.0 Request processed in 34us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.909752:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1746066816.909760:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1746066816.909764:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066816.909785:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985148800:0@lo:400:kworker.0 00000100:00100000:1.0:1746066816.909789:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985149824:12345-0@lo:400:kworker.0 Request processed in 24us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.909793:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1746066816.909794:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875417 gen 2 00000004:00080000:0.0:1746066816.909797:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01500, transno 17179875315 00000004:00080000:0.0:1746066816.909811:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01c00, transno 17179875316 00000004:00080000:0.0:1746066816.909813:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02a00, transno 17179875317 00000004:00080000:0.0:1746066816.909815:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01f80, transno 17179875318 00000004:00080000:0.0:1746066816.909817:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00a80, transno 17179875319 00000004:00080000:0.0:1746066816.909819:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02d80, transno 17179875320 00000004:00080000:0.0:1746066816.909822:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00000, transno 17179875321 00000004:00080000:0.0:1746066816.909824:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01880, transno 17179875322 00000004:00080000:0.0:1746066816.909826:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5826300, transno 17179875323 00000004:00080000:0.0:1746066816.909828:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37b80, transno 17179875329 00000004:00080000:0.0:1746066816.909829:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372a00, transno 17179875330 00000004:00080000:0.0:1746066816.909831:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35c00, transno 17179875331 00000004:00080000:0.0:1746066816.909833:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea36680, transno 17179875332 00000004:00080000:0.0:1746066816.909835:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371c00, transno 17179875333 00000004:00080000:0.0:1746066816.909837:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1f7800, transno 17179875334 00000100:00080000:2.0:1746066816.909839:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746066816.909839:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1f5500, transno 17179875335 00000004:00080000:0.0:1746066816.909841:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ac700, transno 17179875336 00000004:00080000:0.0:1746066816.909843:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad180, transno 17179875337 00000004:00080000:0.0:1746066816.909845:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e437480, transno 17179875338 00000004:00080000:0.0:1746066816.909847:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b2680, transno 17179875339 00000004:00080000:0.0:1746066816.909849:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f711180, transno 17179875340 00000004:00080000:0.0:1746066816.909851:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f712a00, transno 17179875341 00000004:00080000:0.0:1746066816.909853:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095869f80, transno 17179875342 00000004:00080000:0.0:1746066816.909855:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666f480, transno 17179875343 00000004:00080000:0.0:1746066816.909857:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713b80, transno 17179875344 00000004:00080000:0.0:1746066816.909860:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e437b80, transno 17179875345 00000004:00080000:0.0:1746066816.909862:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68a80, transno 17179875346 00000004:00080000:0.0:1746066816.909864:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d82a00, transno 17179875348 00000004:00080000:0.0:1746066816.909866:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d81880, transno 17179875349 00000004:00080000:0.0:1746066816.909868:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83480, transno 17179875350 00000004:00080000:0.0:1746066816.909870:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420380, transno 17179875351 00000004:00080000:0.0:1746066816.909872:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095802300, transno 17179875352 00000004:00080000:0.0:1746066816.909874:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83b80, transno 17179875353 00000004:00080000:0.0:1746066816.909876:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095800380, transno 17179875354 00000004:00080000:0.0:1746066816.909877:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80a80, transno 17179875355 00000004:00080000:0.0:1746066816.909879:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095801880, transno 17179875356 00000004:00080000:0.0:1746066816.910158:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095868700, transno 17179875357 00000004:00080000:0.0:1746066816.910163:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4fb80, transno 17179875358 00000004:00080000:0.0:1746066816.910165:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098924380, transno 17179875359 00000004:00080000:0.0:1746066816.910167:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009586a300, transno 17179875360 00000004:00080000:0.0:1746066816.910169:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e436a00, transno 17179875361 00000004:00080000:0.0:1746066816.910172:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d26300, transno 17179875362 00000004:00080000:0.0:1746066816.910174:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4d500, transno 17179875363 00000004:00080000:0.0:1746066816.910176:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925180, transno 17179875364 00000004:00080000:0.0:1746066816.910178:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5887b80, transno 17179875365 00000004:00080000:0.0:1746066816.910180:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d89c700, transno 17179875366 00000004:00080000:0.0:1746066816.910182:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5885500, transno 17179875367 00000004:00080000:0.0:1746066816.910184:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884700, transno 17179875368 00000004:00080000:0.0:1746066816.910186:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884a80, transno 17179875369 00000004:00080000:0.0:1746066816.910188:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764e00, transno 17179875370 00000004:00080000:0.0:1746066816.910190:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5884380, transno 17179875371 00000004:00080000:0.0:1746066816.910192:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d89ce00, transno 17179875372 00000004:00080000:0.0:1746066816.910194:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d89ca80, transno 17179875373 00000004:00080000:0.0:1746066816.910195:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967a9180, transno 17179875374 00000004:00080000:0.0:1746066816.910197:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371500, transno 17179875376 00000004:00080000:0.0:1746066816.910200:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094371f80, transno 17179875377 00000004:00080000:0.0:1746066816.910202:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372d80, transno 17179875378 00000004:00080000:0.0:1746066816.910204:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094373800, transno 17179875379 00000004:00080000:0.0:1746066816.910206:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d802680, transno 17179875380 00000004:00080000:0.0:1746066816.910208:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094372680, transno 17179875381 00000004:00080000:0.0:1746066816.910210:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094373480, transno 17179875382 00000004:00080000:0.0:1746066816.910212:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094370700, transno 17179875383 00000004:00080000:0.0:1746066816.910214:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c4a2a00, transno 17179875384 00000004:00080000:0.0:1746066816.910216:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0a80, transno 17179875385 00000004:00080000:0.0:1746066816.910219:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958aed80, transno 17179875386 00000004:00080000:0.0:1746066816.910221:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098926300, transno 17179875387 00000004:00080000:0.0:1746066816.910223:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7b80, transno 17179875388 00000004:00080000:0.0:1746066816.910225:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1880, transno 17179875389 00000004:00080000:0.0:1746066816.910227:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1180, transno 17179875390 00000004:00080000:0.0:1746066816.910229:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a4e00, transno 17179875391 00000004:00080000:0.0:1746066816.910231:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958aca80, transno 17179875392 00000004:00080000:0.0:1746066816.910233:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7fb80, transno 17179875393 00000004:00080000:0.0:1746066816.910235:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a4700, transno 17179875400 00000004:00080000:0.0:1746066816.910237:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a6680, transno 17179875401 00000004:00080000:0.0:1746066816.910240:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7480, transno 17179875402 00000004:00080000:0.0:1746066816.910242:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7100, transno 17179875403 00000004:00080000:0.0:1746066816.910245:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7800, transno 17179875404 00000004:00080000:0.0:1746066816.910247:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5880, transno 17179875405 00000004:00080000:0.0:1746066816.910249:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a6300, transno 17179875406 00000004:00080000:0.0:1746066816.910251:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5500, transno 17179875407 00000004:00080000:0.0:1746066816.910253:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095801180, transno 17179875408 00000004:00080000:0.0:1746066816.910255:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803100, transno 17179875409 00000004:00080000:0.0:1746066816.910257:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095800700, transno 17179875410 00000004:00080000:0.0:1746066816.910259:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea34a80, transno 17179875411 00000004:00080000:0.0:1746066816.910261:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54c700, transno 17179875412 00000004:00080000:0.0:1746066816.910263:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea37480, transno 17179875413 00000004:00080000:0.0:1746066816.910265:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54c380, transno 17179875414 00000004:00080000:0.0:1746066816.910267:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095802680, transno 17179875415 00000004:00080000:0.0:1746066816.910269:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea35500, transno 17179875416 00000004:00080000:0.0:1746066816.910272:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54dc00, transno 17179875417 00000100:00100000:0.0:1746066816.910276:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985149824:0@lo:400:kworker.0 00000100:00100000:0.0:1746066816.910342:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.910393:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523328 00000100:00100000:3.0:1746066816.910397:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523328 00002000:00100000:3.0:1746066816.910420:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009677c700 x1830882985523328/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.910429:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882985523328 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.910433:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c700 00000004:00080000:1.0:1746066816.910444:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 54 in progress, 0 in flight, 36 done 00000100:00100000:3.0:1746066816.910454:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7781 00000100:00100000:3.0:1746066816.910459:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985523328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066816.910498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.910592:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523456 00000100:00100000:2.0:1746066816.910596:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523456 00000100:00100000:2.0:1746066816.910621:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20626 00000004:00080000:1.0:1746066816.910624:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 54 done 00000100:00100000:2.0:1746066816.910627:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:3508:x1830882985523456:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066816.910635:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.910648:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bab expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.910668:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.910676:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.910686:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.910687:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.910690:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.910712:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066816.910723:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 11 pid: 3528 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066816.910733:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.910796:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.910804:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066816.910812:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.910827:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066816.915306:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.915318:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066816.915344:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3846144->4194303] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.915383:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47600, rc 0) 00000100:00100000:2.0:1746066816.915431:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:3508:x1830882985523456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4803us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.915438:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20626 00000100:00100000:3.0:1746066816.915569:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985523328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5108us (5227us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066816.915575:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7781 00002000:00100000:3.0:1746066816.915582:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88009677c700 x1830882985523328/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:222/0 lens 488/440 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.915590:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882985523328 ext(4194304->4861951) 00002000:00010000:3.0:1746066816.915594:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c700 00000100:00100000:0.0:1746066816.916998:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.917044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.917124:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523584 00000100:00100000:1.0:1746066816.917131:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523584 00010000:00010000:1.0:1746066816.917156:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066816.917258:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523712 00000100:00100000:1.0:1746066816.917261:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523712 00010000:00010000:1.0:1746066816.917273:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066816.917316:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9462 00000100:00100000:2.0:1746066816.917322:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985523584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.917333:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066816.917349:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.917357:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.917383:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfb1cac lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b2d expref: 22 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066816.917406:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066816.917429:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985523584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.917435:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9462 00000100:00100000:2.0:1746066816.917446:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9463 00000100:00100000:2.0:1746066816.917450:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985523712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066816.917455:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066816.917461:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746066816.917469:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746066816.917478:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c800/0xf1867c21abfb1cc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b49 expref: 12 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746066816.917484:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.917486:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066816.917491:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.917498:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.917519:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.917527:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985150336:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066816.917567:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066816.919831:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.919875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.919910:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985523968 00000100:00100000:3.0:1746066816.919916:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985523968 00002000:00100000:3.0:1746066816.919943:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->3850239) req@ffff88009677dc00 x1830882985523968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746066816.919950:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524096 00002000:00100000:3.0:1746066816.919952:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677dc00 with x1830882985523968 ext(3846144->3850239) 00000100:00100000:1.0:1746066816.919953:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524096 00002000:00010000:3.0:1746066816.919956:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677dc00 00000100:00100000:1.0:1746066816.919971:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20627 00000100:00100000:3.0:1746066816.919974:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7782 00000100:00100000:3.0:1746066816.919977:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985523968:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066816.919977:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985524096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066816.919986:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.919996:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb1d77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bb2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066816.920058:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985150336:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066816.920071:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066816.920306:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150464:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066816.920444:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985523712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2992us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066816.920451:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9463 00000100:00100000:3.0:1746066816.920477:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985523968:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 498us (651us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.920483:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7782 00002000:00100000:3.0:1746066816.920488:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->3850239) req@ffff88009677dc00 x1830882985523968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.920494:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677dc00 with x1830882985523968 ext(3846144->3850239) 00002000:00010000:3.0:1746066816.920497:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677dc00 00000100:00100000:1.0:1746066816.920638:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.921784:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150464:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066816.921804:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb1d77 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bb2 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.921815:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfb1d77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bb2 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.921834:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37200, rc 0) 00000100:00100000:1.0:1746066816.921864:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985524096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1887us (1989us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.921912:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20627 00000100:00100000:0.0:1746066816.923654:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.923684:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066816.923707:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524352 00000100:00100000:1.0:1746066816.923713:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524352 00000100:00100000:1.0:1746066816.923743:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524224 00000100:00100000:1.0:1746066816.923745:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524224 00000100:00100000:3.0:1746066816.923748:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20628 00000100:00100000:3.0:1746066816.923755:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+31:3508:x1830882985524352:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746066816.923758:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20629 00000100:00100000:1.0:1746066816.923761:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985524224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066816.923767:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066816.923767:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066816.923778:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bc0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.923778:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfb1d7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bb9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.923797:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.923810:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066816.923811:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150592:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066816.923816:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.923817:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.923820:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.923835:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066816.923844:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 11 pid: 11630 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746066816.923852:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985150720:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.924063:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.924072:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066816.924074:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985150848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066816.924079:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985150976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066816.924101:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066816.924116:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.924166:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985150848 00000100:00100000:1.0:1746066816.924169:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985150848 00000100:00100000:1.0:1746066816.924195:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1746066816.924199:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985150848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746066816.924211:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1192376768 pending 671744 free 3909910528 avail 3678388224 00000100:00100000:1.0:1746066816.924268:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985150848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.924273:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1746066816.924285:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985150848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746066816.924287:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066816.925018:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985150592:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066816.925034:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfb1d7e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bb9 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.925043:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfb1d7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bb9 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066816.925051:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36000, rc 0) 00000100:00100000:3.0:1746066816.925053:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985150720:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066816.925059:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985150976:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066816.925070:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066816.925070:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985524224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1308us (1387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066816.925076:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20629 00010000:00010000:3.0:1746066816.925083:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:3.0:1746066816.925101:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+32:3508:x1830882985524352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1348us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.925106:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20628 00000100:00100000:0.0:1746066816.930511:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066816.930561:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.930631:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524608 00000100:00100000:3.0:1746066816.930643:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524608 00010000:00010000:3.0:1746066816.930683:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746066816.930711:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524480 00000100:00100000:3.0:1746066816.930713:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524480 00010000:00010000:3.0:1746066816.930723:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066816.930750:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9464 00000100:00100000:3.0:1746066816.930757:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985524608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.930769:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.930785:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746066816.930785:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9465 00000100:00100000:1.0:1746066816.930793:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985524480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066816.930796:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746066816.930802:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066816.930815:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46e00/0xf1867c21abfb1d3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b88 expref: 12 pid: 11630 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746066816.930819:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066816.930827:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066816.930838:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47400/0xf1867c21abfb1d31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b7a expref: 32 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066816.930839:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.930842:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066816.930847:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066816.930855:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066816.930862:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066816.930901:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.930913:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985151104:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066816.930922:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985524480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.930932:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9465 00000100:00100000:3.0:1746066816.930962:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066816.936196:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985151104:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066816.936215:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066816.936263:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985524608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5506us (5760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066816.936273:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9464 00000100:00100000:0.0:1746066816.937359:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066816.937424:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985524864 00000100:00100000:3.0:1746066816.937431:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985524864 00002000:00100000:3.0:1746066816.937463:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4476928->4481023) req@ffff8800986cf480 x1830882985524864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/0 e 0 to 0 dl 1746066827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.937472:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cf480 with x1830882985524864 ext(4476928->4481023) 00002000:00010000:3.0:1746066816.937476:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cf480 00000100:00100000:3.0:1746066816.938026:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7783 00000100:00100000:3.0:1746066816.938034:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985524864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066816.938147:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985524864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 113us (795us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066816.938153:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7783 00002000:00100000:3.0:1746066816.938158:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4476928->4481023) req@ffff8800986cf480 x1830882985524864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746066827 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066816.938164:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cf480 with x1830882985524864 ext(4476928->4481023) 00002000:00010000:3.0:1746066816.938166:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cf480 00000100:00100000:0.0:1746066816.939544:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066816.939756:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985525120 00000100:00100000:2.0:1746066816.939763:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985525120 00000100:00100000:2.0:1746066816.939810:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17295 00000100:00100000:2.0:1746066816.939816:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3512:x1830882985525120:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066816.939831:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066816.939845:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfb1d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bc7 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066816.940094:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985151232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1746066816.940100:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940111:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940120:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066816.940132:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066816.940141:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940146:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940151:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940206:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985151232 00000100:00100000:1.0:1746066816.940210:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985151232 00010000:00010000:2.0:1746066816.940229:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940236:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1746066816.940237:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985151360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1746066816.940240:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940241:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985151232:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1746066816.940245:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066816.940252:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:0.0:1746066816.940258:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1746066816.940263:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:1.0:1746066816.940298:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985151232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.940303:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00010000:00010000:2.0:1746066816.940304:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940309:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940313:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940314:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985151360 00000100:00100000:1.0:1746066816.940316:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985151360 00010000:00010000:2.0:1746066816.940318:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940322:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.940325:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940325:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1746066816.940328:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882985151360:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1746066816.940331:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066816.940338:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985151232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1746066816.940338:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00000004:00000024:1.0:1746066816.940340:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445535744 avail 1316073472 00010000:00010000:2.0:1746066816.940341:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.940344:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940348:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940374:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940379:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940384:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940385:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882985151360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (126us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066816.940387:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066816.940390:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066816.940390:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00010000:00010000:2.0:1746066816.940394:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940400:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a438e800) 00010000:00010000:2.0:1746066816.940402:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066816.940404:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066816.940404:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985151360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1746066816.940407:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066816.940435:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfb1d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 27 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.940443:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 26 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066816.940449:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066816.940450:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066816.940453:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47200, rc 0) 00000100:00100000:2.0:1746066816.940492:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3512:x1830882985525120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 676us (948us total) trans 8589937783 rc 0/0 00000100:00100000:2.0:1746066816.940497:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17295 00000100:00100000:0.0:1746066816.956990:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066816.957009:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985151488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066816.957064:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066816.957085:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985151488 00000100:00100000:1.0:1746066816.957092:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985151488 00000100:00100000:1.0:1746066816.957135:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1746066816.957142:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985151488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746066816.957160:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1293684032 pending 1892352 free 3906400256 avail 3674877952 00000100:00100000:1.0:1746066816.957557:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985151488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 414us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066816.957563:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1746066816.957803:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985151488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066817.045273:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.045388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.045427:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985525504 00000100:00100000:0.0:1746066817.045427:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985525376 00000100:00100000:0.0:1746066817.045434:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985525376 00000100:00100000:2.0:1746066817.045435:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985525504 00000100:00100000:2.0:1746066817.045490:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20630 00000100:00100000:2.0:1746066817.045497:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3512:x1830882985525504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.045513:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1746066817.045515:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066817.045528:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bd5 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.045551:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.045558:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.045560:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.045563:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2134016->3043327] (req 2134016->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 12 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.045582:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17296 00010000:00010000:2.0:1746066817.045587:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.045590:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3516:x1830882985525376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.045598:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 30 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.045601:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066817.045609:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985151616:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066817.045612:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb1db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bce expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.045665:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045675:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045684:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066817.045688:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00010000:00010000:0.0:1746066817.045693:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045698:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045703:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045778:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb1dcb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045786:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045791:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb1dcb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066817.045798:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066817.045852:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045857:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045863:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045867:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045872:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f6a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066817.045875:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045880:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045910:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066817.045912:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066817.045915:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045920:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb1dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045942:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045946:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045954:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045957:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f7400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066817.045960:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045964:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045969:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098485e00) 00010000:00010000:0.0:1746066817.045971:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066817.045973:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.045977:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb1dc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066817.046005:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb1db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bce expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.046015:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb1dcb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bce expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.046020:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066817.046022:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066817.046024:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6e00, rc 0) 00000100:00100000:0.0:1746066817.046048:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3516:x1830882985525376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 459us (781us total) trans 8589937784 rc 0/0 00000100:00100000:0.0:1746066817.046053:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17296 00000100:00100000:0.0:1746066817.048842:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.048905:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985151616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.048928:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2134016->3043327] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 12 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.048936:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066817.048944:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46a00, rc 0) 00000100:00100000:0.0:1746066817.048966:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985525888 00000100:00100000:0.0:1746066817.048971:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985525888 00000100:00100000:2.0:1746066817.048979:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3512:x1830882985525504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3482us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.048986:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20630 00000100:00100000:0.0:1746066817.049007:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 946 00000100:00100000:0.0:1746066817.049013:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985525888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066817.049023:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066817.049040:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb1dcb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bce expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.049053:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066817.049056:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066817.049179:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985525888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 165us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066817.049185:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 946 00000100:00100000:3.0:1746066817.049340:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985525760 00000100:00100000:3.0:1746066817.049344:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985525760 00000100:00100000:3.0:1746066817.049384:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6525 00000100:00100000:3.0:1746066817.049390:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3516:x1830882985525760:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066817.049507:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3516:x1830882985525760:12345-192.168.204.16@tcp:35:cat.0 Request processed in 117us (671us total) trans 8589937785 rc 0/0 00000100:00100000:3.0:1746066817.049512:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6525 00000100:00100000:0.0:1746066817.050010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.050062:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526016 00000100:00100000:3.0:1746066817.050065:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526016 00002000:00100000:3.0:1746066817.050091:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4481023) req@ffff8800986ce680 x1830882985526016/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.050099:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986ce680 with x1830882985526016 ext(4194304->4481023) 00010000:00010000:3.0:1746066817.050105:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 31 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.050115:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 31 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.050121:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800986ce680 00000100:00080000:0.0:1746066817.050169:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066817.050192:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2226 00000100:00100000:3.0:1746066817.050197:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985526016:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066817.052603:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.052626:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.054676:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526144 00000100:00100000:3.0:1746066817.054685:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526144 00000100:00100000:3.0:1746066817.054729:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526272 00000100:00100000:3.0:1746066817.054732:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526272 00000100:00100000:3.0:1746066817.054907:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20631 00000100:00100000:3.0:1746066817.054914:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985526144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.054929:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.054943:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfb1dd9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bdc expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.054989:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985151744:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066817.055071:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.055173:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985526016:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4974us (5163us total) trans 17179875425 rc 0/0 00000100:00100000:3.0:1746066817.055181:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2226 00002000:00100000:3.0:1746066817.055190:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4481023) req@ffff8800986ce680 x1830882985526016/t17179875425(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.055204:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986ce680 with x1830882985526016 ext(4194304->4481023) 00010000:00010000:3.0:1746066817.055210:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.055221:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.055227:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800986ce680 00000100:00100000:2.0:1746066817.055497:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.055571:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526528 00000100:00100000:2.0:1746066817.055575:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526528 00000100:00100000:2.0:1746066817.055606:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17297 00000100:00100000:2.0:1746066817.055612:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:3518:x1830882985526528:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.055620:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.055630:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfb1de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bea expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.055682:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055693:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055702:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055712:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055718:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055723:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055798:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055805:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055811:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066817.055818:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066817.055863:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055868:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055873:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055878:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055901:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.055904:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055910:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055919:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.055921:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.055924:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055929:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46800/0xf1867c21abfb1de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055947:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055951:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055956:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055959:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.055962:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055966:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055972:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a438e800) 00010000:00010000:2.0:1746066817.055973:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.055976:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.055979:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb1dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.056008:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfb1de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 47 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.056016:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 46 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.056022:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.056023:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066817.056025:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46000, rc 0) 00000100:00100000:2.0:1746066817.056045:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:3518:x1830882985526528:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 434us (550us total) trans 8589937786 rc 0/0 00000100:00100000:2.0:1746066817.056051:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17297 00000100:00080000:2.0:1746066817.056079:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066817.056524:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20632 00000100:00100000:1.0:1746066817.056533:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985526272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.056542:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.056552:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfb1e03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7be3 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.056587:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985151872:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.056653:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.058109:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.058158:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.058207:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526656 00000100:00100000:1.0:1746066817.058213:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526656 00010000:00010000:1.0:1746066817.058235:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.058255:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9466 00000100:00100000:1.0:1746066817.058261:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985526656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.058269:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.058284:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.058294:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.058310:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.058312:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.058317:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.058325:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.058343:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.058356:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985152000:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066817.058408:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.058537:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985526912 00000100:00100000:0.0:1746066817.058541:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985526912 00000100:00100000:0.0:1746066817.058563:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6526 00000100:00100000:0.0:1746066817.058568:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:3518:x1830882985526912:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066817.058686:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:3518:x1830882985526912:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 117us (579us total) trans 8589937787 rc 0/0 00000100:00100000:0.0:1746066817.058692:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6526 00010000:00010000:3.0:1746066817.058919:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfb1d85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc0 expref: 33 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.058946:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985151744:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066817.058965:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfb1dd9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bdc expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.058974:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfb1dd9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bdc expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.058981:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506200, rc 0) 00000100:00100000:3.0:1746066817.058999:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985526144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4086us (6401us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.059004:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20631 00000100:00100000:1.0:1746066817.059475:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985151872:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066817.059491:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfb1e03 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7be3 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.059499:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfb1e03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7be3 expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.059679:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37000, rc 0) 00000100:00100000:1.0:1746066817.059780:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985526272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3248us (7151us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.059785:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20632 00000100:00100000:2.0:1746066817.060164:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985152000:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.060173:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.060192:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985526656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1932us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.060198:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9466 00000100:00100000:0.0:1746066817.060982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.061031:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985527168 00000100:00100000:3.0:1746066817.061037:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985527168 00002000:00100000:3.0:1746066817.061063:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->2138111) req@ffff8800986cdf80 x1830882985527168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.061071:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cdf80 with x1830882985527168 ext(2134016->2138111) 00002000:00010000:3.0:1746066817.061077:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cdf80 00000100:00100000:3.0:1746066817.061102:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7784 00000100:00100000:3.0:1746066817.061108:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985527168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.061210:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985527168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 102us (241us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.061216:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7784 00002000:00100000:3.0:1746066817.061222:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->2138111) req@ffff8800986cdf80 x1830882985527168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.061228:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cdf80 with x1830882985527168 ext(2134016->2138111) 00002000:00010000:3.0:1746066817.061231:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cdf80 00000100:00100000:0.0:1746066817.070847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.070959:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985527424 00000100:00100000:3.0:1746066817.070970:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985527424 00002000:00100000:3.0:1746066817.071045:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3039232->3043327) req@ffff8800986cea00 x1830882985527424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.071055:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cea00 with x1830882985527424 ext(3039232->3043327) 00002000:00010000:3.0:1746066817.071060:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cea00 00000100:00100000:3.0:1746066817.071608:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7785 00000100:00100000:3.0:1746066817.071617:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985527424:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.072448:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985527424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 830us (1611us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.072456:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7785 00002000:00100000:3.0:1746066817.072463:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3039232->3043327) req@ffff8800986cea00 x1830882985527424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.072471:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cea00 with x1830882985527424 ext(3039232->3043327) 00002000:00010000:3.0:1746066817.072474:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cea00 00000100:00100000:0.0:1746066817.072993:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.073615:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985527680 00000100:00100000:3.0:1746066817.073623:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985527680 00002000:00100000:3.0:1746066817.073657:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2134015) req@ffff8800986ce300 x1830882985527680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.073666:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986ce300 with x1830882985527680 ext(2097152->2134015) 00002000:00010000:3.0:1746066817.073670:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986ce300 00000100:00100000:3.0:1746066817.073701:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7786 00000100:00100000:3.0:1746066817.073709:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985527680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.076387:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985527680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2672us (3392us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1746066817.076397:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7786 00002000:00100000:3.0:1746066817.076407:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2134015) req@ffff8800986ce300 x1830882985527680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 36864/36864 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.076416:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986ce300 with x1830882985527680 ext(2097152->2134015) 00002000:00010000:3.0:1746066817.076420:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986ce300 00000100:00100000:0.0:1746066817.077394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.077454:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985527936 00000100:00100000:2.0:1746066817.077462:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985527936 00000100:00100000:2.0:1746066817.077504:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6527 00000100:00100000:2.0:1746066817.077511:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3512:x1830882985527936:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066817.077701:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3512:x1830882985527936:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 189us (308us total) trans 8589937788 rc 0/0 00000100:00100000:2.0:1746066817.077706:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6527 00000100:00100000:0.0:1746066817.078422:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.078485:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985528192 00000100:00100000:3.0:1746066817.078490:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985528192 00002000:00100000:3.0:1746066817.078512:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3043328->3145727) req@ffff88009677ce00 x1830882985528192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.078517:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ce00 with x1830882985528192 ext(3043328->3145727) 00002000:00010000:3.0:1746066817.078521:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ce00 00000100:00100000:3.0:1746066817.078547:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7787 00000100:00100000:3.0:1746066817.078552:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985528192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.080291:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985528192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1733us (1866us total) trans 0 rc 102400/102400 00000100:00100000:3.0:1746066817.080300:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7787 00002000:00100000:3.0:1746066817.080308:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3043328->3145727) req@ffff88009677ce00 x1830882985528192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 102400/102400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.080317:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ce00 with x1830882985528192 ext(3043328->3145727) 00002000:00010000:3.0:1746066817.080321:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ce00 00000100:00100000:0.0:1746066817.082772:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.082833:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985528320 00000100:00100000:1.0:1746066817.082841:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985528320 00000100:00100000:1.0:1746066817.082913:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20633 00000100:00100000:1.0:1746066817.082921:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3516:x1830882985528320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.082935:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.082951:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bf1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.082977:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.082989:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.082990:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.082994:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.083018:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.083028:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 20 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.083038:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.084025:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.086491:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152128:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.086519:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.086533:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37a00, rc 0) 00000100:00100000:1.0:1746066817.086584:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3516:x1830882985528320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3663us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.086591:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20633 00000100:00100000:0.0:1746066817.086808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.086872:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985528448 00000100:00100000:2.0:1746066817.086878:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985528448 00002000:00100000:2.0:1746066817.086945:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->4194303) req@ffff880093c4fb80 x1830882985528448/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.086953:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4fb80 with x1830882985528448 ext(3846144->4194303) 00010000:00010000:2.0:1746066817.086959:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 21 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.086969:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 21 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.086974:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4fb80 00000100:00080000:0.0:1746066817.086999:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066817.087003:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2227 00000100:00100000:2.0:1746066817.087010:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985528448:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066817.089633:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985528448:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2617us (2825us total) trans 21474842777 rc 0/0 00000100:00100000:2.0:1746066817.089643:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2227 00002000:00100000:2.0:1746066817.089651:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3846144->4194303) req@ffff880093c4fb80 x1830882985528448/t21474842777(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.089660:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4fb80 with x1830882985528448 ext(3846144->4194303) 00010000:00010000:2.0:1746066817.089667:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.089678:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.089689:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4fb80 00000100:00100000:0.0:1746066817.091524:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.091630:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985528576 00000100:00100000:2.0:1746066817.091637:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985528576 00010000:00010000:2.0:1746066817.091663:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.091686:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9467 00000100:00100000:2.0:1746066817.091693:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985528576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.091704:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.091720:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.091731:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.091750:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1d70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bab expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.091780:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.091782:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.091788:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.091795:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.091828:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.091838:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985152256:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066817.092341:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.094599:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985152256:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.094615:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.094658:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985528576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2965us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.094667:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9467 00000100:00100000:0.0:1746066817.100708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.100760:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.100793:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529088 00000100:00100000:2.0:1746066817.100801:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529088 00000100:00100000:1.0:1746066817.100812:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985528960 00000100:00100000:1.0:1746066817.100817:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985528960 00002000:00100000:2.0:1746066817.100841:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880093c4c000 x1830882985529088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.100841:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4ce00 x1830882985528960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.100850:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c000 with x1830882985529088 ext(3145728->4194303) 00002000:00100000:1.0:1746066817.100854:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ce00 with x1830882985528960 ext(2097152->4194303) 00002000:00010000:2.0:1746066817.100855:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4c000 00002000:00010000:1.0:1746066817.100858:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ce00 00000100:00100000:1.0:1746066817.100902:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7788 00000100:00100000:2.0:1746066817.100906:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7789 00000100:00100000:1.0:1746066817.100908:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985528960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.100912:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985529088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.107744:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985529088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6824us (7036us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.107754:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7789 00002000:00100000:2.0:1746066817.107765:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880093c4c000 x1830882985529088/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.107780:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c000 with x1830882985529088 ext(3145728->4194303) 00002000:00010000:2.0:1746066817.107785:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4c000 00000100:00100000:0.0:1746066817.110023:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.110237:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529344 00000100:00100000:2.0:1746066817.110245:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529344 00000100:00100000:2.0:1746066817.110292:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17298 00000100:00100000:2.0:1746066817.110299:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:3522:x1830882985529344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.110319:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.110334:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46400/0xf1867c21abfb1e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bf8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.110406:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110417:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110426:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110438:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110443:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110448:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110532:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1e26 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110545:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110551:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.110557:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066817.110618:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110624:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110634:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110640:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110645:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.110648:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110653:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110662:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.110665:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.110668:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110672:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47800/0xf1867c21abfb1e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110698:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110702:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110707:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110710:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.110713:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110717:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110722:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a438eb00) 00010000:00010000:2.0:1746066817.110724:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.110726:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110730:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfb1e1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.110759:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46400/0xf1867c21abfb1e11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf8 expref: 50 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.110768:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1e26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf8 expref: 49 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.110774:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.110777:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066817.110779:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46c00, rc 0) 00000100:00100000:2.0:1746066817.110830:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:3522:x1830882985529344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 530us (811us total) trans 8589937789 rc 0/0 00000100:00100000:2.0:1746066817.110836:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17298 00000100:00100000:1.0:1746066817.113956:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985528960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13041us (13190us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066817.113965:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7788 00002000:00100000:1.0:1746066817.113974:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4ce00 x1830882985528960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.113982:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ce00 with x1830882985528960 ext(2097152->4194303) 00002000:00010000:1.0:1746066817.113987:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ce00 00000100:00100000:0.0:1746066817.114196:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.114290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.114349:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529728 00000100:00100000:3.0:1746066817.114355:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529472 00000100:00100000:2.0:1746066817.114369:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529728 00000100:00100000:3.0:1746066817.114372:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529472 00000100:00100000:2.0:1746066817.114399:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6528 00000100:00100000:2.0:1746066817.114405:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+50:3522:x1830882985529728:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066817.114412:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 947 00000100:00100000:3.0:1746066817.114418:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882985529472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.114428:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.114447:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfb1e26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf8 expref: 50 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.114464:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.114467:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.114633:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882985529472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 214us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.114639:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 947 00000100:00100000:2.0:1746066817.114719:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:3522:x1830882985529728:12345-192.168.204.16@tcp:35:cat.0 Request processed in 313us (427us total) trans 8589937790 rc 0/0 00000100:00100000:2.0:1746066817.114726:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6528 00000100:00100000:0.0:1746066817.119927:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.119949:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.119985:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529856 00000100:00100000:1.0:1746066817.119994:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529856 00000100:00100000:0.0:1746066817.120010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.120035:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985529984 00000100:00100000:1.0:1746066817.120038:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985529984 00000100:00100000:1.0:1746066817.120070:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20634 00000100:00100000:1.0:1746066817.120078:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985529856:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066817.120080:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20635 00000100:00100000:3.0:1746066817.120087:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985529984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.120090:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.120097:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.120105:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa37200/0xf1867c21abfb1e34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7bff expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.120107:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c06 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.120123:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.120125:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.120132:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 23 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.120146:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 23 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066817.120148:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985152384:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066817.120155:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c4400, rc 0) 00000100:00100000:3.0:1746066817.120419:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985529984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 331us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.120426:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20635 00000100:00100000:1.0:1746066817.120443:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.120458:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985530240 00000100:00100000:3.0:1746066817.120461:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985530240 00002000:00100000:3.0:1746066817.120483:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4f100 x1830882985530240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.120491:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f100 with x1830882985530240 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.120494:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f100 00000100:00100000:3.0:1746066817.120506:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7790 00000100:00100000:3.0:1746066817.120511:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985530240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.124237:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985530240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3719us (4219us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066817.124249:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7790 00002000:00100000:3.0:1746066817.124258:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4f100 x1830882985530240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.124267:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f100 with x1830882985530240 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.124271:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f100 00002000:00010000:1.0:1746066817.124512:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066817 -> 1746066818 00002000:00010000:1.0:1746066817.124516:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066817 -> 1746066818 00002000:00010000:1.0:1746066817.124518:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066817 -> 1746066818 00000100:00100000:1.0:1746066817.124530:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985152384:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066817.124557:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37200/0xf1867c21abfb1e34 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bff expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.124568:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37200/0xf1867c21abfb1e34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bff expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.124591:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37200, rc 0) 00000100:00100000:1.0:1746066817.124620:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985529856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4542us (4699us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.124626:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20634 00000100:00100000:0.0:1746066817.132837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.132946:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985530496 00000100:00100000:3.0:1746066817.133018:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985530496 00002000:00100000:3.0:1746066817.133060:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c4c380 x1830882985530496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.133070:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c380 with x1830882985530496 ext(1048576->2097151) 00002000:00010000:3.0:1746066817.133075:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4c380 00000100:00100000:3.0:1746066817.133246:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7791 00000100:00100000:3.0:1746066817.133254:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985530496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066817.134995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.135050:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985530624 00000100:00100000:1.0:1746066817.135056:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985530624 00000100:00100000:1.0:1746066817.135096:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20636 00000100:00100000:1.0:1746066817.135102:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:3518:x1830882985530624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066817.135112:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.135125:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c0d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.135148:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.135156:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.135166:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.135168:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.135171:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.135193:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.135202:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746066817.135211:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.135282:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.135290:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 11 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.135296:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.135312:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.137282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.137413:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.137425:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985152640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.137452:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3076096->3145727] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.137474:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7400, rc 0) 00000100:00100000:1.0:1746066817.137516:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:3518:x1830882985530624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2413us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.137524:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20636 00000100:00100000:3.0:1746066817.137669:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985530752 00000100:00100000:3.0:1746066817.137675:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985530752 00010000:00010000:3.0:1746066817.137700:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746066817.137734:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9468 00000100:00100000:3.0:1746066817.137741:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985530752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.137754:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.137774:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.137790:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.137908:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c4400/0xf1867c21abfb1e3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c06 expref: 26 pid: 13726 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.137924:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.137951:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985530752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 211us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.137957:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9468 00000100:00100000:2.0:1746066817.138002:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985530496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4744us (5168us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.138010:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7791 00002000:00100000:2.0:1746066817.138017:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c4c380 x1830882985530496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.138023:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c380 with x1830882985530496 ext(1048576->2097151) 00002000:00010000:2.0:1746066817.138027:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4c380 00000100:00100000:0.0:1746066817.138696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.138760:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985530880 00000100:00100000:3.0:1746066817.138766:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985530880 00010000:00010000:3.0:1746066817.138787:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.138821:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9469 00000100:00100000:3.0:1746066817.138831:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985530880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.138842:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.138856:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.138866:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.138907:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb1e0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bf1 expref: 12 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.138920:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.138922:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.138928:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.138935:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.138960:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.138970:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985152768:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.139048:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.140494:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.140558:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985152768:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.140573:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.140608:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985530880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1781us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.140615:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9469 00000100:00100000:2.0:1746066817.140685:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985531136 00000100:00100000:2.0:1746066817.140690:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985531136 00002000:00100000:2.0:1746066817.140719:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3080191) req@ffff880093c4ed80 x1830882985531136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.140730:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ed80 with x1830882985531136 ext(3076096->3080191) 00002000:00010000:2.0:1746066817.140734:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ed80 00000100:00100000:2.0:1746066817.140752:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7792 00000100:00100000:2.0:1746066817.140758:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985531136:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066817.140852:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985531136:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 93us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066817.140857:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7792 00002000:00100000:2.0:1746066817.140862:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3080191) req@ffff880093c4ed80 x1830882985531136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.140869:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ed80 with x1830882985531136 ext(3076096->3080191) 00002000:00010000:2.0:1746066817.140871:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ed80 00000100:00100000:0.0:1746066817.142487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.142572:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985531264 00000100:00100000:1.0:1746066817.142578:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985531264 00000100:00100000:1.0:1746066817.142620:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20637 00000100:00100000:1.0:1746066817.142833:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:3518:x1830882985531264:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066817.142853:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.142870:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c14 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.142913:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.142920:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.142921:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.142924:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->3833855] (req 3145728->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.142947:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.142958:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 11 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.142972:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985152896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.143283:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.143799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.143845:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985531392 00000100:00100000:3.0:1746066817.143849:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985531392 00000100:00100000:3.0:1746066817.143878:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20638 00000100:00100000:3.0:1746066817.143904:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:3522:x1830882985531392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.143912:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.143923:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c1b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.143941:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.143942:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.143946:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.143954:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.143963:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c5800, rc 0) 00000100:00100000:3.0:1746066817.143986:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:3522:x1830882985531392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.143991:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20638 00000100:00100000:1.0:1746066817.144538:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985152896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.144555:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->3833855] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.144563:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7e00, rc 0) 00000100:00100000:1.0:1746066817.144593:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:3518:x1830882985531264:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1968us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.144599:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20637 00000100:00100000:0.0:1746066817.145097:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.145206:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985531520 00000100:00100000:2.0:1746066817.145210:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985531520 00002000:00100000:2.0:1746066817.145234:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->3043327) req@ffff8800a4d26300 x1830882985531520/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.145243:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26300 with x1830882985531520 ext(2134016->3043327) 00010000:00010000:2.0:1746066817.145250:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 12 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.145261:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 12 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.145267:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d26300 00000100:00100000:2.0:1746066817.145290:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2228 00000100:00100000:2.0:1746066817.145296:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985531520:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066817.151147:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985531520:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5838us (6038us total) trans 17179875426 rc 0/0 00000100:00100000:2.0:1746066817.151160:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2228 00002000:00100000:2.0:1746066817.151174:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->3043327) req@ffff8800a4d26300 x1830882985531520/t17179875426(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.151183:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26300 with x1830882985531520 ext(2134016->3043327) 00010000:00010000:2.0:1746066817.151193:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.151209:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.151216:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d26300 00000100:00100000:0.0:1746066817.156076:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.156187:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985531648 00000100:00100000:3.0:1746066817.156197:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985531648 00010000:00010000:3.0:1746066817.156233:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.156278:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9470 00000100:00100000:3.0:1746066817.156284:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985531648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.156295:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.156311:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.156321:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.156343:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46a00/0xf1867c21abfb1daf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2134016->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bd5 expref: 14 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.156391:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.156393:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.156399:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.156406:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.156413:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.156413:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.156416:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.156421:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.156445:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.156454:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985153024:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.156797:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.156809:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985153152:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.156826:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.159230:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985153024:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.159245:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985153152:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.159264:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.159322:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985531648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3036us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.159464:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9470 00000100:00100000:0.0:1746066817.162159:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.162190:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985532032 00000100:00100000:0.0:1746066817.162194:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.162201:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985532032 00000100:00100000:3.0:1746066817.162261:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985532160 00000100:00100000:3.0:1746066817.162268:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985532160 00002000:00100000:3.0:1746066817.162308:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3076095) req@ffff8800a4d27100 x1830882985532160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.162310:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d24000 x1830882985532032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.162318:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27100 with x1830882985532160 ext(2097152->3076095) 00002000:00100000:2.0:1746066817.162319:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24000 with x1830882985532032 ext(2097152->3145727) 00002000:00010000:3.0:1746066817.162322:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27100 00002000:00010000:2.0:1746066817.162324:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24000 00000100:00100000:3.0:1746066817.162573:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7793 00000100:00100000:3.0:1746066817.162581:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985532160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.162659:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7794 00000100:00100000:2.0:1746066817.162668:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985532032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066817.163016:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.163202:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985532416 00000100:00100000:1.0:1746066817.163207:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985532416 00002000:00100000:1.0:1746066817.163227:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3829760->3833855) req@ffff8800a4d24380 x1830882985532416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.163235:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24380 with x1830882985532416 ext(3829760->3833855) 00002000:00010000:1.0:1746066817.163239:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24380 00000100:00100000:1.0:1746066817.163253:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7795 00000100:00100000:1.0:1746066817.163259:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985532416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.163321:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985532416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 63us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.163327:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7795 00002000:00100000:1.0:1746066817.163332:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3829760->3833855) req@ffff8800a4d24380 x1830882985532416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.163345:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24380 with x1830882985532416 ext(3829760->3833855) 00002000:00010000:1.0:1746066817.163347:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24380 00000100:00100000:3.0:1746066817.171929:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985532160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9336us (9723us total) trans 0 rc 978944/978944 00000100:00100000:3.0:1746066817.171941:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7793 00002000:00100000:3.0:1746066817.171951:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3076095) req@ffff8800a4d27100 x1830882985532160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.171959:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27100 with x1830882985532160 ext(2097152->3076095) 00002000:00010000:3.0:1746066817.171963:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27100 00000100:00100000:2.0:1746066817.172989:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985532032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10314us (10829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.172999:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7794 00002000:00100000:2.0:1746066817.173008:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d24000 x1830882985532032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.173021:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24000 with x1830882985532032 ext(2097152->3145727) 00002000:00010000:2.0:1746066817.173026:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24000 00000100:00100000:0.0:1746066817.178263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.179118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.179196:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985532672 00000100:00100000:2.0:1746066817.179208:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985532672 00002000:00100000:2.0:1746066817.179257:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3833856->4194303) req@ffff8800a4d25500 x1830882985532672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.179267:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25500 with x1830882985532672 ext(3833856->4194303) 00002000:00010000:2.0:1746066817.179273:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25500 00000100:00100000:3.0:1746066817.179280:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985532928 00000100:00100000:3.0:1746066817.179289:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985532928 00002000:00100000:3.0:1746066817.179326:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a4d26a00 x1830882985532928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.179336:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26a00 with x1830882985532928 ext(3145728->4194303) 00002000:00010000:3.0:1746066817.179340:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d26a00 00000100:00100000:2.0:1746066817.179492:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7796 00000100:00100000:2.0:1746066817.179501:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985532672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.179511:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7797 00000100:00100000:3.0:1746066817.179518:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985532928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.185444:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985532672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5932us (7177us total) trans 0 rc 360448/360448 00000100:00100000:2.0:1746066817.185457:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7796 00002000:00100000:2.0:1746066817.185469:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3833856->4194303) req@ffff8800a4d25500 x1830882985532672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 360448/360448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.185478:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25500 with x1830882985532672 ext(3833856->4194303) 00002000:00010000:2.0:1746066817.185484:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25500 00000100:00100000:3.0:1746066817.191977:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985532928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12448us (12847us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066817.191987:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7797 00002000:00100000:3.0:1746066817.191997:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800a4d26a00 x1830882985532928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.192006:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26a00 with x1830882985532928 ext(3145728->4194303) 00002000:00010000:3.0:1746066817.192011:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d26a00 00000100:00100000:0.0:1746066817.197585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.197677:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533056 00000100:00100000:1.0:1746066817.197686:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533056 00000100:00100000:1.0:1746066817.197782:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20639 00000100:00100000:1.0:1746066817.197790:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985533056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.197806:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.197822:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfb1e57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c22 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.197870:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153280:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.198218:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.200575:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153280:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066817.200601:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfb1e57 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c22 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.200613:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfb1e57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c22 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.200840:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6000, rc 0) 00000100:00100000:1.0:1746066817.201149:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985533056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3359us (3571us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.201156:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20639 00000100:00100000:0.0:1746066817.204180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.204237:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533312 00000100:00100000:2.0:1746066817.204245:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533312 00000100:00100000:2.0:1746066817.204295:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17299 00000100:00100000:2.0:1746066817.204302:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3526:x1830882985533312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.204321:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.204340:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb1e5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c29 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.204416:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204428:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204437:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204447:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204453:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204458:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204541:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb1e73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204551:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb1e73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204557:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb1e73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.204568:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:1.0:1746066817.204614:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066817.204631:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204642:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204649:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204653:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204658:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fade00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.204661:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204666:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204674:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.204677:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.204680:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204684:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb1e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204696:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204701:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204704:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204708:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fadc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.204710:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204717:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204722:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9f00) 00010000:00010000:2.0:1746066817.204723:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.204725:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.204729:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1e6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066817.204755:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533568 00000100:00100000:3.0:1746066817.204759:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533568 00010000:00010000:2.0:1746066817.204759:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb1e5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c29 expref: 32 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.204768:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb1e73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c29 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.204773:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.204775:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066817.204777:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac600, rc 0) 00002000:00100000:3.0:1746066817.204784:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094307800 x1830882985533568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.204793:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307800 with x1830882985533568 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.204796:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307800 00000100:00100000:2.0:1746066817.204827:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3526:x1830882985533312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 525us (652us total) trans 8589937791 rc 0/0 00000100:00100000:2.0:1746066817.204833:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17299 00000100:00100000:3.0:1746066817.204847:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7798 00000100:00100000:3.0:1746066817.204853:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985533568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066817.209785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.209843:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533696 00000100:00100000:3.0:1746066817.209852:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533696 00000100:00100000:3.0:1746066817.209931:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 948 00000100:00100000:3.0:1746066817.209938:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985533696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.209949:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.209969:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb1e73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c29 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.209979:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985533568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5125us (5364us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066817.209990:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7798 00010000:00010000:3.0:1746066817.209992:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.209996:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746066817.209998:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094307800 x1830882985533568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.210013:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307800 with x1830882985533568 ext(4194304->4861951) 00000100:00100000:3.0:1746066817.210014:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985533696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (236us total) trans 0 rc 0/0 00002000:00010000:2.0:1746066817.210017:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307800 00000100:00100000:3.0:1746066817.210019:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 948 00000100:00100000:0.0:1746066817.213478:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.213537:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533824 00000100:00100000:1.0:1746066817.213545:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533824 00000100:00100000:1.0:1746066817.213631:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20640 00000100:00100000:1.0:1746066817.213637:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985533824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.213650:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.213666:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb1e81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c30 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.213703:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153408:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.214017:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.219832:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153408:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066817.219865:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb1e81 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c30 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.219876:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb1e81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c30 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.219915:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5200, rc 0) 00000100:00100000:1.0:1746066817.219965:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985533824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6326us (6492us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.219973:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20640 00000100:00100000:0.0:1746066817.221953:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.222618:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985533952 00000100:00100000:1.0:1746066817.222627:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985533952 00000100:00100000:1.0:1746066817.222685:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20641 00000100:00100000:1.0:1746066817.222692:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985533952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.222707:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.222722:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb1e88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c37 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.222773:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153536:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.222869:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.226956:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985153536:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066817.227075:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb1e88 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c37 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.227090:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb1e88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c37 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.227190:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5e00, rc 0) 00000100:00100000:1.0:1746066817.227377:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985533952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4682us (5427us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.227384:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20641 00000100:00100000:0.0:1746066817.247983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.248118:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534208 00000100:00100000:2.0:1746066817.248126:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534208 00000100:00100000:2.0:1746066817.248177:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17300 00000100:00100000:2.0:1746066817.248184:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3530:x1830882985534208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.248201:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.248215:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfb1e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c3e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.248273:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248285:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248293:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248530:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248537:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248542:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248624:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb1ea4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248636:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb1ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248642:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb1ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.248649:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066817.248712:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248717:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248721:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248726:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248730:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.248733:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248739:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248747:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.248750:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.248752:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248756:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.248996:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249002:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249006:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249010:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.249012:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249016:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249022:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9200) 00010000:00010000:2.0:1746066817.249024:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.249026:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249029:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.249061:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfb1e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c3e expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.249071:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb1ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c3e expref: 32 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.249077:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.249079:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066817.249082:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:2.0:1746066817.249131:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3530:x1830882985534208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 947us (1155us total) trans 8589937792 rc 0/0 00000100:00100000:2.0:1746066817.249137:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17300 00000100:00100000:0.0:1746066817.251675:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.251797:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534464 00000100:00100000:2.0:1746066817.251805:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534464 00000100:00100000:2.0:1746066817.251856:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6529 00000100:00100000:2.0:1746066817.251863:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3530:x1830882985534464:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066817.252051:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3530:x1830882985534464:12345-192.168.204.16@tcp:35:cat.0 Request processed in 187us (381us total) trans 8589937793 rc 0/0 00000100:00100000:2.0:1746066817.252058:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6529 00000100:00100000:1.0:1746066817.252341:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.252862:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534592 00000100:00100000:0.0:1746066817.252865:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534592 00000100:00100000:0.0:1746066817.252912:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 949 00000100:00100000:0.0:1746066817.252918:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2014:x1830882985534592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066817.252926:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066817.252945:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb1ea4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c3e expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.252969:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066817.252973:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066817.253002:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985534592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066817.253007:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 949 00000100:00100000:0.0:1746066817.256333:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.256386:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.256434:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534720 00000100:00100000:3.0:1746066817.256441:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534720 00000100:00100000:3.0:1746066817.256472:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534848 00000100:00100000:3.0:1746066817.256474:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534848 00000100:00100000:3.0:1746066817.256499:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20642 00000100:00100000:3.0:1746066817.256506:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985534720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.256518:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.256532:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a800/0xf1867c21abfb1eb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c45 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.256575:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985153664:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066817.256641:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.256646:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20643 00000100:00100000:1.0:1746066817.256653:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985534848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.256659:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.256668:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb1eb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c4c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.256689:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985153792:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.257033:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066817.271734:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066817 -> 1746066818 00000100:00100000:3.0:1746066817.271738:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985153664:192.168.204.16@tcp:106: 00002000:00010000:1.0:1746066817.271739:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066817 -> 1746066818 00002000:00010000:1.0:1746066817.271741:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066817 -> 1746066818 00000100:00100000:1.0:1746066817.271754:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985153792:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066817.271766:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a800/0xf1867c21abfb1eb2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c45 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.271778:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a800/0xf1867c21abfb1eb2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c45 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.271800:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb1eb9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c4c expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.271810:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb1eb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c4c expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.271833:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5600, rc 0) 00000100:00100000:1.0:1746066817.271874:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985534848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 15220us (15486us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.271905:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20643 00010000:00010000:3.0:1746066817.272300:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a800, rc 0) 00000100:00100000:3.0:1746066817.272320:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985534720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 15815us (15992us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.272326:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20642 00000100:00100000:0.0:1746066817.281610:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.281660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.281686:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985534976 00000100:00100000:3.0:1746066817.281693:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985534976 00000100:00100000:1.0:1746066817.281966:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535104 00000100:00100000:1.0:1746066817.281970:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535104 00000100:00100000:3.0:1746066817.281972:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20644 00000100:00100000:3.0:1746066817.281979:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985534976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.281993:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.282007:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1ec0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c53 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.282055:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985153920:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066817.283457:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20645 00000100:00100000:0.0:1746066817.283464:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985535104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066817.283472:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066817.283477:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746066817.283482:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1ec7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c5a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.283772:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985153920:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066817.283790:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1ec0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c53 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.283798:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1ec0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c53 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.283813:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ac00, rc 0) 00000100:00100000:3.0:1746066817.283836:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985534976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1858us (2234us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.283841:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20644 00000100:00100000:0.0:1746066817.284084:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985154048:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066817.284510:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.287815:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985154048:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066817.287844:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1ec7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c5a expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.287856:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1ec7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c5a expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.287879:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2800, rc 0) 00000100:00100000:2.0:1746066817.288620:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985535104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5153us (6957us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066817.288627:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20645 00000100:00100000:0.0:1746066817.291266:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.291467:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535232 00000100:00100000:2.0:1746066817.291475:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535232 00000100:00100000:2.0:1746066817.291512:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20646 00000100:00100000:2.0:1746066817.291519:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3530:x1830882985535232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.291533:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.291548:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c61 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.291568:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.291570:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.291576:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.291588:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.291596:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:2.0:1746066817.291646:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3530:x1830882985535232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.291652:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20646 00000100:00100000:0.0:1746066817.295485:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.295569:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535488 00000100:00100000:2.0:1746066817.295577:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535488 00002000:00100000:2.0:1746066817.295614:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d25c00 x1830882985535488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.295622:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25c00 with x1830882985535488 ext(2097152->3145727) 00002000:00010000:2.0:1746066817.295626:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25c00 00000100:00100000:2.0:1746066817.296267:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7799 00000100:00100000:2.0:1746066817.296275:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985535488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.306690:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985535488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10407us (11203us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.306702:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7799 00002000:00100000:2.0:1746066817.306711:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d25c00 x1830882985535488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.306720:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25c00 with x1830882985535488 ext(2097152->3145727) 00002000:00010000:2.0:1746066817.306725:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25c00 00000100:00100000:0.0:1746066817.312044:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.312131:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535616 00000100:00100000:2.0:1746066817.312140:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535616 00000100:00100000:2.0:1746066817.312178:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20647 00000100:00100000:2.0:1746066817.312184:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3530:x1830882985535616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.312198:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.312213:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c68 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.312236:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.312242:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.312243:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.312246:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.312271:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.312281:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 22 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.312296:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985154176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.313045:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.315406:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.315585:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985154176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.315609:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.315622:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fade00, rc 0) 00000100:00100000:2.0:1746066817.315654:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3530:x1830882985535616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3470us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.315661:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20647 00000100:00100000:3.0:1746066817.315987:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535744 00000100:00100000:3.0:1746066817.315993:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535744 00002000:00100000:3.0:1746066817.316023:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3145727) req@ffff880094306300 x1830882985535744/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.316031:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882985535744 ext(3076096->3145727) 00010000:00010000:3.0:1746066817.316036:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.316047:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 23 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.316052:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306300 00000100:00100000:3.0:1746066817.316067:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2229 00000100:00100000:3.0:1746066817.316072:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985535744:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066817.320978:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985535744:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4897us (5569us total) trans 21474842778 rc 0/0 00000100:00100000:3.0:1746066817.320990:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2229 00002000:00100000:3.0:1746066817.321002:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3076096->3145727) req@ffff880094306300 x1830882985535744/t21474842778(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.321015:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882985535744 ext(3076096->3145727) 00010000:00010000:3.0:1746066817.321025:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.321039:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.321045:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306300 00000100:00100000:0.0:1746066817.329178:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.329400:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985535872 00000100:00100000:3.0:1746066817.329410:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985535872 00010000:00010000:3.0:1746066817.329448:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.329492:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9471 00000100:00100000:3.0:1746066817.329500:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985535872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.329514:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.329535:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.329548:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.329572:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb1e42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3076096->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c0d expref: 25 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.329606:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.329609:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.329617:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.329626:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.329660:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.329672:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985154304:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.329755:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.334021:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985154304:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.334044:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.334094:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985535872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4593us (4925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.334104:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9471 00000100:00100000:0.0:1746066817.337841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.337923:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.338016:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985536128 00000100:00100000:2.0:1746066817.338024:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985536128 00000100:00100000:2.0:1746066817.338061:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20648 00000100:00100000:2.0:1746066817.338068:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3526:x1830882985536128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.338083:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.338097:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c6f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.338122:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.338131:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.338141:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.338142:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.338146:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.338170:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.338181:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 33 pid: 3528 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066817.338191:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154432:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.339482:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985536256 00000100:00100000:3.0:1746066817.339493:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985536256 00002000:00100000:3.0:1746066817.339534:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800958aca80 x1830882985536256/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.339544:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882985536256 ext(2097152->3145727) 00002000:00010000:3.0:1746066817.339549:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958aca80 00010000:00010000:2.0:1746066817.339611:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.339622:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.339657:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7800 00000100:00100000:3.0:1746066817.339664:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985536256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066817.339780:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154560:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.339813:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.343936:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.345187:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.345224:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.345248:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac400, rc 0) 00000100:00100000:2.0:1746066817.345297:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3526:x1830882985536128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7229us (7689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.345305:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20648 00000100:00100000:0.0:1746066817.347309:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.351861:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985536512 00000100:00100000:3.0:1746066817.351873:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985536512 00010000:00010000:3.0:1746066817.351920:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.351921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.351941:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985536384 00000100:00100000:3.0:1746066817.351943:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985536384 00010000:00010000:3.0:1746066817.351951:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 34 pid: 3528 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746066817.351978:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9472 00000100:00100000:3.0:1746066817.351986:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9473 00000100:00100000:3.0:1746066817.351992:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985536384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066817.351995:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985536512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.352003:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.352009:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.352019:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 34 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.352028:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 34 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746066817.352030:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.352046:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb1cba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b3b expref: 34 pid: 3528 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746066817.352049:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.352063:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066817.352074:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0d600/0xf1867c21abfb1cb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b34 expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.352094:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.352096:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.352103:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.352111:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.352114:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985536384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.352121:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9473 00010000:00010000:1.0:1746066817.352144:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.352157:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985154688:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066817.352229:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.352416:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985536256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12752us (14492us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066817.352426:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7800 00002000:00100000:3.0:1746066817.352433:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800958aca80 x1830882985536256/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.352440:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882985536256 ext(2097152->3145727) 00002000:00010000:3.0:1746066817.352444:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958aca80 00000100:00100000:0.0:1746066817.353547:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.353606:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985536768 00000100:00100000:3.0:1746066817.353611:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985536768 00000100:00100000:3.0:1746066817.353676:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17301 00000100:00100000:3.0:1746066817.353682:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:3533:x1830882985536768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.353698:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.353710:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a600/0xf1867c21abfb1ee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c76 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.353711:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985154688:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066817.353727:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066817.353761:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353771:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353778:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353788:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353792:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066817.353794:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985536512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1805us (6492us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066817.353796:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066817.353811:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9472 00010000:00010000:3.0:1746066817.353879:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1ef8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353908:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353913:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066817.353919:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066817.353975:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353981:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353985:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353991:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.353995:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066817.353998:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354004:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354012:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066817.354014:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066817.354017:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354024:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354033:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354036:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354039:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354041:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066817.354042:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354044:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354047:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093a37400) 00010000:00010000:3.0:1746066817.354049:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066817.354050:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354052:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfb1ef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.354073:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a600/0xf1867c21abfb1ee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c76 expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.354079:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c76 expref: 51 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.354085:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.354087:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066817.354088:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b600, rc 0) 00000100:00100000:3.0:1746066817.354114:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:3533:x1830882985536768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 433us (570us total) trans 8589937794 rc 0/0 00000100:00100000:3.0:1746066817.354117:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17301 00000100:00100000:0.0:1746066817.354211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.354269:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537024 00000100:00100000:3.0:1746066817.354273:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537024 00002000:00100000:3.0:1746066817.354293:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->1507327) req@ffff8800958ae680 x1830882985537024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.354301:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ae680 with x1830882985537024 ext(1503232->1507327) 00002000:00010000:3.0:1746066817.354304:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ae680 00000100:00100000:3.0:1746066817.354317:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7801 00000100:00100000:3.0:1746066817.354322:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985537024:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.354417:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985537024:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 94us (205us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.354422:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7801 00002000:00100000:3.0:1746066817.354427:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->1507327) req@ffff8800958ae680 x1830882985537024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.354433:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ae680 with x1830882985537024 ext(1503232->1507327) 00002000:00010000:3.0:1746066817.354435:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ae680 00000100:00100000:0.0:1746066817.357082:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.357239:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537280 00000100:00100000:2.0:1746066817.357248:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537280 00000100:00100000:0.0:1746066817.357260:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.357298:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6530 00000100:00100000:2.0:1746066817.357306:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:3533:x1830882985537280:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066817.357321:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537408 00000100:00100000:1.0:1746066817.357328:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537408 00000100:00100000:1.0:1746066817.357386:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 950 00000100:00100000:1.0:1746066817.357393:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882985537408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.357403:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.357422:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfb1ef8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c76 expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.357446:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066817.357449:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.357483:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882985537408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.357489:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 950 00000100:00100000:2.0:1746066817.357679:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:3533:x1830882985537280:12345-192.168.204.16@tcp:35:cat.0 Request processed in 373us (606us total) trans 8589937795 rc 0/0 00000100:00100000:2.0:1746066817.357687:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6530 00000100:00100000:2.0:1746066817.358686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.358714:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537536 00000100:00100000:0.0:1746066817.358718:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537536 00000100:00100000:0.0:1746066817.358749:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20649 00000100:00100000:0.0:1746066817.358755:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3530:x1830882985537536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066817.358765:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066817.358779:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c7d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.358804:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.358810:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066817.358812:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066817.358815:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.358838:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.358848:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 32 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.358858:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066817.359124:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.359903:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.359930:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.359960:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.359982:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537664 00000100:00100000:3.0:1746066817.359986:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537664 00000100:00100000:2.0:1746066817.360000:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537792 00000100:00100000:2.0:1746066817.360003:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537792 00000100:00100000:3.0:1746066817.360006:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985537920 00000100:00100000:3.0:1746066817.360008:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985537920 00000100:00100000:2.0:1746066817.360021:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20650 00000100:00100000:3.0:1746066817.360026:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20651 00000100:00100000:2.0:1746066817.360026:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985537664:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066817.360031:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985537792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.360033:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.360038:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.360041:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb1f0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c84 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.360044:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629be00/0xf1867c21abfb1f14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c8b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.360066:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985154944:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066817.360066:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985155072:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066817.360118:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20652 00000100:00100000:1.0:1746066817.360125:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985537920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.360133:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.360141:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c92 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.360150:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.360152:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.360157:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.360167:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.360175:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2a00, rc 0) 00000100:00100000:2.0:1746066817.360345:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.360438:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.360451:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985537920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.360457:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20652 00000100:00100000:0.0:1746066817.362539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.362616:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538048 00000100:00100000:1.0:1746066817.362624:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538048 00000100:00100000:0.0:1746066817.362626:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.362660:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20653 00000100:00100000:1.0:1746066817.362666:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3526:x1830882985538048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066817.362676:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.362687:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7c99 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.362709:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.362717:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.362723:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066817.362724:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066817.362727:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.362747:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.362757:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985154816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.362757:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.362767:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155200:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.362783:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.362798:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098890200, rc 0) 00000100:00100000:2.0:1746066817.362829:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3530:x1830882985537536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4074us (4144us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066817.362832:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.362838:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20649 00010000:00010000:1.0:1746066817.362841:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.362850:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155328:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.362867:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066817.362871:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066817 -> 1746066818 00000100:00100000:3.0:1746066817.362874:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985154944:192.168.204.16@tcp:106: 00002000:00010000:2.0:1746066817.362874:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066817 -> 1746066818 00002000:00010000:2.0:1746066817.362876:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066817 -> 1746066818 00000100:00100000:2.0:1746066817.362905:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985155072:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066817.362917:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629be00/0xf1867c21abfb1f14 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c8b expref: 36 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.362918:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb1f0d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c84 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.362926:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb1f0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c84 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.362927:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629be00/0xf1867c21abfb1f14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c8b expref: 36 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.362955:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629be00, rc 0) 00010000:00010000:2.0:1746066817.362955:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:2.0:1746066817.362974:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985537664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2947us (3071us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066817.362979:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20650 00000100:00100000:3.0:1746066817.363239:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985537792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3206us (3306us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.363244:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20651 00000100:00100000:3.0:1746066817.363265:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538176 00000100:00100000:3.0:1746066817.363269:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538176 00002000:00100000:3.0:1746066817.363297:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3833855) req@ffff8800958af800 x1830882985538176/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.363305:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af800 with x1830882985538176 ext(3145728->3833855) 00010000:00010000:3.0:1746066817.363311:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.363322:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 33 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.363332:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958af800 00000100:00100000:3.0:1746066817.363363:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2230 00000100:00100000:3.0:1746066817.363369:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985538176:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066817.368932:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.368984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.369042:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538304 00000100:00100000:3.0:1746066817.369051:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538304 00010000:00010000:3.0:1746066817.369085:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.369110:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538432 00000100:00100000:3.0:1746066817.369112:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538432 00010000:00010000:3.0:1746066817.369122:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.369136:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9474 00000100:00100000:0.0:1746066817.369147:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882985538304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066817.369148:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9475 00000100:00100000:3.0:1746066817.369157:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985538432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066817.369159:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.369165:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.369178:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.369178:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.369189:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.369218:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.369234:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155328:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066817.369591:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.369614:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb1ece lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c61 expref: 17 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.369634:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066817.369672:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985538304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 529us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066817.369679:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9474 00010000:00010000:3.0:1746066817.369694:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c5800/0xf1867c21abfb1e50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c1b expref: 35 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.369713:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.369732:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985538432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 579us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.369739:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9475 00010000:00010000:1.0:1746066817.369940:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.369952:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3800, rc 0) 00000100:00100000:1.0:1746066817.369975:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3526:x1830882985538048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7309us (7445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.369982:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20653 00000100:00100000:3.0:1746066817.371945:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985538176:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8567us (9309us total) trans 17179875427 rc 0/0 00000100:00100000:3.0:1746066817.371955:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2230 00002000:00100000:3.0:1746066817.371965:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3833855) req@ffff8800958af800 x1830882985538176/t17179875427(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.371974:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af800 with x1830882985538176 ext(3145728->3833855) 00010000:00010000:3.0:1746066817.371982:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 34 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.371994:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 34 pid: 9590 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.372000:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958af800 00000100:00100000:2.0:1746066817.373655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.373909:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538560 00000100:00100000:1.0:1746066817.373916:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538560 00000100:00100000:1.0:1746066817.373963:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20654 00000100:00100000:1.0:1746066817.373975:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3533:x1830882985538560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.373993:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.374012:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ca0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.374039:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.374047:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.374048:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.374053:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.374083:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.374094:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 14 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.374105:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.374252:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.376003:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.376114:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985155456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.376140:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.376156:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2800, rc 0) 00000100:00100000:3.0:1746066817.376168:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538688 00000100:00100000:3.0:1746066817.376178:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538688 00000100:00100000:1.0:1746066817.376204:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3533:x1830882985538560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2233us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.376212:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20654 00002000:00100000:3.0:1746066817.376223:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->2097151) req@ffff8800958adf80 x1830882985538688/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.376237:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882985538688 ext(1503232->2097151) 00010000:00010000:3.0:1746066817.376245:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.376256:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 15 pid: 3528 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.376263:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958adf80 00000100:00100000:3.0:1746066817.376288:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2231 00000100:00100000:3.0:1746066817.376295:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985538688:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066817.377392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.377696:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538816 00000100:00100000:3.0:1746066817.377701:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538816 00010000:00010000:3.0:1746066817.377722:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 35 pid: 9590 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.377759:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9476 00000100:00100000:3.0:1746066817.377765:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985538816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.377774:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.377788:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 35 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.377807:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 35 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.377827:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb1e49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c14 expref: 35 pid: 9590 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.377850:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.377852:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.377858:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.377866:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.377873:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.377874:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.377877:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 16 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.377906:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 16 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.377931:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 16 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.377941:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155584:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.378010:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.378019:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155712:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.378036:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.382563:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.382648:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985538944 00000100:00100000:3.0:1746066817.382650:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155584:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066817.382655:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985538944 00000100:00100000:0.0:1746066817.382703:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17302 00000100:00100000:0.0:1746066817.382710:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3534:x1830882985538944:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066817.382728:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066817.382742:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ca7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.382760:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155712:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.382777:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066817.382789:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382800:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382810:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066817.382821:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985538816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5056us (5431us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066817.382821:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382826:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066817.382830:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9476 00010000:00010000:0.0:1746066817.382831:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382926:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382937:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 50 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.382943:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.382966:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 50 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.382975:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 50 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.382985:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985155840:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066817.383037:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.383337:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882985538688:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7041us (7339us total) trans 17179875428 rc 0/0 00000100:00100000:3.0:1746066817.383345:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2231 00002000:00100000:3.0:1746066817.383364:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->2097151) req@ffff8800958adf80 x1830882985538688/t17179875428(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.383374:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882985538688 ext(1503232->2097151) 00010000:00010000:3.0:1746066817.383380:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.383391:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.383397:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958adf80 00000100:00100000:0.0:1746066817.383812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.383849:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985539200 00000100:00100000:3.0:1746066817.383853:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985539200 00002000:00100000:3.0:1746066817.383870:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2416640->2420735) req@ffff8800958ac700 x1830882985539200/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.383878:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882985539200 ext(2416640->2420735) 00002000:00010000:3.0:1746066817.383896:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ac700 00000100:00100000:3.0:1746066817.383914:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7802 00000100:00100000:3.0:1746066817.383920:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985539200:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.384205:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985539200:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 283us (393us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.384211:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7802 00002000:00100000:3.0:1746066817.384215:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2416640->2420735) req@ffff8800958ac700 x1830882985539200/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.384222:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882985539200 ext(2416640->2420735) 00002000:00010000:3.0:1746066817.384225:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ac700 00000100:00100000:2.0:1746066817.385006:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985155840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.385024:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066817.385403:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.385963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.385996:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.386042:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985539584 00000100:00100000:3.0:1746066817.386047:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985539584 00000100:00100000:2.0:1746066817.386059:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985539456 00000100:00100000:2.0:1746066817.386063:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985539456 00010000:00010000:3.0:1746066817.386067:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.386084:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985539840 00000100:00100000:2.0:1746066817.386086:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985539840 00000100:00100000:3.0:1746066817.386088:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9477 00000100:00100000:3.0:1746066817.386093:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2014:x1830882985539584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066817.386099:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6531 00010000:00010000:3.0:1746066817.386102:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066817.386103:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:16320:x1830882985539456:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746066817.386115:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.386124:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.386140:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac400/0xf1867c21abfb1edc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c6f expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.386161:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.386163:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.386168:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.386176:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.386198:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.386206:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155968:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.386255:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.386282:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6532 00000100:00100000:1.0:1746066817.386288:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3526:x1830882985539840:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066817.388908:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:16320:x1830882985539456:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 2796us (3497us total) trans 8589937796 rc 0/0 00000100:00100000:2.0:1746066817.388918:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6531 00000100:00100000:0.0:1746066817.388977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.388985:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3526:x1830882985539840:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 2696us (2988us total) trans 8589937797 rc 0/0 00000100:00100000:1.0:1746066817.388991:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6532 00000100:00100000:0.0:1746066817.389036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.389072:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985540224 00000100:00100000:1.0:1746066817.389078:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985540224 00002000:00100000:1.0:1746066817.389104:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8801310f0a80 x1830882985540224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.389112:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0a80 with x1830882985540224 ext(3145728->4194303) 00002000:00010000:1.0:1746066817.389117:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0a80 00000100:00100000:1.0:1746066817.389129:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985540352 00000100:00100000:1.0:1746066817.389132:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985540352 00002000:00100000:1.0:1746066817.389142:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8801310f1880 x1830882985540352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.389148:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1880 with x1830882985540352 ext(3145728->4194303) 00002000:00010000:1.0:1746066817.389151:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f1880 00000100:00100000:3.0:1746066817.389161:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7803 00000100:00100000:3.0:1746066817.389169:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985540224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066817.389212:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7804 00000100:00100000:1.0:1746066817.389218:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985540352:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.392641:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985155968:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066817.392642:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066817.392660:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.392695:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985540480 00000100:00100000:3.0:1746066817.392699:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985539584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6604us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.392703:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985540480 00000100:00100000:3.0:1746066817.392708:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9477 00010000:00010000:1.0:1746066817.392731:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 52 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.392765:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9478 00000100:00100000:1.0:1746066817.392773:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882985540480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.392783:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.392788:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 52 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.392798:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 52 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.392820:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507e00/0xf1867c21abfb1d4d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b96 expref: 52 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.392832:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066817.392836:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.392844:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.392850:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.392866:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.392923:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882985540480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.392929:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9478 00010000:00010000:2.0:1746066817.392997:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393004:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.393046:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066817.393049:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066817.393063:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393070:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393079:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393084:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393089:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393097:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393101:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.393104:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393109:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393115:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.393117:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.393120:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393129:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2400/0xf1867c21abfb1f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393138:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393143:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393147:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393150:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.393151:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393155:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393163:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a438eb00) 00010000:00010000:2.0:1746066817.393165:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.393167:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393171:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfb1f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.393196:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfb1f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.393207:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.393212:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.393214:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066817.393216:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3600, rc 0) 00000100:00100000:2.0:1746066817.393252:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3534:x1830882985538944:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 10541us (10696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.393258:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17302 00000100:00100000:0.0:1746066817.396679:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.396865:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985540224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7691us (7883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066817.396876:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7803 00002000:00100000:3.0:1746066817.396907:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8801310f0a80 x1830882985540224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.396917:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0a80 with x1830882985540224 ext(3145728->4194303) 00002000:00010000:3.0:1746066817.396924:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0a80 00000100:00100000:2.0:1746066817.397084:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985540736 00000100:00100000:2.0:1746066817.397093:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985540736 00000100:00100000:2.0:1746066817.397140:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17303 00000100:00100000:2.0:1746066817.397148:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:3536:x1830882985540736:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.397167:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.397184:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cae expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.397257:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066817.397264:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397278:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397288:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397302:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397307:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066817.397397:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985540352:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8178us (8359us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066817.397403:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7804 00002000:00100000:1.0:1746066817.397408:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8801310f1880 x1830882985540352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.397416:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1880 with x1830882985540352 ext(3145728->4194303) 00002000:00010000:1.0:1746066817.397420:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f1880 00000100:00100000:1.0:1746066817.397430:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985540992 00000100:00100000:1.0:1746066817.397433:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985540992 00002000:00100000:1.0:1746066817.397450:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8801310f2680 x1830882985540992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066817.397456:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00002000:00100000:1.0:1746066817.397457:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882985540992 ext(1048576->2097151) 00002000:00010000:1.0:1746066817.397460:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f2680 00000100:00100000:1.0:1746066817.397471:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7805 00000100:00100000:1.0:1746066817.397475:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985540992:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746066817.397643:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397653:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397659:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.397666:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066817.397734:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397740:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397749:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397754:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397827:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.397832:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397837:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397847:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.397849:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.397853:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397857:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb1f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397868:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397871:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397876:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397880:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.397955:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397965:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397972:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9c00) 00010000:00010000:2.0:1746066817.397974:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.397976:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.397981:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb1f5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.398014:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfb1f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 54 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.398024:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 53 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.398029:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.398031:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066817.398033:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac000, rc 0) 00000100:00100000:2.0:1746066817.398052:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+53:3536:x1830882985540736:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 906us (1384us total) trans 8589937798 rc 0/0 00000100:00100000:2.0:1746066817.398058:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17303 00000100:00100000:2.0:1746066817.398509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.398854:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541120 00000100:00100000:3.0:1746066817.398859:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541120 00000100:00100000:0.0:1746066817.399267:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.399292:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.399321:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.399401:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541248 00000100:00100000:2.0:1746066817.399405:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541248 00000100:00100000:2.0:1746066817.399427:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541376 00000100:00100000:2.0:1746066817.399429:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541376 00000100:00100000:2.0:1746066817.399438:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541504 00000100:00100000:2.0:1746066817.399440:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541504 00000100:00100000:2.0:1746066817.399677:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20655 00000100:00100000:2.0:1746066817.399684:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985541248:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066817.399696:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.399709:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cbc expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.399726:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.399727:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.399736:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.399746:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066817.399939:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20656 00000100:00100000:3.0:1746066817.399945:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985541376:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066817.399951:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.399958:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfb1f76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cc3 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.399973:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfb1f76 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cc3 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.399981:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfb1f76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cc3 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.399991:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b400, rc 0) 00000100:00100000:3.0:1746066817.400028:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985541376:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 83us (735us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.400033:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20656 00000100:00100000:3.0:1746066817.400046:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20657 00000100:00100000:3.0:1746066817.400050:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985541504:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066817.400057:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.400064:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cca expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.400080:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.400081:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.400085:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.400095:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.400203:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07c00, rc 0) 00000100:00080000:0.0:1746066817.400211:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066817.400220:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985541248:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 536us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.400225:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20655 00000100:00100000:1.0:1746066817.400273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.400405:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541760 00000100:00100000:0.0:1746066817.400409:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541760 00002000:00100000:0.0:1746066817.400437:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094305180 x1830882985541760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066817.400446:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882985541760 ext(4194304->4861951) 00002000:00010000:0.0:1746066817.400450:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:0.0:1746066817.400474:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7806 00000100:00100000:0.0:1746066817.400479:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985541760:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746066817.400763:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00000100:00100000:3.0:1746066817.400786:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985541504:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 734us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.400792:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20657 00000100:00100000:3.0:1746066817.400831:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20658 00000100:00100000:3.0:1746066817.400837:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985541120:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066817.400843:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.400851:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cb5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.400868:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.400870:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.400875:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.400902:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.400914:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:3.0:1746066817.400930:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985541120:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 93us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.400935:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20658 00000100:00100000:0.0:1746066817.403445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.403487:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.403611:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985541888 00000100:00100000:3.0:1746066817.403620:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985541888 00000100:00100000:3.0:1746066817.403661:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542016 00000100:00100000:3.0:1746066817.403664:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542016 00000100:00100000:3.0:1746066817.403678:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20659 00000100:00100000:3.0:1746066817.403684:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985541888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.403700:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066817.403714:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20660 00010000:00010000:3.0:1746066817.403715:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cd1 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.403721:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985542016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066817.403728:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066817.403736:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfb1f92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cd8 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.403737:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.403738:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.403747:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066817.403756:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfb1f92 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd8 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.403760:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066817.403767:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfb1f92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd8 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.403769:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a200, rc 0) 00010000:00010000:0.0:1746066817.403789:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0c00, rc 0) 00000100:00100000:3.0:1746066817.403821:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985541888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 137us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066817.403824:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985542016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 104us (335us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.403827:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20659 00000100:00100000:0.0:1746066817.403830:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20660 00000100:00100000:0.0:1746066817.406367:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.406663:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542272 00000100:00100000:2.0:1746066817.406671:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542272 00000100:00100000:2.0:1746066817.406728:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17304 00000100:00100000:2.0:1746066817.406737:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3534:x1830882985542272:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066817.406756:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.406774:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfb1f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cdf expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.406909:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.406925:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.406932:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.406938:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.406969:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.406980:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 52 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.406992:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985156096:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.407685:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.407693:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 10 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.407701:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985156224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.407741:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.409329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.409350:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542400 00000100:00100000:2.0:1746066817.409363:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542400 00000100:00100000:3.0:1746066817.409365:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985156224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.409627:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985540992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12149us (12368us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066817.409635:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7805 00002000:00100000:1.0:1746066817.409644:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8801310f2680 x1830882985540992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.409652:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882985540992 ext(1048576->2097151) 00002000:00010000:1.0:1746066817.409656:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f2680 00000100:00100000:3.0:1746066817.409794:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985156096:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.409814:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066817.409859:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985541760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9379us (9586us total) trans 0 rc 667648/667648 00000100:00100000:0.0:1746066817.409866:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7806 00002000:00100000:0.0:1746066817.409872:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094305180 x1830882985541760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066817.409879:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882985541760 ext(4194304->4861951) 00002000:00010000:0.0:1746066817.409895:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00010000:00010000:2.0:1746066817.409948:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 11 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.409973:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9479 00000100:00100000:2.0:1746066817.409981:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985542400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.409992:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.409997:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 11 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410006:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 11 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410026:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3600/0xf1867c21abfb1f45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca7 expref: 11 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410042:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.410050:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.410058:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.410161:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.410365:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985542400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 384us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.410371:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9479 00000100:00100000:0.0:1746066817.410437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.410544:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542528 00000100:00100000:2.0:1746066817.410547:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542528 00010000:00010000:2.0:1746066817.410560:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 53 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.410632:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9480 00000100:00100000:2.0:1746066817.410638:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985542528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.410644:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.410648:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 53 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410655:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 53 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410665:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfb1f61 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cae expref: 53 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.410673:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.410675:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.410681:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.410686:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.410699:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.410715:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985542528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.410719:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9480 00010000:00010000:3.0:1746066817.410783:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066817.410792:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066817.410810:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066817.410954:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfb1f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cdf expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.410971:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cdf expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.410977:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.410979:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066817.410981:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728a00, rc 0) 00000100:00100000:3.0:1746066817.411013:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3534:x1830882985542272:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4278us (4667us total) trans 8589937799 rc 0/0 00000100:00100000:3.0:1746066817.411019:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17304 00000100:00100000:0.0:1746066817.412122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.412166:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542656 00000100:00100000:3.0:1746066817.412171:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542656 00000100:00100000:3.0:1746066817.412201:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20661 00000100:00100000:3.0:1746066817.412206:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3536:x1830882985542656:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066817.412219:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.412235:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ce6 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.412256:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.412263:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.412265:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.412269:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->4001791] (req 3698688->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.412281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066817.412294:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.412305:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 16 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.412316:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985542912 00000100:00100000:3.0:1746066817.412317:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985156352:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.412319:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985542912 00000100:00100000:2.0:1746066817.412347:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17305 00000100:00100000:2.0:1746066817.412363:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+10:3534:x1830882985542912:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066817.412376:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.412378:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1746066817.412383:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746066817.412389:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb1fa0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cdf expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.412398:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.412401:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066817.412506:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfb1fb5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ced expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.412583:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412592:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412599:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412608:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412614:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412620:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412626:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d06600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.412630:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412636:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412643:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.412645:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066817.412648:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412651:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb1fbc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.412670:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfb1fb5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ced expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.412676:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfb1fb5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ced expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.412683:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07e00, rc 0) 00000100:00100000:2.0:1746066817.412717:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3534:x1830882985542912:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 363us (434us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066817.412723:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17305 00000100:00100000:0.0:1746066817.414024:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.414071:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543296 00000100:00100000:1.0:1746066817.414075:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543296 00000100:00100000:2.0:1746066817.414085:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985156352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.414099:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6533 00010000:00010000:2.0:1746066817.414105:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->4001791] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.414105:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3534:x1830882985543296:12345-192.168.204.16@tcp:35:mirror_io.0 00010000:00010000:2.0:1746066817.414118:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ac00, rc 0) 00000100:00100000:2.0:1746066817.414139:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3536:x1830882985542656:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1933us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.414148:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20661 00000100:00100000:1.0:1746066817.414233:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3534:x1830882985543296:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 128us (211us total) trans 8589937800 rc 0/0 00000100:00100000:1.0:1746066817.414239:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6533 00000100:00100000:0.0:1746066817.414941:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.415110:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543168 00000100:00100000:2.0:1746066817.415114:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543168 00000100:00100000:2.0:1746066817.415148:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20662 00000100:00100000:2.0:1746066817.415153:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985543168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.415162:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.415174:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d06a00/0xf1867c21abfb1fc3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cf4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.415193:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d06a00/0xf1867c21abfb1fc3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cf4 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.415201:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06a00/0xf1867c21abfb1fc3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cf4 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.415208:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06a00, rc 0) 00000100:00100000:2.0:1746066817.415239:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985543168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 85us (298us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066817.415244:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20662 00000100:00100000:0.0:1746066817.415569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.415633:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543424 00000100:00100000:1.0:1746066817.415637:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543424 00010000:00010000:1.0:1746066817.415654:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.415677:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9481 00000100:00100000:1.0:1746066817.415682:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882985543424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.415691:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.415708:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.415718:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.415735:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb1f06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c7d expref: 17 pid: 3528 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.415744:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.415746:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.415753:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.415761:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.415790:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.415802:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156480:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066817.415873:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.417220:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.417261:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.417373:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543552 00000100:00100000:2.0:1746066817.417380:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543552 00000100:00100000:2.0:1746066817.417406:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543680 00000100:00100000:2.0:1746066817.417408:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543680 00000100:00100000:2.0:1746066817.417422:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20663 00000100:00100000:2.0:1746066817.417428:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:3533:x1830882985543552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.417442:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.417456:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7cfb expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.417477:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.417484:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.417486:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.417489:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.417512:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.417523:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.417535:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985156608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.417583:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.417628:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20664 00000100:00100000:3.0:1746066817.417636:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3530:x1830882985543680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.417644:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.417652:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d02 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.417668:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.417680:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.417681:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.417684:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.417700:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.417954:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.417963:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985156736:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.418009:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.419503:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985156736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.419503:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985156608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.419524:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.419540:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00010000:00010000:2.0:1746066817.419564:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.419572:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06e00, rc 0) 00000100:00100000:3.0:1746066817.419579:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3530:x1830882985543680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1943us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.419586:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20664 00000100:00100000:2.0:1746066817.419592:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3533:x1830882985543552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2164us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.419598:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20663 00000100:00100000:1.0:1746066817.419661:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156480:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066817.419675:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.419698:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2013:x1830882985543424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4015us (4128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.419706:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9481 00000100:00100000:0.0:1746066817.419743:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.419757:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985544064 00000100:00100000:1.0:1746066817.419762:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985544064 00000100:00100000:0.0:1746066817.419787:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066817.419791:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->3702783) req@ffff880098924a80 x1830882985544064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.419800:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882985544064 ext(3698688->3702783) 00010000:00010000:1.0:1746066817.419806:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.419815:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746066817.419821:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098924a80 00000100:00100000:1.0:1746066817.419836:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985543808 00000100:00100000:1.0:1746066817.419838:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985543808 00002000:00100000:1.0:1746066817.419849:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff880098927100 x1830882985543808/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.419856:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927100 with x1830882985543808 ext(2097152->2420735) 00010000:00010000:1.0:1746066817.419860:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.419867:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 17 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746066817.419876:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098927100 00000100:00100000:1.0:1746066817.419910:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2232 00000100:00100000:1.0:1746066817.419916:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985544064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.419971:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2233 00000100:00100000:2.0:1746066817.419978:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985543808:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066817.420021:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985544064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 105us (279us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.420025:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2232 00002000:00100000:1.0:1746066817.420030:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->3702783) req@ffff880098924a80 x1830882985544064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.420036:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882985544064 ext(3698688->3702783) 00010000:00010000:1.0:1746066817.420040:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.420046:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746066817.420051:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098924a80 00000100:00100000:2.0:1746066817.423387:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985543808:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3399us (3589us total) trans 17179875429 rc 0/0 00000100:00100000:2.0:1746066817.423399:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2233 00002000:00100000:2.0:1746066817.423412:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff880098927100 x1830882985543808/t17179875429(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.423421:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927100 with x1830882985543808 ext(2097152->2420735) 00010000:00010000:2.0:1746066817.423430:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.423432:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066817.423442:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.423448:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098927100 00000100:00100000:2.0:1746066817.423468:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985544320 00000100:00100000:2.0:1746066817.423473:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985544320 00002000:00100000:2.0:1746066817.423499:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3997696->4001791) req@ffff880094304700 x1830882985544320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.423506:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830882985544320 ext(3997696->4001791) 00010000:00010000:2.0:1746066817.423511:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.423518:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.423530:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:2.0:1746066817.423546:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2234 00000100:00100000:2.0:1746066817.423553:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985544320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.423637:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985544320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 84us (204us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066817.423643:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2234 00002000:00100000:2.0:1746066817.423870:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3997696->4001791) req@ffff880094304700 x1830882985544320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.423878:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830882985544320 ext(3997696->4001791) 00010000:00010000:2.0:1746066817.424097:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.424105:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.424112:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746066817.424731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.424876:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985544448 00000100:00100000:1.0:1746066817.424880:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985544448 00010000:00010000:1.0:1746066817.424913:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.424942:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9482 00000100:00100000:1.0:1746066817.424947:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985544448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.424958:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.424970:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.424979:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.424999:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3800/0xf1867c21abfb1f22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2420735) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c99 expref: 19 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746066817.425014:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.425015:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.425022:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.425029:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.425059:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.425069:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156864:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066817.425141:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.430441:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.430483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.430570:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985544960 00000100:00100000:1.0:1746066817.430580:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985544960 00000100:00100000:1.0:1746066817.430631:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6534 00000100:00100000:1.0:1746066817.430638:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:3536:x1830882985544960:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066817.430783:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.430811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.430824:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985544704 00000100:00100000:0.0:1746066817.430827:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985544704 00000100:00100000:1.0:1746066817.430850:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:3536:x1830882985544960:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 211us (419us total) trans 8589937801 rc 0/0 00002000:00100000:0.0:1746066817.430852:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->4001791) req@ffff880098925c00 x1830882985544704/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066817.430857:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6534 00002000:00100000:0.0:1746066817.430862:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882985544704 ext(3698688->4001791) 00010000:00010000:0.0:1746066817.430870:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.430902:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 36 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746066817.430909:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098925c00 00000100:00100000:1.0:1746066817.430916:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156864:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066817.430921:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985545344 00000100:00100000:0.0:1746066817.430923:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985545344 00002000:00100000:0.0:1746066817.430934:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098924e00 x1830882985545344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066817.430936:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746066817.430940:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882985545344 ext(2097152->3145727) 00002000:00010000:0.0:1746066817.430943:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:0.0:1746066817.430952:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985545472 00000100:00100000:0.0:1746066817.430954:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985545472 00000100:00100000:1.0:1746066817.430956:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985544448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6008us (6225us total) trans 0 rc 0/0 00002000:00100000:0.0:1746066817.430964:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098925500 x1830882985545472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066817.430965:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9482 00002000:00100000:0.0:1746066817.430970:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925500 with x1830882985545472 ext(2097152->3145727) 00002000:00010000:0.0:1746066817.430972:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925500 00000100:00100000:0.0:1746066817.430999:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2235 00000100:00100000:0.0:1746066817.431005:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985544704:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066817.431022:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7807 00000100:00100000:1.0:1746066817.431029:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985545344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.431285:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7808 00000100:00100000:2.0:1746066817.431293:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985545472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.440471:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985544704:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9333us (9854us total) trans 17179875430 rc 0/0 00000100:00100000:2.0:1746066817.440487:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2235 00002000:00100000:2.0:1746066817.440502:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3698688->4001791) req@ffff880098925c00 x1830882985544704/t17179875430(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.440517:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882985544704 ext(3698688->4001791) 00010000:00010000:2.0:1746066817.440527:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 40 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.440543:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 40 pid: 11630 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.440549:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098925c00 00000100:00100000:0.0:1746066817.442637:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.442723:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985545600 00000100:00100000:2.0:1746066817.442733:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985545600 00010000:00010000:2.0:1746066817.442766:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 39 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746066817.442771:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985545344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11740us (11985us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066817.442782:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7807 00002000:00100000:1.0:1746066817.442792:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098924e00 x1830882985545344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.442801:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882985545344 ext(2097152->3145727) 00000100:00100000:2.0:1746066817.442805:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9483 00002000:00010000:1.0:1746066817.442805:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:2.0:1746066817.442811:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985545600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.442827:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.442850:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.442860:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.443037:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629ac00/0xf1867c21abfb1fae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ce6 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.443069:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.443071:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.443077:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.443083:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.443110:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.443121:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156992:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066817.443349:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.444015:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985545472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12722us (13202us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.444023:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7808 00002000:00100000:2.0:1746066817.444030:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098925500 x1830882985545472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.444037:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925500 with x1830882985545472 ext(2097152->3145727) 00002000:00010000:2.0:1746066817.444041:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925500 00000100:00100000:0.0:1746066817.445565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.445663:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985156992:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.445679:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.445715:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985545600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2904us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.445726:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9483 00000100:00100000:3.0:1746066817.445765:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985545856 00000100:00100000:3.0:1746066817.445771:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985545856 00002000:00100000:3.0:1746066817.445802:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff880098926d80 x1830882985545856/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.445816:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882985545856 ext(4857856->4861951) 00002000:00010000:3.0:1746066817.445820:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:3.0:1746066817.445834:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7809 00000100:00100000:3.0:1746066817.445841:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985545856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.446050:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985545856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 209us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.446056:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7809 00002000:00100000:3.0:1746066817.446061:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff880098926d80 x1830882985545856/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.446068:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882985545856 ext(4857856->4861951) 00002000:00010000:3.0:1746066817.446070:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066817.450967:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.451519:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985545984 00000100:00100000:2.0:1746066817.451552:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985545984 00000100:00100000:2.0:1746066817.451616:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20665 00000100:00100000:2.0:1746066817.451624:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:3533:x1830882985545984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.451639:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.451652:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d09 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.451674:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.451676:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.451682:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.451695:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.451704:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07800, rc 0) 00000100:00100000:2.0:1746066817.451765:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+38:3533:x1830882985545984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 141us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.451770:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20665 00000100:00100000:0.0:1746066817.459488:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.459541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.459677:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985546240 00000100:00100000:1.0:1746066817.459680:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985546496 00000100:00100000:3.0:1746066817.459689:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985546240 00000100:00100000:1.0:1746066817.459690:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985546496 00002000:00100000:3.0:1746066817.459727:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880098924000 x1830882985546240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.459728:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880098925180 x1830882985546496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.459735:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925180 with x1830882985546496 ext(3145728->4194303) 00002000:00010000:1.0:1746066817.459740:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925180 00000100:00100000:1.0:1746066817.459818:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7810 00000100:00100000:1.0:1746066817.459827:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985546496:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746066817.459848:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924000 with x1830882985546240 ext(3145728->4194303) 00002000:00010000:3.0:1746066817.459854:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924000 00000100:00100000:3.0:1746066817.459915:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7811 00000100:00100000:3.0:1746066817.459923:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985546240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.467796:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985546496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7954us (8238us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066817.467809:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7810 00002000:00100000:1.0:1746066817.467821:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880098925180 x1830882985546496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.467831:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925180 with x1830882985546496 ext(3145728->4194303) 00002000:00010000:1.0:1746066817.467837:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925180 00000100:00100000:3.0:1746066817.469044:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985546240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9115us (9565us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066817.469055:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7811 00002000:00100000:3.0:1746066817.469065:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880098924000 x1830882985546240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.469075:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924000 with x1830882985546240 ext(3145728->4194303) 00002000:00010000:3.0:1746066817.469079:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924000 00000100:00100000:0.0:1746066817.474486:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.474994:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985546752 00000100:00100000:3.0:1746066817.475006:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985546752 00002000:00100000:3.0:1746066817.475050:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e436a00 x1830882985546752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.475060:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436a00 with x1830882985546752 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.475064:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436a00 00000100:00100000:3.0:1746066817.475103:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7812 00000100:00100000:3.0:1746066817.475110:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985546752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.479281:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985546752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4157us (4793us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066817.479293:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7812 00002000:00100000:3.0:1746066817.479305:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e436a00 x1830882985546752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.479315:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436a00 with x1830882985546752 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.479321:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436a00 00000100:00100000:0.0:1746066817.607230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.607336:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547008 00000100:00100000:2.0:1746066817.607345:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547008 00000100:00100000:2.0:1746066817.607412:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17306 00000100:00100000:2.0:1746066817.607422:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3543:x1830882985547008:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.607446:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.607467:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb1fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d10 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.607543:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.607556:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.607567:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608326:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608335:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608342:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608463:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608473:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608479:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066817.608490:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066817.608567:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608573:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608579:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608585:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608591:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.608594:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608600:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608610:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066817.608613:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.608616:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608621:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb1fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608646:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608650:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608654:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608658:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f7200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066817.608660:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608669:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608674:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9c00) 00010000:00010000:2.0:1746066817.608675:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066817.608677:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608681:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb1fed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.608718:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb1fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.608730:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 35 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.608735:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.608737:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066817.608739:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6200, rc 0) 00000100:00100000:2.0:1746066817.608801:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:3543:x1830882985547008:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1381us (1582us total) trans 8589937802 rc 0/0 00000100:00100000:2.0:1746066817.608808:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17306 00000100:00100000:0.0:1746066817.643949:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.644025:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547136 00000100:00100000:2.0:1746066817.644035:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547136 00000100:00100000:2.0:1746066817.644100:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20666 00000100:00100000:2.0:1746066817.644110:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3543:x1830882985547136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.644317:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.644335:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d17 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.644381:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.644390:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.644397:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.644403:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.644406:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.644409:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.644440:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.644452:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 8 pid: 9590 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066817.644465:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.644570:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.644578:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066817.644586:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.645528:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.645538:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 37 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.645547:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.645568:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.646272:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.646359:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547264 00000100:00100000:3.0:1746066817.646366:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547264 00010000:00010000:3.0:1746066817.646396:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 9 pid: 9590 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746066817.646420:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9484 00000100:00100000:3.0:1746066817.646427:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985547264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.646436:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.646456:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 9 pid: 9590 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.646466:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 9 pid: 9590 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.646488:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.646530:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985547264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.646537:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9484 00010000:00010000:2.0:1746066817.647181:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfb1f6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cbc expref: 8 pid: 9590 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746066817.647634:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066817.649090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.649194:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.649202:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.649228:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.649242:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7000, rc 0) 00000100:00100000:2.0:1746066817.649678:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3543:x1830882985547136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5569us (5739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.649685:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20666 00000100:00100000:3.0:1746066817.649804:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547392 00000100:00100000:3.0:1746066817.649810:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547392 00000100:00100000:1.0:1746066817.649813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066817.649832:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746066817.649864:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547520 00000100:00100000:3.0:1746066817.649866:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547520 00010000:00010000:3.0:1746066817.649876:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.649917:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9485 00000100:00100000:3.0:1746066817.649923:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985547392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.649934:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.649950:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.649964:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.649983:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfb1f8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cd1 expref: 19 pid: 9591 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746066817.649999:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.650018:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985547392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.650023:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9485 00000100:00100000:3.0:1746066817.650034:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9486 00000100:00100000:3.0:1746066817.650038:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985547520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.650043:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.650049:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.650056:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.650066:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2800/0xf1867c21abfb1f29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ca0 expref: 38 pid: 11630 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.650074:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.650076:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.650081:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.650088:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.650111:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.650121:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985157504:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.650167:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.653186:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985157504:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.653205:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.653262:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985547520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3222us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.653272:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9486 00000100:00100000:1.0:1746066817.653923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.653986:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547776 00000100:00100000:3.0:1746066817.653992:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547776 00002000:00100000:3.0:1746066817.654024:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->1703935) req@ffff880094305c00 x1830882985547776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.654033:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882985547776 ext(1699840->1703935) 00002000:00010000:3.0:1746066817.654038:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:3.0:1746066817.654053:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7813 00000100:00100000:3.0:1746066817.654060:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985547776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.654232:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985547776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 171us (455us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.654241:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7813 00002000:00100000:3.0:1746066817.654246:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->1703935) req@ffff880094305c00 x1830882985547776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.654253:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882985547776 ext(1699840->1703935) 00002000:00010000:3.0:1746066817.654255:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305c00 00010000:00010000:3.0:1746066817.660529:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066817.662502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.662734:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985547904 00000100:00100000:2.0:1746066817.662743:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985547904 00000100:00100000:2.0:1746066817.662806:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20667 00000100:00100000:2.0:1746066817.662814:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3543:x1830882985547904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066817.662834:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.662851:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d1e expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662918:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662927:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662934:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662940:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.662942:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066817.662946:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662977:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.662989:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.663007:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157632:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.663098:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.663106:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.663115:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157760:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.663139:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.663146:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.663154:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157888:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.663170:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.667024:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.667037:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157760:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.667044:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985157888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.667080:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.667103:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7a00, rc 0) 00000100:00100000:2.0:1746066817.667721:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3543:x1830882985547904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4905us (5228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.667731:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20667 00000100:00100000:2.0:1746066817.670817:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.670857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.671607:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548288 00000100:00100000:3.0:1746066817.671617:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548288 00000100:00100000:2.0:1746066817.671645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066817.671653:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 37 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.671679:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548416 00000100:00100000:3.0:1746066817.671681:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548416 00000100:00100000:0.0:1746066817.671687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066817.671690:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.671705:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548160 00000100:00100000:0.0:1746066817.671708:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548160 00000100:00100000:0.0:1746066817.671734:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17307 00000100:00100000:0.0:1746066817.671741:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+53:3545:x1830882985548160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066817.671762:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066817.671775:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1de00/0xf1867c21abfb2010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d25 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.671870:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.671901:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 34 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.671908:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066817.671937:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 34 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.671948:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 34 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746066817.671959:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985158016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066817.672022:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.672527:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548544 00000100:00100000:2.0:1746066817.672530:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548544 00010000:00010000:2.0:1746066817.672546:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 38 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.672564:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9487 00000100:00100000:2.0:1746066817.672569:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985548288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.672578:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.672597:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 38 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672607:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 38 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672626:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfb1fca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cfb expref: 38 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672644:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.672668:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985548288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.672674:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9487 00000100:00100000:2.0:1746066817.672692:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9488 00000100:00100000:2.0:1746066817.672696:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985548416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.672704:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.672710:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672717:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672729:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb1fd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d02 expref: 19 pid: 9591 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672737:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.672751:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985548416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.672756:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9488 00000100:00100000:2.0:1746066817.672765:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9489 00000100:00100000:2.0:1746066817.672770:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985548544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.672775:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.672781:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672788:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672798:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07800/0xf1867c21abfb1fd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d09 expref: 36 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.672805:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.672807:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.672812:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.672820:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.672840:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.672848:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985158144:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066817.672869:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.674697:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.674750:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548672 00000100:00100000:0.0:1746066817.674759:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548672 00000100:00100000:0.0:1746066817.674807:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20668 00000100:00100000:0.0:1746066817.674814:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985548672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066817.674832:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066817.674846:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dd1d000/0xf1867c21abfb201e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d2c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.674900:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985158272:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066817.674953:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.675222:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.675334:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985548800 00000100:00100000:0.0:1746066817.675338:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985548800 00010000:00010000:0.0:1746066817.675376:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 35 pid: 7244 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746066817.675516:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985158144:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.675531:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.675565:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985548544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2795us (3920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.675573:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9489 00000100:00100000:2.0:1746066817.675614:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9490 00000100:00100000:2.0:1746066817.675619:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985548800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.675628:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.675633:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 35 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.675647:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 35 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.675664:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.675668:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.675677:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066817.675683:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.675684:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb1ff4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d10 expref: 35 pid: 7244 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.675692:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.675699:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985158016:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.675706:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2016:x1830882985548800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.675711:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9490 00010000:00010000:1.0:1746066817.675711:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.675719:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.675724:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066817.676292:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066817.676425:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1de00/0xf1867c21abfb2010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 56 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.676437:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 55 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.676702:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.676720:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985549056 00000100:00100000:3.0:1746066817.676725:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985549056 00002000:00100000:3.0:1746066817.676751:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2187264->2191359) req@ffff88012d801180 x1830882985549056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.676761:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801180 with x1830882985549056 ext(2187264->2191359) 00002000:00010000:3.0:1746066817.676765:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d801180 00000100:00100000:0.0:1746066817.676863:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985158272:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066817.676901:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dd1d000/0xf1867c21abfb201e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d2c expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066817.676913:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dd1d000/0xf1867c21abfb201e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d2c expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066817.676925:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1d000, rc 0) 00000100:00100000:0.0:1746066817.676950:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985548672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2137us (2261us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066817.676957:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20668 00010000:00010000:1.0:1746066817.677004:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066817.677006:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066817.677008:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1c200, rc 0) 00000100:00100000:1.0:1746066817.677029:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+55:3545:x1830882985548160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5289us (5341us total) trans 8589937803 rc 0/0 00000100:00100000:1.0:1746066817.677034:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17307 00000100:00100000:3.0:1746066817.677231:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7814 00000100:00100000:3.0:1746066817.677238:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985549056:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066817.677392:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985549056:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (689us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066817.677399:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7814 00002000:00100000:3.0:1746066817.677404:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2187264->2191359) req@ffff88012d801180 x1830882985549056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.677410:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801180 with x1830882985549056 ext(2187264->2191359) 00002000:00010000:3.0:1746066817.677413:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d801180 00000100:00100000:0.0:1746066817.683131:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.684120:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985549312 00000100:00100000:1.0:1746066817.684130:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985549312 00000100:00100000:1.0:1746066817.684180:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6535 00000100:00100000:1.0:1746066817.684187:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:3543:x1830882985549312:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066817.684993:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:3543:x1830882985549312:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 804us (1872us total) trans 8589937804 rc 0/0 00000100:00100000:1.0:1746066817.685001:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6535 00000100:00100000:0.0:1746066817.687315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.687404:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985549568 00000100:00100000:3.0:1746066817.687414:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985549568 00002000:00100000:3.0:1746066817.687454:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1699839) req@ffff88008e435500 x1830882985549568/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.687463:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435500 with x1830882985549568 ext(1048576->1699839) 00002000:00010000:3.0:1746066817.687468:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435500 00000100:00100000:3.0:1746066817.687725:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7815 00000100:00100000:3.0:1746066817.687732:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985549568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.695042:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985549568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7297us (7722us total) trans 0 rc 651264/651264 00000100:00100000:3.0:1746066817.695055:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7815 00002000:00100000:3.0:1746066817.695067:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1699839) req@ffff88008e435500 x1830882985549568/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.695076:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435500 with x1830882985549568 ext(1048576->1699839) 00002000:00010000:3.0:1746066817.695083:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435500 00000100:00100000:0.0:1746066817.704292:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.705147:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985549824 00000100:00100000:3.0:1746066817.705158:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985549824 00002000:00100000:3.0:1746066817.705206:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->4194303) req@ffff88008e436d80 x1830882985549824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.705221:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436d80 with x1830882985549824 ext(2191360->4194303) 00002000:00010000:3.0:1746066817.705227:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436d80 00000100:00100000:3.0:1746066817.705315:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7816 00000100:00100000:3.0:1746066817.705324:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985549824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066817.712584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.712645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.712660:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985549952 00000100:00100000:2.0:1746066817.712671:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985549952 00000100:00100000:2.0:1746066817.712724:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550080 00000100:00100000:2.0:1746066817.712726:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550080 00000100:00100000:2.0:1746066817.712752:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20669 00000100:00100000:2.0:1746066817.712760:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985549952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066817.712782:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.712801:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb202c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d33 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.712856:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985158400:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066817.712907:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20670 00000100:00100000:3.0:1746066817.712916:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985550080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.712923:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.712932:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb2033 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d3a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.712958:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158528:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066817.712982:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.712982:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.716589:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985158400:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066817.716626:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb202c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d33 expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066817.716639:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158528:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066817.716641:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb202c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d33 expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.716660:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6000, rc 0) 00010000:00010000:3.0:1746066817.716664:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb2033 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d3a expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.716675:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb2033 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d3a expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.716692:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:2.0:1746066817.716726:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985549952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3965us (4153us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.716733:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985550080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3817us (4086us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066817.716738:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20669 00000100:00100000:3.0:1746066817.716745:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20670 00000100:00100000:3.0:1746066817.716856:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985549824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11534us (12577us total) trans 0 rc 2002944/2002944 00000100:00100000:3.0:1746066817.716862:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7816 00002000:00100000:3.0:1746066817.716870:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2191360->4194303) req@ffff88008e436d80 x1830882985549824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 2002944/2002944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.716876:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436d80 with x1830882985549824 ext(2191360->4194303) 00002000:00010000:3.0:1746066817.716880:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e436d80 00000100:00100000:0.0:1746066817.722539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.722646:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550336 00000100:00100000:3.0:1746066817.722654:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550336 00002000:00100000:3.0:1746066817.722698:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e435880 x1830882985550336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.722709:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435880 with x1830882985550336 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.722714:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435880 00000100:00100000:3.0:1746066817.722749:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7817 00000100:00100000:3.0:1746066817.722757:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985550336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066817.726058:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985550336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3287us (3514us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066817.726070:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7817 00002000:00100000:3.0:1746066817.726082:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88008e435880 x1830882985550336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.726092:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435880 with x1830882985550336 ext(4194304->4861951) 00002000:00010000:3.0:1746066817.726097:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e435880 00000100:00100000:0.0:1746066817.730803:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.731546:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550464 00000100:00100000:3.0:1746066817.731556:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550464 00000100:00100000:3.0:1746066817.731624:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20671 00000100:00100000:3.0:1746066817.731632:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:3552:x1830882985550464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.731650:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.731668:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d41 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.731700:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.731707:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.731708:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.731711:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.731745:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.731755:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 17 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.731766:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.731859:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.733294:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.733317:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.733330:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066817.733385:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:3552:x1830882985550464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1753us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.733392:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20671 00000100:00100000:0.0:1746066817.736240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.736321:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550592 00000100:00100000:3.0:1746066817.736331:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550592 00002000:00100000:3.0:1746066817.736385:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->2097151) req@ffff88008e436300 x1830882985550592/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066817.736396:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436300 with x1830882985550592 ext(1699840->2097151) 00010000:00010000:3.0:1746066817.736404:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 18 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.736417:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 18 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746066817.736424:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e436300 00000100:00100000:3.0:1746066817.736453:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2236 00000100:00100000:3.0:1746066817.736460:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985550592:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066817.743655:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985550592:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7183us (7412us total) trans 17179875431 rc 0/0 00000100:00100000:0.0:1746066817.743669:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2236 00002000:00100000:0.0:1746066817.743682:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->2097151) req@ffff88008e436300 x1830882985550592/t17179875431(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066817.743698:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e436300 with x1830882985550592 ext(1699840->2097151) 00010000:00010000:0.0:1746066817.743708:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746066817.743723:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746066817.743933:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e436300 00000100:00100000:0.0:1746066817.748652:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.748762:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550720 00000100:00100000:3.0:1746066817.748773:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550720 00010000:00010000:3.0:1746066817.748814:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.748843:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9491 00000100:00100000:3.0:1746066817.748852:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985550720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.748867:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.748913:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.748931:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.748955:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfb2002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d17 expref: 20 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.749580:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.749582:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.749590:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 35 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.749599:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 35 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.749637:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 35 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.749650:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985158784:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.751131:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.754285:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985158784:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.754307:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066817.754372:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985550720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5520us (5729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.754383:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9491 00000100:00100000:0.0:1746066817.756449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.756531:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985550976 00000100:00100000:2.0:1746066817.756540:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985550976 00002000:00100000:2.0:1746066817.756587:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88008e437800 x1830882985550976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.756597:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437800 with x1830882985550976 ext(1048576->2097151) 00002000:00010000:2.0:1746066817.756604:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e437800 00000100:00100000:2.0:1746066817.756637:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7818 00000100:00100000:2.0:1746066817.756644:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985550976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.763697:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985550976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7040us (7242us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066817.763711:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7818 00002000:00100000:2.0:1746066817.763723:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88008e437800 x1830882985550976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.763733:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437800 with x1830882985550976 ext(1048576->2097151) 00002000:00010000:2.0:1746066817.763739:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e437800 00000100:00100000:0.0:1746066817.767493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.767651:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985551104 00000100:00100000:3.0:1746066817.767661:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985551104 00000100:00100000:3.0:1746066817.767721:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20672 00000100:00100000:3.0:1746066817.767730:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:3552:x1830882985551104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.767751:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.767770:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d48 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.767802:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 18 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.767810:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.767812:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066817.767815:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.767847:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 18 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.767858:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 18 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.767871:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158912:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.768410:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.769527:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.769618:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985158912:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.769645:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.769666:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:3.0:1746066817.769711:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3552:x1830882985551104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1982us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.769719:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20672 00000100:00100000:2.0:1746066817.769787:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985551232 00000100:00100000:2.0:1746066817.769792:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985551232 00002000:00100000:2.0:1746066817.769824:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2191359) req@ffff88008e437100 x1830882985551232/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.769833:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437100 with x1830882985551232 ext(2097152->2191359) 00010000:00010000:2.0:1746066817.769839:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 19 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.769849:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 19 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.769855:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e437100 00000100:00100000:2.0:1746066817.770056:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2237 00000100:00100000:2.0:1746066817.770063:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985551232:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066817.773123:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985551232:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3050us (3590us total) trans 17179875432 rc 0/0 00000100:00100000:2.0:1746066817.773134:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2237 00002000:00100000:2.0:1746066817.773145:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2191359) req@ffff88008e437100 x1830882985551232/t17179875432(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.773165:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437100 with x1830882985551232 ext(2097152->2191359) 00010000:00010000:2.0:1746066817.773174:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746066817.773189:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746066817.773196:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e437100 00000100:00100000:0.0:1746066817.780248:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.780362:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985551360 00000100:00100000:3.0:1746066817.780371:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985551360 00010000:00010000:3.0:1746066817.780409:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746066817.780438:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9492 00000100:00100000:3.0:1746066817.780445:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985551360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066817.780460:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.780480:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.780494:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.780518:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7a00/0xf1867c21abfb2009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d1e expref: 21 pid: 13726 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746066817.780552:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.780554:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.780562:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.780575:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.780607:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066817.780714:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159040:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066817.781642:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.788198:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.788462:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159040:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066817.788486:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.788510:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985551616 00000100:00100000:2.0:1746066817.788518:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985551616 00000100:00100000:3.0:1746066817.788531:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985551360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8085us (8295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.788542:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9492 00002000:00100000:2.0:1746066817.788560:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880098fbc000 x1830882985551616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.788570:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc000 with x1830882985551616 ext(2097152->4194303) 00002000:00010000:2.0:1746066817.788574:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbc000 00000100:00100000:2.0:1746066817.788604:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7819 00000100:00100000:2.0:1746066817.788611:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985551616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.802614:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985551616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13991us (14416us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066817.802626:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7819 00002000:00100000:2.0:1746066817.802637:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880098fbc000 x1830882985551616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.802646:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc000 with x1830882985551616 ext(2097152->4194303) 00002000:00010000:2.0:1746066817.802653:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbc000 00000100:00100000:0.0:1746066817.807033:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.807089:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985551744 00000100:00100000:3.0:1746066817.807100:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985551744 00000100:00100000:3.0:1746066817.807156:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20673 00000100:00100000:3.0:1746066817.807164:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3545:x1830882985551744:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066817.807181:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.807200:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d4f expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.807234:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.807241:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.807244:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.807247:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2134016->3043327] (req 2134016->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.807278:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.807290:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066817.807303:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985159168:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.807401:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.808488:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985159168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.808506:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2134016->3043327] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.808514:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77600, rc 0) 00000100:00100000:3.0:1746066817.808546:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3545:x1830882985551744:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1382us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.808553:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20673 00000100:00100000:0.0:1746066817.809060:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.809136:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552000 00000100:00100000:2.0:1746066817.809142:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552000 00002000:00100000:2.0:1746066817.809176:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880098fbf480 x1830882985552000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.809185:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882985552000 ext(4194304->4861951) 00010000:00010000:2.0:1746066817.809191:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.809201:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066817.809208:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf480 00000100:00100000:2.0:1746066817.809300:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2238 00000100:00100000:2.0:1746066817.809307:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985552000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066817.812798:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985552000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3479us (3727us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066817.812809:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2238 00002000:00100000:2.0:1746066817.812820:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880098fbf480 x1830882985552000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066817.812829:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882985552000 ext(4194304->4861951) 00010000:00010000:2.0:1746066817.812839:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.812852:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066817.812859:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf480 00000100:00100000:0.0:1746066817.815410:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.815512:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552128 00000100:00100000:3.0:1746066817.815521:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552128 00000100:00100000:3.0:1746066817.815576:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20674 00000100:00100000:3.0:1746066817.815584:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985552128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.815604:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.815623:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb204f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d56 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.815653:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.815663:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb204f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d56 expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.815673:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb204f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d56 expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.815703:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:3.0:1746066817.815751:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985552128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 167us (349us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.815757:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20674 00000100:00100000:0.0:1746066817.817312:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.817375:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.817395:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552256 00000100:00100000:3.0:1746066817.817402:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552256 00000100:00100000:3.0:1746066817.817429:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20675 00000100:00100000:3.0:1746066817.817435:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3552:x1830882985552256:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066817.817446:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552384 00010000:00010000:3.0:1746066817.817447:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066817.817450:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552384 00010000:00010000:3.0:1746066817.817461:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d5d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.817469:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 39 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066817.817479:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.817481:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.817489:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 40 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.817503:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9493 00010000:00010000:3.0:1746066817.817505:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 40 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.817509:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985552384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.817518:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066817.817520:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77400, rc 0) 00010000:00010000:2.0:1746066817.817537:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.817548:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.817561:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2041 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d48 expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066817.817563:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:3552:x1830882985552256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.817568:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20675 00010000:00010000:2.0:1746066817.817575:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.817577:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.817581:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.817588:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.817614:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.817630:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159296:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066817.817699:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.819765:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.819835:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159296:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.819854:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066817.819854:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.819933:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985552384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2422us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.819939:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552512 00000100:00100000:2.0:1746066817.819942:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9493 00000100:00100000:0.0:1746066817.819943:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985552768 00000100:00100000:3.0:1746066817.819945:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552512 00000100:00100000:0.0:1746066817.819949:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985552768 00000100:00100000:3.0:1746066817.819985:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20676 00002000:00100000:0.0:1746066817.819987:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->2138111) req@ffff880098fbc380 x1830882985552768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066817.819992:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985552512:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:0.0:1746066817.819996:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc380 with x1830882985552768 ext(2134016->2138111) 00002000:00010000:0.0:1746066817.820000:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbc380 00010000:00010000:3.0:1746066817.820005:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.820019:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb205d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d64 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066817.820033:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7820 00010000:00010000:3.0:1746066817.820042:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb205d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d64 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066817.820043:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985552768:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066817.820051:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb205d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d64 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.820075:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77c00, rc 0) 00000100:00100000:3.0:1746066817.820097:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985552512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.820102:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20676 00000100:00100000:1.0:1746066817.820164:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985552768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 122us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.820170:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7820 00002000:00100000:1.0:1746066817.820176:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->2138111) req@ffff880098fbc380 x1830882985552768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.820182:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc380 with x1830882985552768 ext(2134016->2138111) 00002000:00010000:1.0:1746066817.820185:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbc380 00000100:00100000:0.0:1746066817.821430:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.821471:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553024 00000100:00100000:1.0:1746066817.821475:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553024 00002000:00100000:1.0:1746066817.821491:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff880098fbdc00 x1830882985553024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.821496:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882985553024 ext(4857856->4861951) 00002000:00010000:1.0:1746066817.821498:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:1.0:1746066817.821514:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7821 00000100:00100000:1.0:1746066817.821519:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985553024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.821589:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985553024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 69us (160us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.821594:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7821 00002000:00100000:1.0:1746066817.821599:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff880098fbdc00 x1830882985553024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.821606:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882985553024 ext(4857856->4861951) 00002000:00010000:1.0:1746066817.821608:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:0.0:1746066817.827029:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.827070:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553280 00000100:00100000:1.0:1746066817.827078:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553280 00002000:00100000:1.0:1746066817.827115:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3039232->3043327) req@ffff880098fbf800 x1830882985553280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.827122:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882985553280 ext(3039232->3043327) 00002000:00010000:1.0:1746066817.827127:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf800 00000100:00100000:1.0:1746066817.827154:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7822 00000100:00100000:1.0:1746066817.827161:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985553280:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.827298:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985553280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 137us (281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.827307:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7822 00002000:00100000:1.0:1746066817.827313:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3039232->3043327) req@ffff880098fbf800 x1830882985553280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.827319:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882985553280 ext(3039232->3043327) 00002000:00010000:1.0:1746066817.827322:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf800 00000100:00100000:2.0:1746066817.843043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.843094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.843174:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553408 00000100:00100000:3.0:1746066817.843182:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553408 00000100:00100000:3.0:1746066817.843223:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553536 00000100:00100000:3.0:1746066817.843226:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553536 00000100:00100000:3.0:1746066817.843240:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20677 00000100:00100000:3.0:1746066817.843246:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985553408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066817.843260:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.843275:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d6b expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.843296:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.843297:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066817.843304:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.843317:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066817.843326:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76200, rc 0) 00000100:00100000:3.0:1746066817.843385:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985553408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.843387:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20678 00000100:00100000:3.0:1746066817.843393:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20677 00000100:00100000:1.0:1746066817.843396:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985553536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.843403:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.843410:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb206b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d72 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.843425:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb206b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d72 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.843432:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb206b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d72 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.843444:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0000, rc 0) 00000100:00100000:1.0:1746066817.843461:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985553536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (367us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066817.843466:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20678 00000100:00100000:0.0:1746066817.851425:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.851487:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553792 00000100:00100000:1.0:1746066817.851495:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553792 00002000:00100000:1.0:1746066817.851532:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880098fbea00 x1830882985553792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.851551:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882985553792 ext(1048576->2097151) 00002000:00010000:1.0:1746066817.851555:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:1.0:1746066817.851581:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7823 00000100:00100000:1.0:1746066817.851588:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985553792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.857327:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985553792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5727us (5897us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066817.857340:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7823 00002000:00100000:1.0:1746066817.857367:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880098fbea00 x1830882985553792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.857377:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882985553792 ext(1048576->2097151) 00002000:00010000:1.0:1746066817.857384:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066817.862074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.862196:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985553920 00000100:00100000:1.0:1746066817.862206:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985553920 00000100:00100000:1.0:1746066817.862263:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20679 00000100:00100000:1.0:1746066817.862272:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3558:x1830882985553920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066817.862300:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.862318:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d79 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.862357:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.862365:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.862367:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066817.862374:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.862405:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.862416:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 37 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066817.862428:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985159424:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.862525:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.863932:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985159424:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.863960:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.863974:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0800, rc 0) 00000100:00100000:1.0:1746066817.864012:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3558:x1830882985553920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1741us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.864020:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20679 00000100:00100000:0.0:1746066817.865000:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.865088:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985554048 00000100:00100000:1.0:1746066817.865094:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985554048 00002000:00100000:1.0:1746066817.865130:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->3043327) req@ffff880098fbd880 x1830882985554048/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.865139:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd880 with x1830882985554048 ext(2134016->3043327) 00010000:00010000:1.0:1746066817.865145:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066817.865161:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 38 pid: 9591 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746066817.865167:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd880 00000100:00100000:1.0:1746066817.865217:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2239 00000100:00100000:1.0:1746066817.865224:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985554048:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066817.873623:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985554048:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8389us (8615us total) trans 17179875433 rc 0/0 00000100:00100000:1.0:1746066817.873635:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2239 00002000:00100000:1.0:1746066817.873647:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2134016->3043327) req@ffff880098fbd880 x1830882985554048/t17179875433(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:223/0 lens 488/448 e 0 to 0 dl 1746066828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.873656:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd880 with x1830882985554048 ext(2134016->3043327) 00010000:00010000:1.0:1746066817.873665:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066817.873680:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746066817.873686:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd880 00000100:00100000:0.0:1746066817.876821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.876925:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985554176 00000100:00100000:2.0:1746066817.876935:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985554176 00010000:00010000:2.0:1746066817.876969:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.877001:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9494 00000100:00100000:2.0:1746066817.877006:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985554176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.877017:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.877033:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.877041:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.877060:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2134016->3047423] (req 2134016->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d4f expref: 40 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.877085:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.877086:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.877092:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.877098:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.877131:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066817.877142:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159552:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066817.877241:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066817.878938:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985159552:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.878962:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.879013:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985554176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2002us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.879023:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9494 00000100:00100000:0.0:1746066817.883169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.883241:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985554432 00000100:00100000:1.0:1746066817.883249:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985554432 00002000:00100000:1.0:1746066817.883295:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880098fbca80 x1830882985554432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.883304:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985554432 ext(2097152->4194303) 00002000:00010000:1.0:1746066817.883310:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:1.0:1746066817.883356:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7824 00000100:00100000:1.0:1746066817.883364:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985554432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.891311:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985554432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7938us (8139us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066817.891323:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7824 00002000:00100000:1.0:1746066817.891334:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880098fbca80 x1830882985554432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.891351:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985554432 ext(2097152->4194303) 00002000:00010000:1.0:1746066817.891356:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:0.0:1746066817.898795:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.898924:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985554688 00000100:00100000:1.0:1746066817.898932:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985554688 00002000:00100000:1.0:1746066817.898970:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880098fbf100 x1830882985554688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.898978:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985554688 ext(4194304->4861951) 00002000:00010000:1.0:1746066817.898982:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:1.0:1746066817.899000:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7825 00000100:00100000:1.0:1746066817.899007:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985554688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066817.903154:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985554688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4139us (4357us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066817.903165:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7825 00002000:00100000:1.0:1746066817.903175:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880098fbf100 x1830882985554688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/440 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.903190:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985554688 ext(4194304->4861951) 00002000:00010000:1.0:1746066817.903195:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:0.0:1746066817.912760:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.912879:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985554944 00000100:00100000:1.0:1746066817.912913:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985554944 00000100:00100000:1.0:1746066817.912962:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17308 00000100:00100000:1.0:1746066817.912971:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:3560:x1830882985554944:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066817.913004:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.913024:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d80 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.913132:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.913146:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066817.913159:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066817.913169:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066817.913262:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 38 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.913299:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 37 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.913308:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066817.913310:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066817.913314:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1800, rc 0) 00000100:00100000:1.0:1746066817.913369:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:3560:x1830882985554944:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 399us (620us total) trans 8589937805 rc 0/0 00000100:00100000:1.0:1746066817.913376:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17308 00000100:00100000:0.0:1746066817.923843:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.924067:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555072 00000100:00100000:2.0:1746066817.924078:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555072 00000100:00100000:2.0:1746066817.924137:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17309 00000100:00100000:2.0:1746066817.924145:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3563:x1830882985555072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066817.924174:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.924193:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfb208e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d87 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.924472:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924484:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924494:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924507:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924512:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924517:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924726:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924737:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 54 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.924743:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.924749:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.924781:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.924861:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 36 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.924874:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159680:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.925005:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 54 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.925013:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 54 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.925021:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159808:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.925046:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.927670:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.927783:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555328 00000100:00100000:1.0:1746066817.927794:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555328 00000100:00100000:1.0:1746066817.927871:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6536 00000100:00100000:1.0:1746066817.927913:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+55:314:x1830882985555328:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066817.928004:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159680:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066817.928014:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159808:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066817.928034:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066817.928201:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+56:314:x1830882985555328:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 317us (536us total) trans 8589937806 rc 0/0 00000100:00100000:1.0:1746066817.928208:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6536 00000100:00100000:0.0:1746066817.928592:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.928706:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555456 00000100:00100000:2.0:1746066817.928710:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555456 00010000:00010000:2.0:1746066817.928728:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 37 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.928756:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9495 00000100:00100000:2.0:1746066817.928762:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2016:x1830882985555456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.928771:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.928778:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 37 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.928787:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 37 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.928808:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1800/0xf1867c21abfb2080 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d80 expref: 37 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.928828:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.928834:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.928842:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.928847:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.928852:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.929060:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2016:x1830882985555456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 297us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.929067:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9495 00000100:00100000:0.0:1746066817.929975:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.930299:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555584 00000100:00100000:2.0:1746066817.930307:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555584 00010000:00010000:2.0:1746066817.930403:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 56 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.930451:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9496 00000100:00100000:2.0:1746066817.930461:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+56:2015:x1830882985555584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.930477:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.930483:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 56 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.930494:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 56 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.930513:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfb2017 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d25 expref: 56 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.930527:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.930532:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.930541:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.930549:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.930597:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.930660:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985555584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 198us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.930668:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9496 00010000:00010000:3.0:1746066817.930841:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.930850:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066817.930943:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066817.930949:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066817.930968:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.930982:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.930992:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.930998:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931004:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931010:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931015:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095750800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066817.931019:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931026:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931035:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066817.931038:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066817.931042:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931046:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750800/0xf1867c21abfb2095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931063:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931069:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931074:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931078:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095750400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066817.931080:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931085:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931092:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9d00) 00010000:00010000:3.0:1746066817.931094:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066817.931096:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931101:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb209c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.931138:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfb208e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.931151:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.931157:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.931159:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066817.931161:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751c00, rc 0) 00000100:00100000:3.0:1746066817.931200:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+11:3563:x1830882985555072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7056us (7373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.931208:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17309 00000100:00100000:0.0:1746066817.934637:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.934691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.934722:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555712 00000100:00100000:1.0:1746066817.934732:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555712 00000100:00100000:2.0:1746066817.934742:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985555840 00000100:00100000:2.0:1746066817.934746:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985555840 00000100:00100000:2.0:1746066817.934785:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20680 00000100:00100000:1.0:1746066817.934791:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20681 00000100:00100000:2.0:1746066817.934793:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985555840:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066817.934797:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985555712:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066817.934815:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.934822:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066817.934833:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d95 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.934833:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d8e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066817.934855:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.934855:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066817.934857:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.934857:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.934865:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.934866:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.934880:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.934880:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066817.934906:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750a00, rc 0) 00010000:00010000:1.0:1746066817.934911:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1c00, rc 0) 00000100:00100000:2.0:1746066817.934960:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985555840:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 168us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.934961:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985555712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 163us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.934966:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20680 00000100:00100000:1.0:1746066817.934970:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20681 00000100:00100000:0.0:1746066817.938166:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.938362:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556096 00000100:00100000:3.0:1746066817.938371:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556096 00000100:00100000:3.0:1746066817.938434:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17310 00000100:00100000:3.0:1746066817.938443:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+11:3563:x1830882985556096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066817.938465:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.938483:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfb20b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7d9c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.938590:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.938607:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.938614:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.938646:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.938659:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 12 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066817.938671:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.938763:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.947638:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.947855:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985159936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.947880:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066817.947987:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556224 00000100:00100000:1.0:1746066817.947995:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556224 00010000:00010000:1.0:1746066817.948028:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066817.948121:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9497 00000100:00100000:1.0:1746066817.948130:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985556224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066817.948145:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066817.948151:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066817.948162:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066817.948183:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfb20a3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d87 expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066817.948210:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066817.948215:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066817.948224:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066817.948231:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066817.948249:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066817.948298:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985556224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 169us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.948305:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9497 00010000:00010000:3.0:1746066817.948490:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.948498:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066817.948520:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066817.948651:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfb20b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.948680:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.948690:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.948692:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066817.948694:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77e00, rc 0) 00000100:00100000:3.0:1746066817.948733:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985556096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 10291us (10579us total) trans 8589937807 rc 0/0 00000100:00100000:3.0:1746066817.948740:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17310 00000100:00100000:0.0:1746066817.951949:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.952019:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556480 00000100:00100000:3.0:1746066817.952028:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556480 00000100:00100000:3.0:1746066817.952084:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17311 00000100:00100000:3.0:1746066817.952093:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+55:3565:x1830882985556480:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066817.952118:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.952137:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb20cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7da3 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.952237:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.952250:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.952261:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066817.952277:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066817.952385:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfb20cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 58 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.952406:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 57 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.952414:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.952417:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066817.952420:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:3.0:1746066817.952479:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+57:3565:x1830882985556480:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 385us (543us total) trans 8589937808 rc 0/0 00000100:00100000:3.0:1746066817.952485:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17311 00000100:00100000:0.0:1746066817.953702:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.954120:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556608 00000100:00100000:3.0:1746066817.954127:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556608 00000100:00100000:3.0:1746066817.954170:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17312 00000100:00100000:3.0:1746066817.954177:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985556608:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066817.954197:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.954211:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098890200/0xf1867c21abfb20e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7daa expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.954284:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.954297:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.954304:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 56 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.954310:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.954340:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 56 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.954364:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 56 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066817.954375:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985160064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.954584:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.954592:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066817.954600:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985160192:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.954625:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066817.958595:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985160064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066817.958608:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985160192:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066817.958770:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066817.960561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.960682:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556736 00000100:00100000:2.0:1746066817.960690:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556736 00010000:00010000:2.0:1746066817.960720:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 57 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.960759:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9498 00000100:00100000:2.0:1746066817.960765:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+57:2014:x1830882985556736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.960775:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.960780:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 57 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.960788:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 57 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.960810:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77a00/0xf1867c21abfb20d4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7da3 expref: 57 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.960839:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.960844:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.960855:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.960859:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.960863:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.961107:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+56:2014:x1830882985556736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 340us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.961114:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9498 00000100:00100000:1.0:1746066817.961572:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.961612:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985556864 00000100:00100000:2.0:1746066817.961615:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985556864 00010000:00010000:2.0:1746066817.961626:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 14 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066817.961638:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9499 00000100:00100000:2.0:1746066817.961641:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985556864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.961645:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.961648:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 14 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.961657:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 14 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.961664:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77e00/0xf1867c21abfb20bf lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d9c expref: 14 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066817.961670:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066817.961673:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.961677:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.961681:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066817.961699:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.961719:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985556864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.961722:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9499 00010000:00010000:3.0:1746066817.961747:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.961754:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066817.961798:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066817.961802:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066817.961816:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.961843:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098890200/0xf1867c21abfb20e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.961873:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.961879:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.961901:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066817.961904:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:3.0:1746066817.961929:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985556608:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7752us (8230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066817.961935:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17312 00000100:00100000:0.0:1746066817.967582:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066817.967709:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557120 00000100:00100000:3.0:1746066817.967720:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557120 00000100:00100000:3.0:1746066817.967789:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17313 00000100:00100000:3.0:1746066817.967799:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985557120:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066817.967822:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066817.967843:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb20f0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7db1 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.968092:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968109:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968121:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968133:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968139:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968145:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968151:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984bb000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066817.968155:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968161:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968171:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066817.968174:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066817.968177:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968182:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb20f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066817.968216:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb20f0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db1 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.968223:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb20f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db1 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066817.968231:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb200, rc 0) 00000100:00100000:3.0:1746066817.968282:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985557120:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 484us (712us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066817.968289:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17313 00000100:00100000:0.0:1746066817.972954:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.973007:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557376 00000100:00100000:1.0:1746066817.973016:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557376 00000100:00100000:1.0:1746066817.973061:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6537 00000100:00100000:1.0:1746066817.973069:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3563:x1830882985557376:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066817.973254:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+13:3563:x1830882985557376:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 185us (305us total) trans 8589937809 rc 0/0 00000100:00100000:1.0:1746066817.973260:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6537 00000100:00100000:0.0:1746066817.986086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.986962:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557504 00000100:00100000:1.0:1746066817.986971:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557504 00000100:00100000:1.0:1746066817.987020:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20682 00000100:00100000:1.0:1746066817.987027:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3560:x1830882985557504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066817.987041:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066817.987055:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7db8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.987083:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 9 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987091:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987098:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987104:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.987106:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066817.987109:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.987137:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987148:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066817.987158:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.987265:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987273:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 38 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066817.987281:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160448:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.987305:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 9 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066817.987316:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 9 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066817.987323:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160576:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.987338:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066817.991159:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.991168:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160448:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066817.991174:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985160576:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066817.991202:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066817.991216:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0200, rc 0) 00000100:00100000:1.0:1746066817.991265:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3560:x1830882985557504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4238us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066817.991272:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20682 00000100:00100000:0.0:1746066817.992095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.992145:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557632 00000100:00100000:2.0:1746066817.992152:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557632 00010000:00010000:2.0:1746066817.992178:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066817.992210:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9500 00000100:00100000:2.0:1746066817.992216:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985557632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.992225:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.992240:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992248:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992267:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfb193a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7951 expref: 10 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992331:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.992375:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985557632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.992381:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9500 00000100:00100000:0.0:1746066817.992522:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066817.992581:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557888 00000100:00100000:2.0:1746066817.992585:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557888 00010000:00010000:2.0:1746066817.992598:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 39 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066817.992618:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9501 00000100:00100000:2.0:1746066817.992623:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985557888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066817.992629:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066817.992637:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 39 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992645:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 39 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992656:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05200/0xf1867c21abfb1a4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79e4 expref: 39 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066817.992664:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.992686:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985557888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.992692:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9501 00000100:00100000:2.0:1746066817.992904:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066817.992988:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985557760 00000100:00100000:0.0:1746066817.992991:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985557760 00010000:00010000:0.0:1746066817.993005:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746066817.993018:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9502 00000100:00100000:0.0:1746066817.993023:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985557760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066817.993029:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066817.993037:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066817.993045:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066817.993055:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6c00/0xf1867c21abfb19e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79a5 expref: 23 pid: 12255 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066817.993074:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066817.993076:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066817.993081:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.993087:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066817.993110:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066817.993119:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5824700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985160704:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066817.993230:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066817.995255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066817.995317:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558144 00000100:00100000:1.0:1746066817.995323:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558144 00002000:00100000:1.0:1746066817.995528:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->438271) req@ffff8800a5d81f80 x1830882985558144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/0 e 0 to 0 dl 1746066828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.995536:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882985558144 ext(434176->438271) 00002000:00010000:1.0:1746066817.995540:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00000100:00100000:1.0:1746066817.995558:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7826 00000100:00100000:1.0:1746066817.995565:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985558144:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066817.995667:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985558144:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 103us (415us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066817.995673:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7826 00002000:00100000:1.0:1746066817.995677:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->438271) req@ffff8800a5d81f80 x1830882985558144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:223/0 lens 488/4536 e 0 to 0 dl 1746066828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066817.995684:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882985558144 ext(434176->438271) 00002000:00010000:1.0:1746066817.995686:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00000100:00100000:2.0:1746066817.995775:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5824700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985160704:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066817.995794:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066817.995816:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985557760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2792us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066817.995823:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9502 00000100:00100000:0.0:1746066818.003641:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.003771:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558272 00000100:00100000:1.0:1746066818.003784:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558272 00000100:00100000:1.0:1746066818.003859:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20683 00000100:00100000:1.0:1746066818.003872:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3560:x1830882985558272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066818.003910:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.003925:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7dbf expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.003952:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.003960:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.003967:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.003972:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.003975:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.003978:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.004002:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.004012:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 24 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.004023:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985160832:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.004119:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.004128:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 7 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.004135:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985160960:192.168.204.16@tcp:104: 00000100:00080000:0.0:1746066818.004182:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746066818.004242:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.004249:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.004257:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985161088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.004273:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.005567:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985160832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.006867:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985160960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.006880:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985161088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.006951:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.006967:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1600, rc 0) 00000100:00100000:1.0:1746066818.007028:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3560:x1830882985558272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3159us (3396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.007036:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20683 00000100:00100000:0.0:1746066818.008072:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.008105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.008134:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558400 00000100:00100000:0.0:1746066818.008140:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.008142:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558400 00000100:00100000:3.0:1746066818.008159:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558656 00000100:00100000:3.0:1746066818.008166:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558656 00010000:00010000:2.0:1746066818.008173:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.008192:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.008212:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558528 00000100:00100000:2.0:1746066818.008215:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558528 00000100:00100000:3.0:1746066818.008226:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9503 00010000:00010000:2.0:1746066818.008229:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 25 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.008231:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985558400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066818.008239:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9504 00010000:00010000:3.0:1746066818.008241:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066818.008247:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985558656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066818.008254:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9505 00010000:00010000:3.0:1746066818.008255:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.008255:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066818.008261:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985558528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.008262:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.008271:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066818.008271:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.008280:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb1f84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cb5 expref: 8 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.008281:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.008295:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 25 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.008301:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda7600/0xf1867c21abfb1d54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b8f expref: 13 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.008303:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066818.008312:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 25 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.008319:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066818.008331:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47e00/0xf1867c21abfb1d69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ba4 expref: 25 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.008332:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985558400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.008335:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985558656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.008336:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9503 00010000:00010000:2.0:1746066818.008355:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.008357:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066818.008358:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9504 00010000:00010000:2.0:1746066818.008365:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.008373:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.008403:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.008415:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985161216:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.008486:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.009932:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985161216:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066818.009950:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.009986:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985558528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1725us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.009995:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9505 00000100:00100000:2.0:1746066818.010304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.010539:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985558912 00000100:00100000:1.0:1746066818.010552:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985558912 00002000:00100000:1.0:1746066818.010597:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1073152->1077247) req@ffff88012d803100 x1830882985558912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.010604:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985558912 ext(1073152->1077247) 00002000:00010000:1.0:1746066818.010721:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d803100 00000100:00100000:1.0:1746066818.011405:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7827 00000100:00100000:1.0:1746066818.011412:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985558912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066818.012126:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985558912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 707us (1815us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066818.012136:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7827 00002000:00100000:1.0:1746066818.012144:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1073152->1077247) req@ffff88012d803100 x1830882985558912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.012152:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985558912 ext(1073152->1077247) 00002000:00010000:1.0:1746066818.012158:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d803100 00000100:00100000:0.0:1746066818.014617:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.014675:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559168 00000100:00100000:1.0:1746066818.014683:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559168 00000100:00100000:1.0:1746066818.014718:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6538 00000100:00100000:1.0:1746066818.014722:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:3560:x1830882985559168:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066818.014949:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:3560:x1830882985559168:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 225us (342us total) trans 8589937810 rc 0/0 00000100:00100000:1.0:1746066818.014955:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6538 00000100:00100000:0.0:1746066818.044977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.045017:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.045061:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.045137:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559296 00000100:00100000:2.0:1746066818.045146:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559296 00000100:00100000:3.0:1746066818.045167:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559552 00000100:00100000:1.0:1746066818.045167:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559424 00000100:00100000:3.0:1746066818.045176:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559552 00000100:00100000:1.0:1746066818.045176:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559424 00000100:00100000:2.0:1746066818.045201:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20684 00000100:00100000:2.0:1746066818.045208:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985559296:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066818.045217:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20685 00000100:00100000:3.0:1746066818.045225:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985559424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.045226:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.045239:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.045244:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfb210c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7dc6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.045254:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba600/0xf1867c21abfb2113 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7dcd expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.045298:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985161472:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.045298:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985161344:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.045418:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.045421:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.045438:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20686 00000100:00100000:3.0:1746066818.045444:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985559552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.045451:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.045459:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7dd4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.045470:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.045472:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.045479:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.045494:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.045503:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bac00, rc 0) 00000100:00100000:3.0:1746066818.045525:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985559552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 81us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.045530:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20686 00002000:00010000:2.0:1746066818.047378:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066816 -> 1746066819 00002000:00010000:2.0:1746066818.047384:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066816 -> 1746066818 00002000:00010000:2.0:1746066818.047386:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066816 -> 1746066819 00000100:00100000:2.0:1746066818.047406:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985161344:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.047433:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfb210c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dc6 expref: 40 pid: 13726 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746066818.047439:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066817 -> 1746066819 00002000:00010000:3.0:1746066818.047444:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066817 -> 1746066818 00010000:00010000:2.0:1746066818.047445:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfb210c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dc6 expref: 40 pid: 13726 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746066818.047446:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066817 -> 1746066819 00000100:00100000:3.0:1746066818.047462:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985161472:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.047472:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750000, rc 0) 00010000:00010000:3.0:1746066818.047489:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba600/0xf1867c21abfb2113 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dcd expref: 25 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.047500:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba600/0xf1867c21abfb2113 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dcd expref: 25 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.047657:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba600, rc 0) 00000100:00100000:2.0:1746066818.047659:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985559296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2449us (2691us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.047666:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20684 00000100:00100000:3.0:1746066818.047684:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985559424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2459us (2622us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.047690:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20685 00000100:00100000:0.0:1746066818.050118:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.050240:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559680 00000100:00100000:3.0:1746066818.050249:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559680 00000100:00100000:3.0:1746066818.050334:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20687 00000100:00100000:3.0:1746066818.050354:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3570:x1830882985559680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.050372:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.050388:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ddb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.050418:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.050426:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.050428:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.050431:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.050467:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.050478:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 21 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.050489:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161600:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.050581:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.052085:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161600:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.052104:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.052116:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984baa00, rc 0) 00000100:00100000:3.0:1746066818.052142:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:3570:x1830882985559680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1801us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.052152:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20687 00000100:00100000:0.0:1746066818.052802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.052920:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559808 00000100:00100000:1.0:1746066818.052926:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559808 00002000:00100000:1.0:1746066818.052966:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->1048575) req@ffff8800a5d82d80 x1830882985559808/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.052974:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830882985559808 ext(434176->1048575) 00010000:00010000:1.0:1746066818.052981:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.052992:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746066818.052999:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00000100:00100000:1.0:1746066818.053013:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2240 00000100:00100000:1.0:1746066818.053019:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985559808:12345-192.168.204.16@tcp:4:multiop.0 00000100:00080000:0.0:1746066818.053070:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066818.059772:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985559808:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6745us (6963us total) trans 17179875434 rc 0/0 00000100:00100000:1.0:1746066818.059786:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2240 00002000:00100000:1.0:1746066818.059796:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->1048575) req@ffff8800a5d82d80 x1830882985559808/t17179875434(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.059805:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830882985559808 ext(434176->1048575) 00010000:00010000:1.0:1746066818.059813:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.059828:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746066818.059835:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00000100:00100000:0.0:1746066818.062982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.063048:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985559936 00000100:00100000:2.0:1746066818.063057:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985559936 00010000:00010000:2.0:1746066818.063089:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.063132:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9506 00000100:00100000:2.0:1746066818.063140:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985559936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.063151:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.063168:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.063179:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.063202:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0200/0xf1867c21abfb20fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7db8 expref: 24 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.063228:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.063230:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.063237:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.063245:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.063272:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.063284:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985161728:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.063375:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.066272:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985161728:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066818.066292:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.066358:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985559936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3218us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.066368:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9506 00000100:00100000:0.0:1746066818.067598:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.067703:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560192 00000100:00100000:1.0:1746066818.067712:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560192 00002000:00100000:1.0:1746066818.067765:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800966e3100 x1830882985560192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.067776:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882985560192 ext(0->1048575) 00002000:00010000:1.0:1746066818.067782:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3100 00000100:00100000:1.0:1746066818.067812:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7828 00000100:00100000:1.0:1746066818.067820:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985560192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.071116:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.071360:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560320 00000100:00100000:3.0:1746066818.071370:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560320 00000100:00100000:3.0:1746066818.071754:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20688 00000100:00100000:3.0:1746066818.071763:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:3565:x1830882985560320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066818.071781:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.071799:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7de2 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.071829:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 43 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.071838:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.071845:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.071851:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.071853:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.071856:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.071910:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.071922:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.071935:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.072033:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.072042:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.072051:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161984:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.072366:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 43 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.072375:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 43 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.072383:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.072402:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.074729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.074794:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560448 00000100:00100000:2.0:1746066818.074803:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560448 00010000:00010000:2.0:1746066818.074855:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00000100:00080000:0.0:1746066818.074857:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066818.074917:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9507 00000100:00100000:2.0:1746066818.074924:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985560448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.074936:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.074955:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.074967:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.074996:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.075034:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985560448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.075041:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9507 00000100:00100000:0.0:1746066818.075042:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.075054:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560576 00000100:00100000:2.0:1746066818.075057:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560576 00010000:00010000:2.0:1746066818.075066:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 23 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.075085:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9508 00000100:00100000:2.0:1746066818.075090:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985560576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.075095:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.075100:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 23 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.075107:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 23 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.075116:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.075131:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985560576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 41us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.075136:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9508 00000100:00100000:1.0:1746066818.075285:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985560192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7465us (7694us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.075293:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7828 00002000:00100000:1.0:1746066818.075301:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800966e3100 x1830882985560192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.075317:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882985560192 ext(0->1048575) 00002000:00010000:1.0:1746066818.075321:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3100 00010000:00010000:3.0:1746066818.075433:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db76200/0xf1867c21abfb2064 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d6b expref: 22 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.075451:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.075461:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb20aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d8e expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.075472:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985161984:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.075481:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.075503:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.075513:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba200, rc 0) 00000100:00100000:3.0:1746066818.075538:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:3565:x1830882985560320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3777us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.075544:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20688 00000100:00100000:1.0:1746066818.076002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.076020:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560704 00000100:00100000:3.0:1746066818.076023:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560704 00010000:00010000:3.0:1746066818.076036:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 41 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.076058:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9509 00000100:00100000:3.0:1746066818.076064:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985560704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.076070:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.076078:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 41 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.076086:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 41 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.076098:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb203a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d41 expref: 41 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.076106:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.076108:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.076114:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.076121:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.076143:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.076154:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985162240:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066818.076216:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.079326:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985162240:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066818.079360:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.079401:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985560704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3336us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.079412:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9509 00000100:00100000:0.0:1746066818.079605:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.080103:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985560960 00000100:00100000:2.0:1746066818.080110:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985560960 00002000:00100000:2.0:1746066818.080150:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->1507327) req@ffff8800966e1c00 x1830882985560960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.080160:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985560960 ext(1503232->1507327) 00002000:00010000:2.0:1746066818.080165:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:2.0:1746066818.080179:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7829 00000100:00100000:2.0:1746066818.080186:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985560960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066818.080310:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985560960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 124us (706us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.080320:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7829 00002000:00100000:2.0:1746066818.080324:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->1507327) req@ffff8800966e1c00 x1830882985560960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.080331:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985560960 ext(1503232->1507327) 00002000:00010000:2.0:1746066818.080333:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:0.0:1746066818.081927:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.082035:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561088 00000100:00100000:3.0:1746066818.082041:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561088 00000100:00100000:3.0:1746066818.082078:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20689 00000100:00100000:3.0:1746066818.082084:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:3570:x1830882985561088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.082097:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.082113:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7de9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.082149:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.082156:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.082157:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.082161:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.082271:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.082281:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 11 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.082290:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985162368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.082377:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.083608:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985162368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.083628:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.083642:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb200, rc 0) 00000100:00100000:3.0:1746066818.083678:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:3570:x1830882985561088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1592us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.083684:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20689 00000100:00100000:0.0:1746066818.083758:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.083821:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561216 00000100:00100000:2.0:1746066818.083827:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561216 00002000:00100000:2.0:1746066818.083856:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1077247) req@ffff8800966e0000 x1830882985561216/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.083866:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0000 with x1830882985561216 ext(1048576->1077247) 00010000:00010000:2.0:1746066818.083873:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 12 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.083903:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 12 pid: 11630 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.083909:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e0000 00000100:00100000:2.0:1746066818.083937:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2241 00000100:00100000:2.0:1746066818.083944:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985561216:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066818.085556:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.085644:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561344 00000100:00100000:3.0:1746066818.085650:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561344 00000100:00100000:3.0:1746066818.085689:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20690 00000100:00100000:3.0:1746066818.085695:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:3565:x1830882985561344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066818.085709:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.085727:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7df0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.085751:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.085758:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.085764:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.085769:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.085771:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.085774:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.085798:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 7 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.085808:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 7 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746066818.085809:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985561216:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1865us (2051us total) trans 21474842779 rc 0/0 00000100:00100000:0.0:1746066818.085816:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2241 00000100:00100000:3.0:1746066818.085819:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162496:192.168.204.16@tcp:104: 00002000:00100000:0.0:1746066818.085823:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1077247) req@ffff8800966e0000 x1830882985561216/t21474842779(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066818.085830:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0000 with x1830882985561216 ext(1048576->1077247) 00010000:00010000:0.0:1746066818.085835:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.085843:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00002000:00010000:0.0:1746066818.085849:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e0000 00010000:00010000:3.0:1746066818.085869:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.085877:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.085909:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.085945:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.085953:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 21 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.085960:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162752:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.086035:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.087397:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.087405:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.088011:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985162752:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.088037:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.088052:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb000, rc 0) 00000100:00100000:3.0:1746066818.088102:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:3565:x1830882985561344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2405us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.088113:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20690 00000100:00100000:0.0:1746066818.090088:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.090122:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.090250:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561472 00000100:00100000:2.0:1746066818.090255:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561728 00000100:00100000:0.0:1746066818.090255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.090263:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561728 00000100:00100000:3.0:1746066818.090264:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561472 00000100:00100000:0.0:1746066818.090288:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066818.090297:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.090298:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 8 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.090327:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561600 00000100:00100000:2.0:1746066818.090330:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561600 00010000:00010000:2.0:1746066818.090355:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746066818.090361:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985561856 00000100:00100000:0.0:1746066818.090363:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985561856 00000100:00100000:3.0:1746066818.090366:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9510 00000100:00100000:3.0:1746066818.090375:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985561728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066818.090375:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9511 00010000:00010000:0.0:1746066818.090375:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.090381:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985561472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066818.090389:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9512 00010000:00010000:3.0:1746066818.090390:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.090392:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066818.090393:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985561600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066818.090398:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9513 00010000:00010000:0.0:1746066818.090399:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066818.090407:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985561856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.090408:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.090409:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.090410:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 8 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.090415:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.090420:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.090420:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.090428:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 8 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.090436:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1600/0xf1867c21abfb2105 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dbf expref: 14 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.090439:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.090448:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bac00/0xf1867c21abfb211a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dd4 expref: 41 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.090452:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfb20b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d95 expref: 8 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.090453:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.090455:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.090457:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.090460:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.090466:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066818.090467:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.090473:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfb2072 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d79 expref: 22 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.090474:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.090475:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.090481:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.090488:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.090493:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.090496:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.090499:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985561472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.090504:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985162880:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.090505:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9511 00010000:00010000:3.0:1746066818.090513:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.090523:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985163008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.090524:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985561856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.090531:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9513 00000100:00100000:0.0:1746066818.090544:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.090557:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.091720:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985162880:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066818.091738:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.091765:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985163008:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.091783:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985561600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1387us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.091790:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9512 00010000:00010000:3.0:1746066818.092035:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.092074:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985561728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1700us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.092082:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9510 00000100:00100000:0.0:1746066818.093518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.093583:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985562112 00000100:00100000:2.0:1746066818.093590:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985562112 00002000:00100000:2.0:1746066818.093624:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2416640->2420735) req@ffff8800a5766680 x1830882985562112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.093632:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766680 with x1830882985562112 ext(2416640->2420735) 00002000:00010000:2.0:1746066818.093636:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5766680 00000100:00100000:2.0:1746066818.093664:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7830 00000100:00100000:2.0:1746066818.093670:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985562112:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066818.093781:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985562112:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (265us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.093787:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7830 00002000:00100000:2.0:1746066818.093792:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2416640->2420735) req@ffff8800a5766680 x1830882985562112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.093800:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766680 with x1830882985562112 ext(2416640->2420735) 00002000:00010000:2.0:1746066818.093802:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5766680 00000100:00100000:0.0:1746066818.094459:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.094499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.094523:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985562624 00000100:00100000:2.0:1746066818.094526:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985562624 00002000:00100000:2.0:1746066818.094541:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1503231) req@ffff8800a5765c00 x1830882985562624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.094549:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985562624 ext(1048576->1503231) 00002000:00010000:2.0:1746066818.094553:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5765c00 00000100:00100000:2.0:1746066818.094562:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985562496 00000100:00100000:2.0:1746066818.094564:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985562496 00002000:00100000:2.0:1746066818.094574:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5766300 x1830882985562496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746066818.094575:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7831 00002000:00100000:2.0:1746066818.094580:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766300 with x1830882985562496 ext(1048576->2097151) 00000100:00100000:0.0:1746066818.094582:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985562624:12345-192.168.204.16@tcp:3:multiop.0 00002000:00010000:2.0:1746066818.094583:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5766300 00000100:00100000:2.0:1746066818.094605:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7832 00000100:00100000:2.0:1746066818.094610:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985562496:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066818.098980:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.099039:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985562880 00000100:00100000:1.0:1746066818.099048:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985562880 00000100:00100000:1.0:1746066818.099098:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6539 00000100:00100000:1.0:1746066818.099105:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+56:3565:x1830882985562880:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066818.099216:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985562624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 4633us (4756us total) trans 0 rc 454656/454656 00000100:00100000:0.0:1746066818.099224:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7831 00002000:00100000:0.0:1746066818.099231:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1503231) req@ffff8800a5765c00 x1830882985562624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 454656/454656 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066818.099239:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985562624 ext(1048576->1503231) 00002000:00010000:0.0:1746066818.099244:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5765c00 00000100:00100000:1.0:1746066818.099246:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+57:3565:x1830882985562880:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 141us (274us total) trans 8589937811 rc 0/0 00000100:00100000:1.0:1746066818.099255:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6539 00000100:00100000:2.0:1746066818.099674:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985562496:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5061us (5173us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.099681:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7832 00002000:00100000:2.0:1746066818.099687:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5766300 x1830882985562496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.099693:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5766300 with x1830882985562496 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.099696:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5766300 00000100:00100000:0.0:1746066818.108258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.108390:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563008 00000100:00100000:3.0:1746066818.108401:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563008 00000100:00100000:3.0:1746066818.108468:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20691 00000100:00100000:3.0:1746066818.108475:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:3570:x1830882985563008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.108490:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.108506:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7df7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.108532:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.108539:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.108540:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.108543:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2420736->3145727] (req 2420736->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.108568:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.108581:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.108592:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985163136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.109456:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.110513:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985163136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.110535:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2420736->3145727] (req 2420736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.110548:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066818.110594:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:3570:x1830882985563008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2118us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.110601:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20691 00000100:00100000:0.0:1746066818.111261:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.111366:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563136 00000100:00100000:2.0:1746066818.111374:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563136 00002000:00100000:2.0:1746066818.111412:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff8800a5764a80 x1830882985563136/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.111419:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764a80 with x1830882985563136 ext(2097152->2420735) 00010000:00010000:2.0:1746066818.111426:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.111436:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 41 pid: 20361 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.111441:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5764a80 00000100:00100000:2.0:1746066818.111462:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2242 00000100:00100000:2.0:1746066818.111469:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985563136:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066818.114129:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985563136:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2651us (2863us total) trans 17179875435 rc 0/0 00000100:00100000:2.0:1746066818.114141:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2242 00002000:00100000:2.0:1746066818.114150:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff8800a5764a80 x1830882985563136/t17179875435(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.114158:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764a80 with x1830882985563136 ext(2097152->2420735) 00010000:00010000:2.0:1746066818.114167:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.114179:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.114186:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5764a80 00000100:00100000:0.0:1746066818.116567:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.116668:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563264 00000100:00100000:3.0:1746066818.116676:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563264 00010000:00010000:3.0:1746066818.116710:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.116754:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9514 00000100:00100000:3.0:1746066818.116762:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985563264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.116776:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066818.116791:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066818 -> 1746066819 00002000:00010000:3.0:1746066818.116795:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066818 -> 1746066819 00010000:00010000:3.0:1746066818.116800:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.116812:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.116836:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2136 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2420735) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df0 expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.116865:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.116867:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.116875:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.116912:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.116945:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.116957:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985163264:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066818.117081:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.121322:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985163264:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066818.121354:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.121508:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985563264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4636us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.121520:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9514 00000100:00100000:0.0:1746066818.123118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.123748:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563520 00000100:00100000:2.0:1746066818.123757:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563520 00002000:00100000:2.0:1746066818.123808:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2420736->4194303) req@ffff880093c6b800 x1830882985563520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.123819:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b800 with x1830882985563520 ext(2420736->4194303) 00002000:00010000:2.0:1746066818.123824:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b800 00000100:00100000:2.0:1746066818.124374:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7833 00000100:00100000:2.0:1746066818.124394:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985563520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.124653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.124687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.124712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.124738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.124768:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563648 00000100:00100000:1.0:1746066818.124772:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563648 00000100:00100000:1.0:1746066818.124798:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20692 00000100:00100000:3.0:1746066818.124804:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563776 00000100:00100000:1.0:1746066818.124804:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985563648:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066818.124807:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563776 00010000:00010000:1.0:1746066818.124816:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066818.124825:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985563904 00000100:00100000:3.0:1746066818.124826:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985563904 00000100:00100000:3.0:1746066818.124834:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985564032 00010000:00010000:1.0:1746066818.124834:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7dfe expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.124836:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985564032 00000100:00100000:3.0:1746066818.124852:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20693 00000100:00100000:3.0:1746066818.124857:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985563776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.124857:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.124858:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.124864:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.124873:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e05 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.124925:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20694 00000100:00100000:0.0:1746066818.124932:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985563904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.124938:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.124946:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2152 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e0c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.124989:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985163392:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066818.125056:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.125077:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20695 00000100:00100000:0.0:1746066818.125082:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985564032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.125088:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.125094:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e13 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.125104:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.125105:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.125110:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.125124:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.125133:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77e00, rc 0) 00000100:00100000:0.0:1746066818.125155:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985564032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.125161:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20695 00010000:00010000:3.0:1746066818.125206:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.125207:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.125212:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.125227:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.125234:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba000, rc 0) 00000100:00100000:3.0:1746066818.125252:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985563776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 395us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.125257:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20693 00010000:00010000:1.0:1746066818.125504:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.125517:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.125523:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00000100:00100000:1.0:1746066818.125544:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985563648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 740us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.125562:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20692 00002000:00010000:2.0:1746066818.130951:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066818 -> 1746066819 00002000:00010000:2.0:1746066818.130960:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066818 -> 1746066819 00002000:00010000:2.0:1746066818.130962:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066818 -> 1746066819 00000100:00100000:2.0:1746066818.130996:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985163392:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.131037:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2152 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e0c expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.131055:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77600/0xf1867c21abfb2152 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e0c expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.131081:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77600, rc 0) 00000100:00100000:2.0:1746066818.131129:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985563904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6197us (6415us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.131138:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20694 00000100:00100000:2.0:1746066818.132586:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985563520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8197us (9468us total) trans 0 rc 1773568/1773568 00000100:00100000:2.0:1746066818.132596:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7833 00002000:00100000:2.0:1746066818.132608:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (2420736->4194303) req@ffff880093c6b800 x1830882985563520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1773568/1773568 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.132617:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b800 with x1830882985563520 ext(2420736->4194303) 00002000:00010000:2.0:1746066818.132622:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b800 00000100:00100000:0.0:1746066818.133144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.133359:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985564288 00000100:00100000:3.0:1746066818.133367:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985564288 00000100:00100000:3.0:1746066818.133415:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17314 00000100:00100000:3.0:1746066818.133421:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:3576:x1830882985564288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066818.133446:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.133465:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb2160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e1a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.133676:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.133692:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.133698:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.133728:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.133740:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 12 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.133752:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985163520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.134022:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.136820:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985163520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.136847:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066818.137084:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.137302:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985564416 00000100:00100000:3.0:1746066818.137308:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985564416 00010000:00010000:3.0:1746066818.137364:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00000100:00080000:0.0:1746066818.137383:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066818.137403:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9515 00000100:00100000:3.0:1746066818.137413:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985564416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.137429:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.137434:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.137443:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.137465:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb20e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7daa expref: 13 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.137490:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.137494:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.137536:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.137545:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.137605:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066818.137612:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.137618:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066818.137637:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:3.0:1746066818.137652:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985564416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 241us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.137658:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9515 00010000:00010000:0.0:1746066818.138009:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb2160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.138033:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.138040:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.138042:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066818.138044:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba800, rc 0) 00000100:00100000:0.0:1746066818.138068:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:3576:x1830882985564288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4647us (4926us total) trans 8589937812 rc 0/0 00000100:00100000:0.0:1746066818.138074:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17314 00000100:00100000:0.0:1746066818.140264:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.140304:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.140381:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985564672 00000100:00100000:1.0:1746066818.140389:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985564672 00002000:00100000:1.0:1746066818.140435:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c68700 x1830882985564672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.140445:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68700 with x1830882985564672 ext(0->1048575) 00002000:00010000:1.0:1746066818.140450:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68700 00000100:00100000:1.0:1746066818.140467:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985564928 00000100:00100000:1.0:1746066818.140469:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985564928 00002000:00100000:1.0:1746066818.140483:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c68000 x1830882985564928/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.140490:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68000 with x1830882985564928 ext(1048576->2097151) 00000100:00100000:0.0:1746066818.140491:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7834 00002000:00010000:1.0:1746066818.140493:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c68000 00000100:00100000:0.0:1746066818.140499:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985564672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.140516:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7835 00000100:00100000:1.0:1746066818.140520:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985564928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.141275:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.141371:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565184 00000100:00100000:3.0:1746066818.141381:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565184 00002000:00100000:3.0:1746066818.141420:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4857855) req@ffff880094307100 x1830882985565184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.141428:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830882985565184 ext(4194304->4857855) 00002000:00010000:3.0:1746066818.141433:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:3.0:1746066818.141459:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7836 00000100:00100000:3.0:1746066818.141465:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985565184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.145599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.145670:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565312 00000100:00100000:2.0:1746066818.145679:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565312 00000100:00100000:2.0:1746066818.145737:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20696 00000100:00100000:2.0:1746066818.145743:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3576:x1830882985565312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.145763:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.145779:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e21 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.145804:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.145814:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 6 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.145819:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.145822:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.145823:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.145825:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3231744->3358719] (req 3231744->3358719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.145849:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.145857:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 24 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.145866:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.145962:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 6 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.145967:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 6 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.145972:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.145987:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.145992:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 17 pid: 3528 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.145996:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163904:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.146033:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.147570:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985564928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7043us (7258us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.147582:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7835 00002000:00100000:1.0:1746066818.147593:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c68000 x1830882985564928/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.147608:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68000 with x1830882985564928 ext(1048576->2097151) 00002000:00010000:1.0:1746066818.147614:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c68000 00000100:00100000:3.0:1746066818.149095:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.149107:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.149116:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985163904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.149148:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3231744->3358719] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.149163:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fc00, rc 0) 00000100:00100000:3.0:1746066818.149224:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3576:x1830882985565312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3479us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.149312:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985564672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8810us (9052us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.149322:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7834 00002000:00100000:1.0:1746066818.149330:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c68700 x1830882985564672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.149358:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68700 with x1830882985564672 ext(0->1048575) 00002000:00010000:1.0:1746066818.149362:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68700 00000100:00100000:3.0:1746066818.149744:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20696 00000100:00100000:0.0:1746066818.150593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.150681:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565568 00000100:00100000:3.0:1746066818.150688:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565568 00010000:00010000:3.0:1746066818.150719:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746066818.150984:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.151123:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565440 00000100:00100000:3.0:1746066818.151127:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565440 00010000:00010000:3.0:1746066818.151141:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 7 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.151167:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9516 00000100:00100000:3.0:1746066818.151174:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985565568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.151191:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.151209:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.151221:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.151244:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb1f1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c92 expref: 25 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.151263:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.151290:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985565568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.151295:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9517 00000100:00100000:1.0:1746066818.151302:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985565440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066818.151303:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9516 00010000:00010000:1.0:1746066818.151309:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.151316:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 7 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.151324:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 7 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.151335:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb1f7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7cca expref: 7 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.151361:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.151470:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985565440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 168us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.151476:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9517 00000100:00100000:3.0:1746066818.151810:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985565184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10343us (10535us total) trans 0 rc 663552/663552 00000100:00100000:3.0:1746066818.151817:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7836 00002000:00100000:3.0:1746066818.151826:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4857855) req@ffff880094307100 x1830882985565184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.151834:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830882985565184 ext(4194304->4857855) 00002000:00010000:3.0:1746066818.151838:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:0.0:1746066818.151989:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.152039:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565696 00000100:00100000:1.0:1746066818.152042:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565696 00010000:00010000:1.0:1746066818.152056:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 15 pid: 3528 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.152081:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9518 00000100:00100000:1.0:1746066818.152086:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985565696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.152094:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.152100:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 15 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.152112:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 15 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.152124:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfb1ed5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7c68 expref: 15 pid: 3528 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.152132:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.152134:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.152140:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.152148:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.152177:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.152187:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985164032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.152594:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.153777:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985164032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.153796:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.153840:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985565696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1752us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.153849:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9518 00000100:00100000:0.0:1746066818.155169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.155243:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985565952 00000100:00100000:3.0:1746066818.155250:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985565952 00000100:00100000:0.0:1746066818.155465:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066818.155523:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3235839) req@ffff880093c6aa00 x1830882985565952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.155540:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6aa00 with x1830882985565952 ext(3231744->3235839) 00000100:00100000:2.0:1746066818.155542:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566080 00002000:00010000:3.0:1746066818.155545:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6aa00 00000100:00100000:2.0:1746066818.155550:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566080 00000100:00100000:3.0:1746066818.155578:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7837 00000100:00100000:3.0:1746066818.155585:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985565952:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066818.155588:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20697 00000100:00100000:2.0:1746066818.155595:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985566080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.155609:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.155626:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb217c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e28 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.155677:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985164160:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066818.156636:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985565952:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1049us (1472us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.156642:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.156643:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7837 00002000:00100000:3.0:1746066818.156649:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3235839) req@ffff880093c6aa00 x1830882985565952/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.156656:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6aa00 with x1830882985565952 ext(3231744->3235839) 00002000:00010000:3.0:1746066818.156659:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6aa00 00000100:00100000:2.0:1746066818.156901:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746066818.156914:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985164288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746066818.156955:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.157288:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985164288 00000100:00100000:1.0:1746066818.157293:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985164288 00000100:00100000:1.0:1746066818.157327:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1746066818.157333:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882985164288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746066818.157358:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1192896960 pending 1191936 free 3909910528 avail 3678388224 00000100:00100000:1.0:1746066818.157395:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882985164288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.157400:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00080000:0.0:1746066818.157450:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066818.157480:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985164288:0@lo:13:osp-pre-0-1.0 00002000:00010000:3.0:1746066818.157511:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066818 -> 1746066819 00002000:00010000:3.0:1746066818.157513:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066818 -> 1746066819 00002000:00010000:3.0:1746066818.157515:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066818 -> 1746066819 00000100:00100000:3.0:1746066818.157525:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985164160:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.157546:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb217c lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e28 expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.157557:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb217c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e28 expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.157584:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e400, rc 0) 00000100:00100000:3.0:1746066818.157620:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985566080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2025us (2154us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.157626:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20697 00000100:00100000:0.0:1746066818.159374:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.159432:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566336 00000100:00100000:3.0:1746066818.159438:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566336 00002000:00100000:3.0:1746066818.159467:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880093c68e00 x1830882985566336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.159476:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68e00 with x1830882985566336 ext(3354624->3358719) 00002000:00010000:3.0:1746066818.159480:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c68e00 00000100:00100000:3.0:1746066818.159508:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7838 00000100:00100000:3.0:1746066818.159514:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985566336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066818.159625:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985566336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (254us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.159631:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7838 00002000:00100000:3.0:1746066818.159636:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880093c68e00 x1830882985566336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.159644:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68e00 with x1830882985566336 ext(3354624->3358719) 00002000:00010000:3.0:1746066818.159646:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c68e00 00000100:00100000:1.0:1746066818.160237:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.160304:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566464 00000100:00100000:3.0:1746066818.160308:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566464 00000100:00100000:3.0:1746066818.160350:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20698 00000100:00100000:3.0:1746066818.160356:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3574:x1830882985566464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.160365:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.160380:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e2f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.160407:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.160413:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.160415:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.160418:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.160440:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.160451:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 41 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.160461:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985164416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.161046:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.161645:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.161664:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566592 00000100:00100000:0.0:1746066818.161669:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566592 00000100:00100000:0.0:1746066818.161704:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20699 00000100:00100000:0.0:1746066818.161710:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985566592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.161720:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.161731:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb218a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e36 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.161762:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164544:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066818.161812:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.164392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.164411:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164544:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066818.164448:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb218a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e36 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.164460:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfb218a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e36 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.164474:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:1.0:1746066818.164512:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985566592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2802us (2869us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066818.164521:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20699 00000100:00100000:2.0:1746066818.164609:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566720 00000100:00100000:2.0:1746066818.164616:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566720 00002000:00100000:2.0:1746066818.164646:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->2097151) req@ffff880093c68a80 x1830882985566720/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.164660:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68a80 with x1830882985566720 ext(1503232->2097151) 00010000:00010000:2.0:1746066818.164667:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 42 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.164678:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 42 pid: 20361 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.164685:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c68a80 00000100:00100000:2.0:1746066818.164698:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2243 00000100:00100000:2.0:1746066818.164703:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985566720:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066818.164927:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985164416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.164944:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.164955:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb000, rc 0) 00000100:00100000:3.0:1746066818.164992:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3574:x1830882985566464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4632us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.164997:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20698 00000100:00100000:3.0:1746066818.171273:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985566720:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6562us (6878us total) trans 17179875436 rc 0/0 00000100:00100000:3.0:1746066818.171286:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2243 00002000:00100000:3.0:1746066818.171295:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1503232->2097151) req@ffff880093c68a80 x1830882985566720/t17179875436(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.171303:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68a80 with x1830882985566720 ext(1503232->2097151) 00010000:00010000:3.0:1746066818.171311:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.171325:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.171331:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c68a80 00000100:00100000:0.0:1746066818.174269:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.174397:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985566848 00000100:00100000:1.0:1746066818.174408:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985566848 00010000:00010000:1.0:1746066818.174451:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.174501:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9519 00000100:00100000:1.0:1746066818.174509:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985566848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.174520:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.174539:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.174549:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.174570:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfb2128 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de2 expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.174594:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.174596:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.174603:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.174611:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.174641:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.174652:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985164672:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.174741:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.176974:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985164672:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.177000:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.177052:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985566848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2543us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.177060:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9519 00000100:00100000:0.0:1746066818.177661:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.177750:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985567104 00000100:00100000:3.0:1746066818.177758:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985567104 00002000:00100000:3.0:1746066818.177804:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f711180 x1830882985567104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.177814:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711180 with x1830882985567104 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.177819:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711180 00000100:00100000:3.0:1746066818.177845:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7839 00000100:00100000:3.0:1746066818.177853:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985567104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066818.183192:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985567104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5327us (5524us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.183205:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7839 00002000:00100000:3.0:1746066818.183217:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f711180 x1830882985567104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.183324:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711180 with x1830882985567104 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.183329:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711180 00000100:00100000:0.0:1746066818.193148:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.193195:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.193276:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985567360 00000100:00100000:3.0:1746066818.193285:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985567360 00000100:00100000:1.0:1746066818.193312:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985567616 00000100:00100000:1.0:1746066818.193328:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985567616 00002000:00100000:3.0:1746066818.193354:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88011f712a00 x1830882985567360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.193366:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712a00 with x1830882985567360 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.193372:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f712a00 00002000:00100000:1.0:1746066818.193390:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f713b80 x1830882985567616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.193400:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713b80 with x1830882985567616 ext(2097152->4194303) 00002000:00010000:1.0:1746066818.193404:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713b80 00000100:00100000:3.0:1746066818.193410:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7840 00000100:00100000:3.0:1746066818.193469:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985567360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.194014:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7841 00000100:00100000:1.0:1746066818.194022:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985567616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.207397:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985567360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13968us (14246us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066818.207407:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7840 00002000:00100000:3.0:1746066818.207417:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88011f712a00 x1830882985567360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.207424:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712a00 with x1830882985567360 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.207429:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f712a00 00000100:00100000:1.0:1746066818.208708:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985567616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14682us (15508us total) trans 0 rc 1970176/1970176 00000100:00100000:1.0:1746066818.208718:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7841 00002000:00100000:1.0:1746066818.208726:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f713b80 x1830882985567616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1970176/1970176 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.208733:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713b80 with x1830882985567616 ext(2097152->4194303) 00002000:00010000:1.0:1746066818.208738:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713b80 00000100:00100000:0.0:1746066818.215550:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.215697:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985567872 00000100:00100000:1.0:1746066818.215707:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985567872 00002000:00100000:1.0:1746066818.215754:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011f711f80 x1830882985567872/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.215764:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711f80 with x1830882985567872 ext(4194304->4861951) 00002000:00010000:1.0:1746066818.215771:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711f80 00000100:00100000:1.0:1746066818.215803:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7842 00000100:00100000:1.0:1746066818.215810:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985567872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.221036:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985567872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5213us (5484us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066818.221049:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7842 00002000:00100000:1.0:1746066818.221061:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88011f711f80 x1830882985567872/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.221070:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711f80 with x1830882985567872 ext(4194304->4861951) 00002000:00010000:1.0:1746066818.221077:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711f80 00000100:00100000:0.0:1746066818.287271:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.287614:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985568000 00000100:00100000:3.0:1746066818.287625:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985568000 00000100:00100000:3.0:1746066818.287681:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20700 00000100:00100000:3.0:1746066818.287690:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985568000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.287711:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.287728:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e3d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.287751:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.287754:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.287762:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 44 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.287779:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 44 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.287790:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:3.0:1746066818.287835:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882985568000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.287840:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20700 00000100:00100000:0.0:1746066818.287929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.287999:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985568128 00000100:00100000:1.0:1746066818.288003:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985568128 00000100:00100000:1.0:1746066818.288026:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20701 00000100:00100000:1.0:1746066818.288031:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985568128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.288038:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.288047:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226ce00/0xf1867c21abfb2198 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e44 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.288087:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164800:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066818.288147:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.290222:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164800:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066818.290261:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b226ce00/0xf1867c21abfb2198 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e44 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.290273:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b226ce00/0xf1867c21abfb2198 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e44 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.290286:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226ce00, rc 0) 00000100:00100000:1.0:1746066818.290343:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985568128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2302us (2404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066818.290349:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20701 00000100:00100000:0.0:1746066818.298764:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.299179:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985568384 00000100:00100000:1.0:1746066818.299189:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985568384 00002000:00100000:1.0:1746066818.299235:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f711c00 x1830882985568384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.299245:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711c00 with x1830882985568384 ext(1048576->2097151) 00002000:00010000:1.0:1746066818.299251:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711c00 00000100:00100000:1.0:1746066818.300604:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7843 00000100:00100000:1.0:1746066818.300617:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985568384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.307742:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985568384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7117us (8977us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.307754:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7843 00002000:00100000:1.0:1746066818.307767:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f711c00 x1830882985568384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.307776:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711c00 with x1830882985568384 ext(1048576->2097151) 00002000:00010000:1.0:1746066818.307783:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711c00 00000100:00100000:3.0:1746066818.315400:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.315462:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985568640 00000100:00100000:1.0:1746066818.315474:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985568640 00002000:00100000:1.0:1746066818.315518:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff8800a5d7df80 x1830882985568640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.315536:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830882985568640 ext(2097152->2420735) 00002000:00010000:1.0:1746066818.315542:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7df80 00000100:00100000:1.0:1746066818.315568:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7844 00000100:00100000:1.0:1746066818.315575:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985568640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.319408:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.320166:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985568896 00000100:00100000:2.0:1746066818.320176:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985568896 00000100:00100000:3.0:1746066818.320371:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985568640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4786us (4968us total) trans 0 rc 323584/323584 00000100:00100000:3.0:1746066818.320381:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7844 00002000:00100000:3.0:1746066818.320390:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2420735) req@ffff8800a5d7df80 x1830882985568640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 323584/323584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.320398:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830882985568640 ext(2097152->2420735) 00002000:00010000:3.0:1746066818.320403:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7df80 00000100:00100000:2.0:1746066818.320628:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17315 00000100:00100000:2.0:1746066818.320639:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+57:3584:x1830882985568896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.320663:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.320683:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb219f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e4b expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.320781:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.320796:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.320806:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.320820:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066818.320929:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb219f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 60 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.320957:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 59 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.320965:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.320968:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066818.320972:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fa00, rc 0) 00000100:00100000:2.0:1746066818.321007:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+59:3584:x1830882985568896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 371us (1612us total) trans 8589937813 rc 0/0 00000100:00100000:2.0:1746066818.321012:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17315 00000100:00100000:0.0:1746066818.324518:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.324616:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569024 00000100:00100000:1.0:1746066818.324625:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569024 00000100:00100000:1.0:1746066818.324677:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20702 00000100:00100000:1.0:1746066818.324685:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+24:3582:x1830882985569024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.324706:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.324724:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e52 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.324754:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.324762:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066818.324764:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066818.324768:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.324799:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 13 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.324811:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 13 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.324830:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.325561:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.326929:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985164928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.326969:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.326984:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226de00, rc 0) 00000100:00100000:1.0:1746066818.327032:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+25:3582:x1830882985569024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2346us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.327039:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20702 00000100:00100000:0.0:1746066818.327235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.327388:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569152 00000100:00100000:3.0:1746066818.327398:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569152 00002000:00100000:3.0:1746066818.327439:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3358719) req@ffff88011f711500 x1830882985569152/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.327448:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711500 with x1830882985569152 ext(3231744->3358719) 00010000:00010000:3.0:1746066818.327456:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 14 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.327469:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 14 pid: 1893 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.327476:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f711500 00000100:00100000:3.0:1746066818.327508:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2244 00000100:00100000:3.0:1746066818.327515:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985569152:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066818.331088:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985569152:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3561us (3842us total) trans 21474842780 rc 0/0 00000100:00100000:3.0:1746066818.331101:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2244 00002000:00100000:3.0:1746066818.331114:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3358719) req@ffff88011f711500 x1830882985569152/t21474842780(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.331123:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711500 with x1830882985569152 ext(3231744->3358719) 00010000:00010000:3.0:1746066818.331134:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.331150:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.331157:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f711500 00000100:00100000:0.0:1746066818.335418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.335523:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569280 00000100:00100000:1.0:1746066818.335531:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569280 00010000:00010000:1.0:1746066818.335567:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.335610:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9520 00000100:00100000:1.0:1746066818.335619:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985569280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.335635:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.335656:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.335669:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.335698:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb2175 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e21 expref: 16 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.335718:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.335719:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.335726:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.335733:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.335766:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.335780:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985165056:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.335999:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.338408:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985165056:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.338438:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.338490:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985569280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2871us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.338499:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9520 00000100:00100000:0.0:1746066818.341777:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.341911:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569536 00000100:00100000:3.0:1746066818.341922:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569536 00002000:00100000:3.0:1746066818.341975:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f712300 x1830882985569536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.341992:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712300 with x1830882985569536 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.341999:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712300 00000100:00100000:3.0:1746066818.342030:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7845 00000100:00100000:3.0:1746066818.342042:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985569536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.351853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.351984:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569664 00000100:00100000:1.0:1746066818.351992:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569664 00000100:00100000:1.0:1746066818.352044:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20703 00000100:00100000:1.0:1746066818.352051:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:3584:x1830882985569664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066818.352068:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.352082:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e59 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.352107:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.352115:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.352121:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.352123:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.352126:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.352149:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.352161:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.352171:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.352850:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.352858:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 23 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.352871:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.353584:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.354208:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985569536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12160us (12433us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066818.354220:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7845 00002000:00100000:3.0:1746066818.354236:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f712300 x1830882985569536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.354246:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712300 with x1830882985569536 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.354251:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712300 00000100:00100000:0.0:1746066818.359042:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.359092:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.359278:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.359285:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569792 00000100:00100000:3.0:1746066818.359292:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569792 00000100:00100000:1.0:1746066818.359293:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.359326:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 46 pid: 1893 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.359329:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 46 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.359356:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c800, rc 0) 00000100:00100000:3.0:1746066818.359360:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985569920 00000100:00100000:3.0:1746066818.359362:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985569920 00010000:00010000:3.0:1746066818.359372:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.359386:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9521 00000100:00100000:3.0:1746066818.359393:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882985569792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.359406:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066818.359406:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+46:3584:x1830882985569664:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7357us (7561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.359412:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20703 00010000:00010000:3.0:1746066818.359425:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.359434:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.359451:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9522 00010000:00010000:3.0:1746066818.359453:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfb2191 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e3d expref: 45 pid: 1893 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.359456:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985569920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.359462:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.359467:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066818.359470:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.359478:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.359482:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882985569792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.359486:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9521 00010000:00010000:1.0:1746066818.359489:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb2183 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e2f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.359506:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.359508:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.359514:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.359522:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.359769:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.360074:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985165440:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.360668:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.361179:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.361297:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570048 00000100:00100000:1.0:1746066818.361303:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570048 00000100:00100000:1.0:1746066818.361479:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20704 00000100:00100000:1.0:1746066818.361487:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985570048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.361503:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.361517:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb21c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e60 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.361552:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165568:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066818.361819:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.362864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.363723:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570304 00000100:00100000:3.0:1746066818.363730:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570304 00002000:00100000:3.0:1746066818.363771:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->1703935) req@ffff8800a03d4a80 x1830882985570304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.363780:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882985570304 ext(1699840->1703935) 00002000:00010000:3.0:1746066818.363785:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4a80 00000100:00100000:3.0:1746066818.363814:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7846 00000100:00100000:3.0:1746066818.363822:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985570304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066818.363908:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985165440:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.363931:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.363966:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985569920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4509us (4873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.363975:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9522 00000100:00100000:3.0:1746066818.364628:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985570304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 804us (1764us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.364635:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7846 00002000:00100000:3.0:1746066818.364641:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->1703935) req@ffff8800a03d4a80 x1830882985570304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.364655:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882985570304 ext(1699840->1703935) 00002000:00010000:3.0:1746066818.364658:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4a80 00000100:00100000:1.0:1746066818.365025:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165568:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066818.365253:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb21c2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e60 expref: 45 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.365266:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb21c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e60 expref: 45 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.365935:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c400, rc 0) 00000100:00100000:1.0:1746066818.365967:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985570048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4480us (4796us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066818.365974:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20704 00000100:00100000:0.0:1746066818.375801:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.375948:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570432 00000100:00100000:1.0:1746066818.375958:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570432 00000100:00100000:1.0:1746066818.376021:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20705 00000100:00100000:1.0:1746066818.376031:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:3584:x1830882985570432:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066818.376051:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.376069:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e67 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.376100:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.376107:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.376112:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.376114:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.376116:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 45 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.376142:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.376150:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 22 pid: 9590 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.376160:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.376253:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.376260:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.376267:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.376284:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.377481:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.377489:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985165824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.377518:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 45 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.377536:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c600, rc 0) 00000100:00100000:1.0:1746066818.377864:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+45:3584:x1830882985570432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1834us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.377871:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20705 00000100:00100000:0.0:1746066818.379257:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.379373:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570560 00000100:00100000:1.0:1746066818.379380:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570560 00010000:00010000:1.0:1746066818.379408:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.379441:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9523 00000100:00100000:1.0:1746066818.379448:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985570560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.379459:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.379480:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.379490:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.381092:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb213d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2420736->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7df7 expref: 45 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.381130:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.381189:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985570560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1741us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.381199:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9523 00000100:00100000:0.0:1746066818.381718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.382353:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570688 00000100:00100000:1.0:1746066818.382361:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570688 00010000:00010000:1.0:1746066818.382386:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 23 pid: 9590 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.382417:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9524 00000100:00100000:1.0:1746066818.382423:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985570688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.382435:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.382452:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 23 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.382462:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 23 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.382477:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb2159 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e13 expref: 23 pid: 9590 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.382489:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.382491:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.382498:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.382506:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.382535:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.382552:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985165952:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.382636:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.385659:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985165952:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.385686:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.385742:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985570688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3317us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.385753:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9524 00000100:00100000:0.0:1746066818.386531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.386636:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985570944 00000100:00100000:2.0:1746066818.386646:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985570944 00002000:00100000:2.0:1746066818.386697:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2187264->2191359) req@ffff8800a03d5f80 x1830882985570944/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.386708:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5f80 with x1830882985570944 ext(2187264->2191359) 00002000:00010000:2.0:1746066818.386714:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5f80 00000100:00100000:2.0:1746066818.386755:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7847 00000100:00100000:2.0:1746066818.386765:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985570944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066818.387246:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985570944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 480us (713us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.387253:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7847 00002000:00100000:2.0:1746066818.387260:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2187264->2191359) req@ffff8800a03d5f80 x1830882985570944/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.387268:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5f80 with x1830882985570944 ext(2187264->2191359) 00002000:00010000:2.0:1746066818.387271:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5f80 00000100:00100000:0.0:1746066818.419262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.419437:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571072 00000100:00100000:1.0:1746066818.419447:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571072 00000100:00100000:1.0:1746066818.419579:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20706 00000100:00100000:1.0:1746066818.419588:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3586:x1830882985571072:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066818.419603:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.419618:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e6e expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.419644:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.419653:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.419658:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.419659:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.419662:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [331776->913407] (req 331776->913407) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 23 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.419692:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.419702:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.419712:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985166080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.420217:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.420225:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 43 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.420233:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985166208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.420256:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.421122:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985166080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.421130:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985166208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.421155:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [331776->913407] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 23 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.421167:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226d200, rc 0) 00000100:00100000:1.0:1746066818.421192:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3586:x1830882985571072:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1605us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.421202:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20706 00000100:00100000:0.0:1746066818.422133:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.422373:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571200 00000100:00100000:1.0:1746066818.422378:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571200 00010000:00010000:1.0:1746066818.422399:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.422431:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9525 00000100:00100000:1.0:1746066818.422436:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985571200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.422444:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.422459:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.422466:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.422482:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfb2121 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ddb expref: 44 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.422712:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.422745:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985571200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 308us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.422750:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9525 00000100:00100000:0.0:1746066818.422960:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.423119:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571328 00000100:00100000:1.0:1746066818.423123:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571328 00010000:00010000:1.0:1746066818.423135:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.424077:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9526 00000100:00100000:1.0:1746066818.424085:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985571328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.424094:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.424105:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.424115:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.424129:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfb2144 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7dfe expref: 23 pid: 13726 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.424139:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.424141:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.424146:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.424154:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.424176:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.424185:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985166336:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.424247:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.425316:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985166336:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.425403:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.425427:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985571328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1343us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.425434:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9526 00000100:00100000:0.0:1746066818.426486:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.426547:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571584 00000100:00100000:2.0:1746066818.426555:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571584 00002000:00100000:2.0:1746066818.426587:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->335871) req@ffff8800a03d7480 x1830882985571584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.426595:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985571584 ext(331776->335871) 00002000:00010000:2.0:1746066818.426599:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7480 00000100:00100000:2.0:1746066818.426629:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7848 00000100:00100000:2.0:1746066818.426635:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985571584:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066818.426743:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985571584:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 107us (262us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.426749:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7848 00002000:00100000:2.0:1746066818.426754:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->335871) req@ffff8800a03d7480 x1830882985571584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.426760:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985571584 ext(331776->335871) 00002000:00010000:2.0:1746066818.426763:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7480 00000100:00100000:0.0:1746066818.433521:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.433616:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571840 00000100:00100000:2.0:1746066818.433628:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571840 00002000:00100000:2.0:1746066818.433674:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (909312->913407) req@ffff88012c4a2a00 x1830882985571840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.433690:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a2a00 with x1830882985571840 ext(909312->913407) 00002000:00010000:2.0:1746066818.433696:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a2a00 00000100:00100000:2.0:1746066818.434300:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7849 00000100:00100000:2.0:1746066818.434309:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985571840:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066818.434464:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985571840:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 155us (953us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066818.434470:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7849 00002000:00100000:2.0:1746066818.434476:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (909312->913407) req@ffff88012c4a2a00 x1830882985571840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.434483:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a2a00 with x1830882985571840 ext(909312->913407) 00002000:00010000:2.0:1746066818.434486:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a2a00 00000100:00100000:0.0:1746066818.445091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.445250:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.445342:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.445492:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985571968 00000100:00100000:1.0:1746066818.445501:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985571968 00000100:00100000:0.0:1746066818.445504:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572096 00000100:00100000:0.0:1746066818.445507:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572096 00000100:00100000:1.0:1746066818.445878:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572224 00000100:00100000:1.0:1746066818.445881:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572224 00000100:00100000:0.0:1746066818.446017:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20707 00000100:00100000:3.0:1746066818.446023:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20708 00000100:00100000:0.0:1746066818.446025:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985571968:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066818.446029:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985572096:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066818.446052:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20709 00010000:00010000:3.0:1746066818.446053:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066818.446056:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985572224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.446063:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.446072:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb21d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e7c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.446072:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e83 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.446094:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.446097:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.446102:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb21d7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e7c expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.446104:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.446112:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfb21d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e7c expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.446116:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.446124:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0600, rc 0) 00010000:00010000:3.0:1746066818.446129:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:0.0:1746066818.446165:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985572224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 107us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.446171:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20709 00010000:00010000:0.0:1746066818.446187:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.446193:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb21e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e75 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.446231:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c4a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166464:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066818.446482:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985572096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 452us (1232us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.446487:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20708 00000100:00100000:0.0:1746066818.446699:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.447606:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c4a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166464:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.447626:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb21e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e75 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.447635:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb21e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e75 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.447678:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0000, rc 0) 00000100:00100000:2.0:1746066818.447710:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985571968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1685us (2631us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.447716:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20707 00000100:00100000:0.0:1746066818.450224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.450316:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572480 00000100:00100000:3.0:1746066818.450323:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572480 00002000:00100000:3.0:1746066818.450379:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c4a2d80 x1830882985572480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.450388:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a2d80 with x1830882985572480 ext(0->1048575) 00002000:00010000:3.0:1746066818.450393:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a2d80 00000100:00100000:3.0:1746066818.450493:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7850 00000100:00100000:3.0:1746066818.450502:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985572480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.453392:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985572480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2880us (3166us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746066818.453404:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7850 00002000:00100000:3.0:1746066818.453415:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c4a2d80 x1830882985572480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.453424:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a2d80 with x1830882985572480 ext(0->1048575) 00002000:00010000:3.0:1746066818.453429:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a2d80 00000100:00100000:0.0:1746066818.459647:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.459759:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572608 00000100:00100000:2.0:1746066818.459770:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572608 00000100:00100000:2.0:1746066818.459831:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20710 00000100:00100000:2.0:1746066818.459840:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3592:x1830882985572608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.459865:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.459920:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e8a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.459951:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 42 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.459957:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.459958:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.459961:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.459988:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 42 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.459997:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 42 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.460007:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.460096:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.461138:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.461164:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.461177:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:2.0:1746066818.461207:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3592:x1830882985572608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1367us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.461215:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20710 00000100:00100000:0.0:1746066818.461870:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.461982:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572736 00000100:00100000:3.0:1746066818.461988:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572736 00002000:00100000:3.0:1746066818.462025:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->2097151) req@ffff88012c4a1f80 x1830882985572736/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.462034:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1f80 with x1830882985572736 ext(1699840->2097151) 00010000:00010000:3.0:1746066818.462041:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 43 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.462053:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 43 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.462059:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c4a1f80 00000100:00100000:3.0:1746066818.462135:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2245 00000100:00100000:3.0:1746066818.462142:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985572736:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066818.465769:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985572736:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3612us (3885us total) trans 17179875437 rc 0/0 00000100:00100000:3.0:1746066818.465786:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2245 00002000:00100000:3.0:1746066818.465798:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1699840->2097151) req@ffff88012c4a1f80 x1830882985572736/t17179875437(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.465808:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1f80 with x1830882985572736 ext(1699840->2097151) 00010000:00010000:3.0:1746066818.465818:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.465832:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.465838:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c4a1f80 00000100:00100000:0.0:1746066818.467833:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.467933:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985572864 00000100:00100000:1.0:1746066818.467941:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985572864 00010000:00010000:1.0:1746066818.467974:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.468151:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9527 00000100:00100000:1.0:1746066818.468159:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985572864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.468173:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.468193:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.468204:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.468226:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c800/0xf1867c21abfb21bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e59 expref: 45 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.468258:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.468260:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.468269:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.468282:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.468349:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.468362:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985166720:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.468511:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.469724:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985166720:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.469748:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.469786:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985572864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1627us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.469794:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9527 00000100:00100000:0.0:1746066818.471223:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.471309:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985573120 00000100:00100000:3.0:1746066818.471316:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985573120 00002000:00100000:3.0:1746066818.471370:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012c4a1500 x1830882985573120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.471380:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1500 with x1830882985573120 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.471385:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a1500 00000100:00100000:3.0:1746066818.471477:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7851 00000100:00100000:3.0:1746066818.471485:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985573120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.479061:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985573120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7563us (7829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.479075:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7851 00002000:00100000:3.0:1746066818.479088:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012c4a1500 x1830882985573120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.479104:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c4a1500 with x1830882985573120 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.479111:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c4a1500 00000100:00100000:0.0:1746066818.483731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.483800:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985573248 00000100:00100000:2.0:1746066818.483809:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985573248 00000100:00100000:2.0:1746066818.483866:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20711 00000100:00100000:2.0:1746066818.483874:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3592:x1830882985573248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.483921:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.483939:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e91 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.483971:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.483978:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.483980:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.483983:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.484012:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.484024:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 43 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.484036:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.484127:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.485500:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.485547:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985573376 00000100:00100000:3.0:1746066818.485554:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985573376 00000100:00100000:3.0:1746066818.485601:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17316 00000100:00100000:3.0:1746066818.485608:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3593:x1830882985573376:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066818.485624:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.485639:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb21fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e98 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.485697:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485784:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485796:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485809:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485814:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485819:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485950:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.485964:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.485971:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 58 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.485977:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.486031:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 58 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.486040:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 58 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.486051:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985166976:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.486132:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.486141:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 38 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.486148:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985167104:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.486167:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.488625:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985166848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.488653:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.488669:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fc00, rc 0) 00000100:00100000:2.0:1746066818.488706:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3592:x1830882985573248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4833us (4987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.488714:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20711 00000100:00100000:0.0:1746066818.488825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.488854:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.488905:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985573760 00000100:00100000:0.0:1746066818.488906:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.488913:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985573760 00000100:00100000:1.0:1746066818.488955:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574016 00000100:00100000:1.0:1746066818.488958:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574016 00000100:00100000:3.0:1746066818.488971:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985166976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.488974:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6540 00000100:00100000:3.0:1746066818.488980:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985167104:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.488980:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+59:8545:x1830882985573760:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746066818.488995:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066818.489021:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6541 00000100:00100000:3.0:1746066818.489025:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:8546:x1830882985574016:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066818.489377:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+60:8545:x1830882985573760:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 397us (551us total) trans 8589937814 rc 0/0 00000100:00100000:1.0:1746066818.489384:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6540 00000100:00100000:2.0:1746066818.489492:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985573504 00000100:00100000:2.0:1746066818.489496:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985573504 00002000:00100000:2.0:1746066818.489519:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2191359) req@ffff88012b54dc00 x1830882985573504/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.489529:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54dc00 with x1830882985573504 ext(2097152->2191359) 00010000:00010000:2.0:1746066818.489536:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 44 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.489547:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 44 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.489554:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b54dc00 00000100:00100000:2.0:1746066818.489568:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2246 00000100:00100000:2.0:1746066818.489573:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985573504:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066818.489621:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:8546:x1830882985574016:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 594us (712us total) trans 8589937815 rc 0/0 00000100:00100000:3.0:1746066818.489626:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6541 00000100:00100000:0.0:1746066818.490869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.490916:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.491265:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574272 00000100:00100000:1.0:1746066818.491271:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574272 00000100:00100000:3.0:1746066818.491282:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574144 00000100:00100000:3.0:1746066818.491286:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574144 00010000:00010000:1.0:1746066818.491294:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.491300:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.491319:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9528 00000100:00100000:1.0:1746066818.491325:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+60:2015:x1830882985574272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066818.491326:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9529 00000100:00100000:3.0:1746066818.491343:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2015:x1830882985574144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.491346:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.491350:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.491352:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.491354:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.491362:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.491370:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.491401:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfb21a6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e4b expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.491496:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985573504:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1922us (2640us total) trans 17179875438 rc 0/0 00000100:00100000:2.0:1746066818.491503:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2246 00002000:00100000:2.0:1746066818.491511:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->2191359) req@ffff88012b54dc00 x1830882985573504/t17179875438(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.491518:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54dc00 with x1830882985573504 ext(2097152->2191359) 00010000:00010000:2.0:1746066818.491524:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.491558:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfb2167 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e1a expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.491559:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066818.491564:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.491575:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.491581:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.491588:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.491591:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066818.491610:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.491628:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+59:2015:x1830882985574272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 303us (761us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066818.491629:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066818.491635:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9528 00010000:00010000:0.0:1746066818.491636:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066818.491673:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066818.491677:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066818.491690:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491699:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491709:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491715:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491720:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491726:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491732:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984baa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.491735:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491742:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491750:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066818.491753:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.491756:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491761:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb2201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491777:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491782:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491786:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491789:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984bb000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.491791:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491794:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491799:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20c00) 00010000:00010000:0.0:1746066818.491801:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.491802:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491805:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfb2208 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.491833:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfb21fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.491849:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.491855:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.491857:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066818.491859:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bac00, rc 0) 00000100:00100000:0.0:1746066818.491909:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+13:3593:x1830882985573376:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6301us (6412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.491915:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17316 00010000:00010000:2.0:1746066818.491985:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.491992:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b54dc00 00000100:00100000:3.0:1746066818.492027:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2015:x1830882985574144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 695us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.492032:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9529 00000100:00100000:0.0:1746066818.494292:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.494330:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.494363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.494375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.494386:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.494424:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.494434:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574528 00000100:00100000:2.0:1746066818.494440:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574528 00000100:00100000:2.0:1746066818.494466:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574656 00000100:00100000:2.0:1746066818.494467:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574656 00000100:00100000:2.0:1746066818.494475:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574784 00000100:00100000:2.0:1746066818.494476:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574784 00000100:00100000:2.0:1746066818.494486:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574912 00000100:00100000:2.0:1746066818.494487:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574912 00000100:00100000:2.0:1746066818.494492:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985575040 00000100:00100000:2.0:1746066818.494494:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985575040 00000100:00100000:2.0:1746066818.494504:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20712 00000100:00100000:2.0:1746066818.494509:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985574528:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.494523:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.494538:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941a0c00/0xf1867c21abfb2216 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7e9f expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.494583:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167232:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.494640:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.494657:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20713 00000100:00100000:2.0:1746066818.494661:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985574656:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.494666:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.494674:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ea6 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.494682:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.494684:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.494690:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066818.494693:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20714 00000100:00100000:3.0:1746066818.494702:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985574784:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.494702:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.494709:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.494709:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00010000:00010000:3.0:1746066818.494719:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ead expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.494724:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985574656:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.494728:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20713 00010000:00010000:3.0:1746066818.494731:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.494733:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.494737:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066818.494738:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20715 00000100:00100000:2.0:1746066818.494740:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985574912:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.494744:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.494748:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb222b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7eb4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.494753:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.494758:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb222b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7eb4 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.494761:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00010000:00010000:2.0:1746066818.494763:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb222b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7eb4 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.494773:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2e00, rc 0) 00000100:00100000:3.0:1746066818.494780:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985574784:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 80us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.494782:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985574912:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 41us (396us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.494785:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20714 00000100:00100000:2.0:1746066818.494788:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20715 00000100:00100000:2.0:1746066818.494794:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20716 00000100:00100000:2.0:1746066818.494796:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985575040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.494799:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.494803:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ebb expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.494807:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985574400 00000100:00100000:3.0:1746066818.494810:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985574400 00010000:00010000:2.0:1746066818.494810:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.494811:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.494813:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.494819:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.494823:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2c00, rc 0) 00010000:00010000:3.0:1746066818.494827:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.494829:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985575040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.494833:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20716 00000100:00100000:3.0:1746066818.494843:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9530 00000100:00100000:3.0:1746066818.494848:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985574400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.494857:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.494874:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.495144:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.495162:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c600/0xf1867c21abfb21c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3047423] (req 2097152->2191359) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e67 expref: 46 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.495170:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.495172:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.495176:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.495184:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.495202:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.495210:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985167360:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066818.495248:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f540 going to sleep for 11 seconds 00002000:00010000:2.0:1746066818.497986:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066818 -> 1746066819 00000100:00100000:2.0:1746066818.498013:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167232:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.498045:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941a0c00/0xf1867c21abfb2216 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e9f expref: 9 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.498317:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941a0c00/0xf1867c21abfb2216 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e9f expref: 9 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.498328:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941a0c00, rc 0) 00000100:00100000:3.0:1746066818.498382:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985167360:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066818.498395:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.498444:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985574528:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3932us (4111us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.498452:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20712 00000100:00100000:3.0:1746066818.498524:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985574400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3675us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.498536:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9530 00000100:00100000:0.0:1746066818.501186:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.501370:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985575296 00000100:00100000:2.0:1746066818.501378:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985575296 00000100:00100000:2.0:1746066818.501424:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17317 00000100:00100000:2.0:1746066818.501431:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+13:3593:x1830882985575296:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.501450:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.501467:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb2239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ec2 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.501574:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.501589:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.501596:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.501626:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.501637:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 14 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.501649:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985167488:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.501723:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.503965:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985167488:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.503990:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066818.504006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.504295:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985575424 00000100:00100000:3.0:1746066818.504303:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985575424 00010000:00010000:3.0:1746066818.504343:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 15 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.504379:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9531 00000100:00100000:3.0:1746066818.504386:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985575424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.504400:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.504405:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 15 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.504416:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 15 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.504437:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfb220f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e98 expref: 15 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.504450:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.504454:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.504463:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.504469:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.504491:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.504539:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985575424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.504546:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9531 00010000:00010000:2.0:1746066818.504638:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.504719:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.504737:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066818.504855:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb2239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.504870:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.504877:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.504880:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066818.504901:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2a00, rc 0) 00000100:00100000:2.0:1746066818.504925:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+14:3593:x1830882985575296:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3495us (3749us total) trans 8589937816 rc 0/0 00000100:00100000:2.0:1746066818.504931:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17317 00000100:00100000:0.0:1746066818.506853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.507066:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985575680 00000100:00100000:2.0:1746066818.507074:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985575680 00002000:00100000:2.0:1746066818.507113:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012b54d880 x1830882985575680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.507123:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d880 with x1830882985575680 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.507129:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54d880 00000100:00100000:2.0:1746066818.507161:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7852 00000100:00100000:2.0:1746066818.507168:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985575680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.508202:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.508274:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576064 00000100:00100000:3.0:1746066818.508278:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576064 00000100:00100000:0.0:1746066818.508430:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17318 00000100:00100000:0.0:1746066818.508438:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:3593:x1830882985576064:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066818.508457:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066818.508468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066818.508474:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb224e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ec9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.508487:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985575936 00000100:00100000:1.0:1746066818.508490:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985575936 00002000:00100000:1.0:1746066818.508511:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5764e00 x1830882985575936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.508520:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764e00 with x1830882985575936 ext(2097152->4194303) 00002000:00010000:1.0:1746066818.508524:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5764e00 00000100:00100000:1.0:1746066818.508545:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7853 00000100:00100000:1.0:1746066818.508550:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985575936:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066818.508555:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066818.508570:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.508579:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066818.508609:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 15 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.508620:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 15 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746066818.508631:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985167616:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.508702:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.516457:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985167616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.516482:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066818.519091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.519316:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985575680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12145us (12466us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066818.519328:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7852 00002000:00100000:2.0:1746066818.519351:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012b54d880 x1830882985575680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.519360:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d880 with x1830882985575680 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.519365:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54d880 00000100:00100000:3.0:1746066818.519610:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576192 00000100:00100000:3.0:1746066818.519619:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576192 00010000:00010000:3.0:1746066818.519650:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 16 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.519694:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9532 00000100:00100000:3.0:1746066818.519701:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985576192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.519714:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.519720:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 16 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.519731:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 16 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.519753:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2240 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec2 expref: 16 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.519781:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.519786:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.519795:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.519802:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.519896:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066818.520027:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.520034:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066818.520087:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066818.520091:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066818.520107:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.520140:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb224e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec9 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.520152:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec9 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.520472:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985576192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 770us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.520480:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9532 00010000:00010000:2.0:1746066818.520520:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.520523:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066818.520526:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bcc00, rc 0) 00000100:00100000:2.0:1746066818.520564:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:3593:x1830882985576064:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 12126us (12365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.520570:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17318 00000100:00100000:1.0:1746066818.522943:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985575936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14382us (14470us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066818.522955:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7853 00002000:00100000:1.0:1746066818.522967:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5764e00 x1830882985575936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.522975:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764e00 with x1830882985575936 ext(2097152->4194303) 00002000:00010000:1.0:1746066818.522981:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5764e00 00000100:00100000:0.0:1746066818.524311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.524367:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576320 00000100:00100000:2.0:1746066818.524375:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576320 00000100:00100000:0.0:1746066818.524375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.524409:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576448 00000100:00100000:2.0:1746066818.524411:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576448 00000100:00100000:2.0:1746066818.524427:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20717 00000100:00100000:2.0:1746066818.524434:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985576320:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.524452:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.524469:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2800/0xf1867c21abfb225c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ed0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.524560:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20718 00000100:00100000:3.0:1746066818.524569:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985576448:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066818.524577:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.524586:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ed7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.524599:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.524601:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.524610:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.524625:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.524636:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419c00, rc 0) 00000100:00100000:3.0:1746066818.524670:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985576448:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.524675:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20718 00000100:00100000:2.0:1746066818.525042:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167744:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.525434:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.527002:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167744:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.527030:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2800/0xf1867c21abfb225c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed0 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.527044:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2800/0xf1867c21abfb225c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed0 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.527053:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2800, rc 0) 00000100:00100000:2.0:1746066818.527100:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985576320:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2666us (2796us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.527107:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20717 00000100:00100000:0.0:1746066818.533320:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.533411:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.533479:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576960 00000100:00100000:3.0:1746066818.533483:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985576832 00000100:00100000:3.0:1746066818.533488:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576832 00000100:00100000:1.0:1746066818.533488:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985576960 00002000:00100000:1.0:1746066818.533530:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012b54f100 x1830882985576960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066818.533535:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17319 00002000:00100000:1.0:1746066818.533540:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54f100 with x1830882985576960 ext(4194304->4861951) 00000100:00100000:3.0:1746066818.533543:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+14:3593:x1830882985576832:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:1.0:1746066818.533546:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54f100 00000100:00100000:1.0:1746066818.533558:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7854 00000100:00100000:1.0:1746066818.533563:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985576960:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066818.533564:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.533581:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfb226a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ede expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.533681:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.533725:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.533739:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066818.533755:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066818.533850:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfb226a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.533897:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.533905:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.533908:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066818.533911:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:3.0:1746066818.533959:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+16:3593:x1830882985576832:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 416us (651us total) trans 8589937817 rc 0/0 00000100:00100000:3.0:1746066818.533964:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17319 00000100:00100000:1.0:1746066818.540259:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985576960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6681us (6833us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066818.540271:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7854 00002000:00100000:1.0:1746066818.540282:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012b54f100 x1830882985576960/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.540292:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54f100 with x1830882985576960 ext(4194304->4861951) 00002000:00010000:1.0:1746066818.540298:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54f100 00000100:00100000:0.0:1746066818.540476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.540515:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.541067:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.541223:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.541240:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577088 00000100:00100000:3.0:1746066818.541249:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577088 00000100:00100000:3.0:1746066818.541293:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577344 00000100:00100000:3.0:1746066818.541295:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577344 00000100:00100000:3.0:1746066818.541307:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577600 00000100:00100000:3.0:1746066818.541309:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577600 00000100:00100000:3.0:1746066818.541320:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20719 00000100:00100000:3.0:1746066818.541326:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985577088:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746066818.541378:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20720 00010000:00010000:3.0:1746066818.541380:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.541387:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985577344:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066818.541397:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 23 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.541404:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.541406:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.541409:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.541413:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.541430:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.541439:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 24 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.541440:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 23 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.541445:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.541450:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.541451:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.541452:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 23 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.541453:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.541467:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167872:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.541482:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.541489:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 15 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.541498:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168000:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.541520:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.541540:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20721 00000100:00100000:3.0:1746066818.541546:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985577600:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066818.541563:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.541578:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.541585:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.541592:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 44 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.541593:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 24 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.541598:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.541600:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.541601:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 24 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.541602:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.541610:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168128:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.541618:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 44 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.541627:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 44 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.541631:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066818.541634:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.541638:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.541645:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.541660:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066818.541660:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0300 going to sleep for 11 seconds 00010000:00010000:3.0:1746066818.541668:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 10 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.541680:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.542023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.542060:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.542282:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577216 00000100:00100000:1.0:1746066818.542287:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577216 00010000:00010000:3.0:1746066818.542303:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.542306:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577472 00000100:00100000:1.0:1746066818.542307:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577472 00010000:00010000:3.0:1746066818.542310:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 23 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.542315:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577728 00000100:00100000:1.0:1746066818.542317:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577728 00000100:00100000:3.0:1746066818.542318:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.542346:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20722 00000100:00100000:1.0:1746066818.542351:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985577216:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:3.0:1746066818.542354:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20723 00000100:00100000:3.0:1746066818.542360:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985577472:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066818.542367:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542377:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.542377:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.542383:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542387:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.542390:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542395:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.542400:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.542401:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.542402:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.542402:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.542404:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.542404:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542419:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.542419:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.542426:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.542428:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 11 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.542434:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985168768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.542437:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985168896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.542457:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542460:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.542465:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 10 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.542468:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 23 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.542472:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985169024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.542475:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985169152:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.542486:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00010000:00010000:1.0:1746066818.542496:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.542497:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066818.542503:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.542513:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985169280:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.542518:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20724 00000100:00100000:3.0:1746066818.542523:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985577728:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:1.0:1746066818.542526:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066818.542536:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542545:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542552:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542564:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542569:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.542570:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.542572:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542584:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542591:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 15 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.542597:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169408:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.542616:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.542624:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 10 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.542636:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.542657:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.542669:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.542675:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169664:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.542686:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.548755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.548786:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578368 00000100:00100000:0.0:1746066818.548795:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578368 00010000:00010000:0.0:1746066818.548835:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 12 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.548849:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985168896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.548864:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9533 00000100:00100000:3.0:1746066818.548871:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985167872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.548871:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985578368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066818.548908:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.548914:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.548930:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 12 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.548936:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066818.548942:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 12 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.548944:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066818.548965:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfb2224 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ead expref: 12 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.548994:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066818.549034:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985578368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.549044:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9533 00000100:00100000:3.0:1746066818.549068:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985169152:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.549074:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066818.549081:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.549083:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577984 00000100:00100000:0.0:1746066818.549085:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577984 00010000:00010000:0.0:1746066818.549097:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 16 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746066818.549111:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9534 00000100:00100000:0.0:1746066818.549116:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985577984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066818.549124:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066818.549133:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066818.549135:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 16 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.549142:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168128:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066818.549143:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 16 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.549150:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985168384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066818.549155:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfb19e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79b3 expref: 16 pid: 9592 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.549164:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.549167:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066818.549171:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.549180:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985577984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.549186:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9534 00000100:00100000:2.0:1746066818.549188:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578240 00000100:00100000:2.0:1746066818.549190:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578240 00010000:00010000:2.0:1746066818.549202:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.549217:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9535 00000100:00100000:2.0:1746066818.549222:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985578240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.549227:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.549236:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.549243:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.549254:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb2263 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ed7 expref: 11 pid: 3528 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.549265:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.549265:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985168768:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.549288:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985578240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.549294:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9535 00000100:00100000:0.0:1746066818.549356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.549379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.549436:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985577856 00000100:00100000:1.0:1746066818.549440:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985577856 00002000:00100000:1.0:1746066818.549467:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->913407) req@ffff88006e210000 x1830882985577856/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.549477:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882985577856 ext(331776->913407) 00010000:00010000:1.0:1746066818.549482:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.549491:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746066818.549496:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88006e210000 00000100:00100000:1.0:1746066818.549518:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2247 00000100:00100000:1.0:1746066818.549523:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985577856:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066818.549729:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.549743:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.549755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.549775:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.550140:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985169024:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.550147:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985169280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.550169:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.550213:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578112 00000100:00100000:2.0:1746066818.550216:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578112 00010000:00010000:2.0:1746066818.550228:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 11 pid: 11630 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.550242:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578496 00000100:00100000:2.0:1746066818.550244:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578496 00010000:00010000:2.0:1746066818.550252:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 25 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.550260:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578624 00000100:00100000:2.0:1746066818.550262:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578624 00010000:00010000:2.0:1746066818.550267:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.550274:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578752 00000100:00100000:2.0:1746066818.550276:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578752 00010000:00010000:2.0:1746066818.550282:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 26 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.550289:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985578880 00000100:00100000:2.0:1746066818.550291:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985578880 00010000:00010000:2.0:1746066818.550299:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 45 pid: 9591 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.550308:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9536 00000100:00100000:2.0:1746066818.550313:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985578112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.550321:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.550341:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 11 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550355:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 11 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550367:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfb1933 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d795f expref: 11 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550378:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.550398:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985578112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550403:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9536 00000100:00100000:2.0:1746066818.550414:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9537 00000100:00100000:2.0:1746066818.550418:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985578496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.550425:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.550430:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 25 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550438:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 25 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550449:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfb1a59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d79f2 expref: 25 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550456:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.550458:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.550462:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550470:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550486:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.550500:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985578496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550505:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9537 00000100:00100000:2.0:1746066818.550514:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9538 00000100:00100000:2.0:1746066818.550518:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985578624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.550523:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.550531:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550538:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550547:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb214b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e05 expref: 15 pid: 12233 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.550555:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.550566:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985578624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550570:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9538 00000100:00100000:2.0:1746066818.550597:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9539 00000100:00100000:2.0:1746066818.550601:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985578752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.550608:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.550614:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 26 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550622:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 26 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550633:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfb21ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e8a expref: 26 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550641:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.550642:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.550645:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550651:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550669:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.550682:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985578752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550688:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9539 00000100:00100000:2.0:1746066818.550696:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9540 00000100:00100000:2.0:1746066818.550700:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985578880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.550705:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.550711:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 45 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550723:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 45 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550733:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfb2056 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3047424->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7d5d expref: 45 pid: 9591 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.550741:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.550754:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985578880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550759:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9540 00010000:00010000:2.0:1746066818.550777:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550784:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550799:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550806:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550813:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550819:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.550823:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550832:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550841:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.550848:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb2286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.550902:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985577344:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 9517us (10386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.550909:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20720 00010000:00010000:3.0:1746066818.551025:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551034:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551052:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551059:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551065:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551070:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096a59600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.551073:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551079:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551089:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.551094:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb229b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.551148:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985577472:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8787us (9124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.551155:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20723 00000100:00100000:2.0:1746066818.551183:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.551458:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985168640:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.551487:0:13726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.551873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.552136:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169536:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.552145:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985169664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.552161:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.552527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.552580:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.553210:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579136 00000100:00100000:1.0:1746066818.553213:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579264 00000100:00100000:2.0:1746066818.553217:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579136 00000100:00100000:1.0:1746066818.553217:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579264 00010000:00010000:2.0:1746066818.553241:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.553241:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 24 pid: 20361 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.553263:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579520 00000100:00100000:1.0:1746066818.553264:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579520 00000100:00100000:2.0:1746066818.553268:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9541 00010000:00010000:1.0:1746066818.553272:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 25 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.553273:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985579136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.553284:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066818.553289:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9542 00000100:00100000:1.0:1746066818.553293:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985579264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.553298:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.553298:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.553305:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 25 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.553307:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.553312:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 25 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.553325:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2c00/0xf1867c21abfb2232 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ebb expref: 9 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.553325:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb200/0xf1867c21abfb212f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7de9 expref: 25 pid: 20361 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.553352:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066818.553352:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.553383:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985579264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.553389:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9542 00000100:00100000:1.0:1746066818.553403:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9543 00000100:00100000:1.0:1746066818.553407:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985579520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.553416:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.553423:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 23 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.553430:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 23 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.553440:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb21b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e52 expref: 23 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.553447:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.554826:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985579136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1547us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.554835:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9541 00000100:00100000:1.0:1746066818.555384:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985579520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1973us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.555391:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9543 00000100:00100000:2.0:1746066818.555766:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.555992:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579392 00000100:00100000:1.0:1746066818.555999:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579392 00000100:00100000:2.0:1746066818.556008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066818.556025:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 14 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.556038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.556770:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579008 00000100:00100000:1.0:1746066818.556774:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579008 00000100:00100000:2.0:1746066818.556779:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579648 00000100:00100000:2.0:1746066818.556781:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579648 00010000:00010000:1.0:1746066818.556786:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.556793:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 25 pid: 11630 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.556804:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9544 00000100:00100000:1.0:1746066818.556810:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985579392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.556821:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.556838:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 14 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.556848:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 14 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.556870:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb21de lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e83 expref: 14 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.556896:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.556898:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.556903:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.556912:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.556935:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.556964:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985579392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 155us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.556970:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9544 00000100:00100000:1.0:1746066818.556981:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9545 00000100:00100000:1.0:1746066818.556985:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985579008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.556991:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.556999:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.557007:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.557019:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb221d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ea6 expref: 8 pid: 11630 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.557028:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.557029:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.557032:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557037:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.557048:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9546 00010000:00010000:1.0:1746066818.557049:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.557054:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985579648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.557060:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066818.557062:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985579008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.557067:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9545 00010000:00010000:2.0:1746066818.557071:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 25 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.557078:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 25 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.557089:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fc00/0xf1867c21abfb21f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e91 expref: 25 pid: 11630 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.557097:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.557098:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.557101:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557105:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557106:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557112:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557118:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066818.557127:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.557131:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985579648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (1091us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066818.557134:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.557136:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9546 00010000:00010000:1.0:1746066818.557145:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557149:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557152:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b226cc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.557156:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557156:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557163:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557166:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557171:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557172:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557177:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.557178:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfb2294 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557182:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943eae00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.557183:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557188:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557194:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557198:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb22a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.557211:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985577216:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 14860us (15988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.557218:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20722 00000100:00100000:2.0:1746066818.557219:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985577728:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 14696us (15159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.557224:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20724 00010000:00010000:2.0:1746066818.557237:0:13726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557243:0:13726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557254:0:13726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557260:0:13726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557265:0:13726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557270:0:13726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094418c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.557272:0:13726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557277:0:13726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557285:0:13726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.557290:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094418c00/0xf1867c21abfb228d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.558157:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985577600:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 16607us (17087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.558164:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20721 00000100:00100000:2.0:1746066818.559620:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985577856:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10093us (10402us total) trans 17179875439 rc 0/0 00000100:00100000:2.0:1746066818.559628:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2247 00002000:00100000:2.0:1746066818.559636:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->913407) req@ffff88006e210000 x1830882985577856/t17179875439(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.559645:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882985577856 ext(331776->913407) 00010000:00010000:2.0:1746066818.559652:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.559665:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746066818.559671:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88006e210000 00000100:00100000:0.0:1746066818.561671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.561737:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985579776 00000100:00100000:2.0:1746066818.561745:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985579776 00010000:00010000:2.0:1746066818.561773:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.561804:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9547 00000100:00100000:2.0:1746066818.561811:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985579776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.561826:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.561844:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.561854:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.561873:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb21d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7e6e expref: 24 pid: 13726 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.561904:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.561909:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.561912:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.561918:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.561939:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066818.561961:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.561969:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.561982:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985579776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 172us (319us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066818.561985:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.561987:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9547 00010000:00010000:3.0:1746066818.561992:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.561999:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.562005:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094419000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.562009:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.562017:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.562026:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.562033:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419000/0xf1867c21abfb227f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.562293:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985577088:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 20965us (21817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.562302:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20719 00000100:00100000:0.0:1746066818.563165:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.563275:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580032 00000100:00100000:3.0:1746066818.563280:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580032 00000100:00100000:3.0:1746066818.563362:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17320 00000100:00100000:3.0:1746066818.563369:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+16:3593:x1830882985580032:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746066818.563517:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.563536:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2255 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ec9 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563548:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.563562:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066818.563588:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.563601:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 38 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563608:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 58 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563614:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563619:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 58 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563625:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.563653:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 58 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563664:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 58 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.563677:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985169792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.563762:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563770:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 38 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.563783:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985169920:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.563809:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 58 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563816:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 58 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.563823:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985170048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.563842:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 38 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.563848:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 38 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.563868:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985170176:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.563911:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.565245:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.565272:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.565287:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.565324:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580160 00000100:00100000:0.0:1746066818.565327:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.565342:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580160 00000100:00100000:3.0:1746066818.565352:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985169792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.565362:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985169920:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.565363:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580416 00000100:00100000:1.0:1746066818.565367:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580416 00010000:00010000:2.0:1746066818.565368:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 59 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.565369:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985170048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.565375:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985170176:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.565381:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 60 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.565389:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580288 00000100:00100000:2.0:1746066818.565392:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580288 00010000:00010000:3.0:1746066818.565396:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.565400:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 39 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.565405:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580544 00000100:00100000:1.0:1746066818.565408:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580544 00000100:00100000:2.0:1746066818.565411:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9548 00000100:00100000:2.0:1746066818.565417:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+60:2014:x1830882985580160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.565417:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 40 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.565418:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9549 00000100:00100000:3.0:1746066818.565424:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+60:2014:x1830882985580416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066818.565424:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9550 00010000:00010000:2.0:1746066818.565425:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.565429:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.565432:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066818.565432:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985580288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066818.565433:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9551 00010000:00010000:3.0:1746066818.565436:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 60 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.565437:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985580544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.565438:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.565439:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.565442:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066818.565444:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.565446:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 60 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.565446:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 40 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.565462:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb1df5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bea expref: 60 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.565463:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746066818.565470:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 40 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.565482:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c5600/0xf1867c21abfb1d62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7b9d expref: 59 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.565486:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfb1da1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7bc7 expref: 40 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746066818.565488:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.565492:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.565499:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066818.565504:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066818.565504:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb19b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7990 expref: 39 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.565507:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.565517:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.565523:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066818.565526:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+58:2014:x1830882985580160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (283us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066818.565529:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066818.565531:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.565531:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.565532:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9548 00010000:00010000:1.0:1746066818.565534:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066818.565539:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.565546:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985580544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.565546:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985580288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (258us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066818.565548:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066818.565551:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9550 00010000:00010000:3.0:1746066818.565553:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066818.565554:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9551 00000040:00080000:3.0:1746066818.565790:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1248, 88 off117416 00000004:00080000:3.0:1746066818.565797:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786776913105ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.565835:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1252, 88 off117680 00000004:00080000:3.0:1746066818.565840:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786776956288ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.565863:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1253, 88 off117768 00000004:00080000:3.0:1746066818.565866:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786776982948ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.565878:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1249, 88 off117504 00000004:00080000:3.0:1746066818.565880:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786776996875ns, next at 733263941116ns, rc = 0 00000100:00100000:3.0:1746066818.565919:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+57:2014:x1830882985580416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 495us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.565926:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9549 00000040:00080000:2.0:1746066818.565951:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1250, 88 off117592 00000004:00080000:2.0:1746066818.565956:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777072977ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.565974:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1254, 88 off117856 00000004:00080000:2.0:1746066818.565977:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777094140ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066818.565997:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1255, 88 off117944 00000004:00080000:2.0:1746066818.566001:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777117548ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066818.566008:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1256, 88 off118032 00000004:00080000:2.0:1746066818.566011:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777127470ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066818.566018:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1251, 88 off117680 00000004:00080000:2.0:1746066818.566021:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777137455ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566039:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1257, 88 off118120 00000004:00080000:2.0:1746066818.566042:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777158790ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066818.566052:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1252, 88 off117768 00000004:00080000:2.0:1746066818.566054:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777170997ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566062:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1258, 88 off118208 00000004:00080000:2.0:1746066818.566064:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777180798ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066818.566071:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1253, 88 off117856 00000004:00080000:2.0:1746066818.566073:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777190257ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566081:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1254, 88 off117944 00000004:00080000:2.0:1746066818.566083:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777199645ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566090:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1255, 88 off118032 00000004:00080000:2.0:1746066818.566093:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777209738ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566100:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1256, 88 off118120 00000004:00080000:2.0:1746066818.566103:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786777219247ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066818.566109:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1259, 88 off118296 00000004:00080000:2.0:1746066818.566112:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786777228610ns, next at 733263917711ns, rc = 0 00000001:00080000:3.0:1746066818.569052:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937818 is committed 00000004:00080000:3.0:1746066818.569064:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1233 committed 00000004:00080000:3.0:1746066818.569081:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1232 committed 00000004:00080000:3.0:1746066818.569095:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1231 committed 00000004:00080000:3.0:1746066818.569097:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1230 committed 00000004:00080000:3.0:1746066818.569101:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1229 committed 00000004:00080000:3.0:1746066818.569103:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1232 committed 00000004:00080000:3.0:1746066818.569104:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1228 committed 00000004:00080000:3.0:1746066818.569106:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1231 committed 00000004:00080000:3.0:1746066818.569107:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1227 committed 00000004:00080000:3.0:1746066818.569109:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1230 committed 00000004:00080000:3.0:1746066818.569111:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1229 committed 00000004:00080000:3.0:1746066818.569112:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1228 committed 00000004:00080000:3.0:1746066818.569114:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1226 committed 00000004:00080000:3.0:1746066818.569116:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1225 committed 00000004:00080000:3.0:1746066818.569118:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1227 committed 00000004:00080000:3.0:1746066818.569120:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1226 committed 00000004:00080000:3.0:1746066818.569121:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1224 committed 00000001:00080000:3.0:1746066818.569130:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937815 is committed 00000001:00080000:3.0:1746066818.569135:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937814 is committed 00000100:00100000:2.0:1746066818.569220:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985170304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.569241:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985170688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.569243:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985170560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.569279:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066818.569296:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066818.569311:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985171200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.569318:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985170816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.569327:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066818.569372:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170304 00000100:00100000:3.0:1746066818.569378:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170304 00000004:00010000:2.0:1746066818.569378:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88006e212300 reply state ffff8800a0100400 transno 8589937818 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.569398:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066818.569406:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.569408:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066818.569411:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170688 00000100:00100000:2.0:1746066818.569412:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746066818.569413:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170688 00000100:00100000:3.0:1746066818.569422:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171200 00000100:00100000:3.0:1746066818.569424:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171200 00000100:00100000:3.0:1746066818.569435:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20725 00000100:00100000:3.0:1746066818.569441:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3777:x1830882985170304:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746066818.569485:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066818.569498:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3593:x1830882985580032:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 6128us (6333us total) trans 8589937818 rc 0/0 00000100:00100000:2.0:1746066818.569504:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17320 00000100:00100000:2.0:1746066818.569531:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20726 00000100:00100000:2.0:1746066818.569537:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882985170688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.569555:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985170304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (277us total) trans 17179875440 rc 0/0 00000100:00100000:3.0:1746066818.569564:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20725 00000100:00100000:3.0:1746066818.569573:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20727 00000100:00100000:3.0:1746066818.569577:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882985171200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.569610:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882985170688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (313us total) trans 17179875441 rc 0/0 00000100:00100000:2.0:1746066818.569615:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20726 00002000:00010000:3.0:1746066818.569617:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:3.0:1746066818.569620:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066818.569622:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066818.569624:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066818.569626:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:3.0:1746066818.569642:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882985171200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (314us total) trans 17179875442 rc 0/0 00000004:00080000:2.0:1746066818.569644:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f713800/2, rc 0, transno 17179875441 00000100:00100000:3.0:1746066818.569647:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20727 00000100:00100000:2.0:1746066818.569651:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985170688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066818.569659:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89180/2, rc 0, transno 17179875442 00000100:00100000:2.0:1746066818.569661:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985171200:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066818.569663:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.569670:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066818.569672:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746066818.569677:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.569682:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943ea200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066818.569686:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00000004:00080000:2.0:1746066818.569688:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c6a300/2, rc 0, transno 17179875440 00000100:00100000:2.0:1746066818.569691:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985170304:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066818.569692:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.569701:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:2.0:1746066818.569702:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170816 00010000:00010000:3.0:1746066818.569704:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066818.569704:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170816 00010000:00010000:3.0:1746066818.569707:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066818.569711:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ea200/0xf1867c21abfb22a9 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066818.569717:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20728 00000100:00100000:2.0:1746066818.569722:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985170816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066818.569762:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066818.569764:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066818.569767:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066818.569769:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066818.569770:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066818.569773:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985170432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.569824:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.569853:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882985170816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (179us total) trans 17179875443 rc 0/0 00000100:00100000:0.0:1746066818.569855:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.569858:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20728 00000100:00100000:2.0:1746066818.569867:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170560 00000100:00100000:2.0:1746066818.569870:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170560 00000100:00100000:0.0:1746066818.569870:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985170944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.569872:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985171072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.569880:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170432 00000100:00100000:2.0:1746066818.569905:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170432 00000100:00100000:0.0:1746066818.569908:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.569916:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.569925:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985170944 00000100:00100000:2.0:1746066818.569927:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985170944 00000100:00080000:0.0:1746066818.569930:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066818.569937:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171072 00000100:00100000:2.0:1746066818.569939:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171072 00000100:00100000:1.0:1746066818.569944:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20729 00000100:00100000:0.0:1746066818.569948:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20730 00000100:00100000:1.0:1746066818.569951:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985170560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066818.569960:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882985170432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.570017:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985170560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (193us total) trans 17179875444 rc 0/0 00000100:00100000:0.0:1746066818.570024:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882985170432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (168us total) trans 17179875445 rc 0/0 00000100:00100000:2.0:1746066818.570084:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20731 00000100:00100000:2.0:1746066818.570090:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882985170944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.570120:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20729 00000100:00100000:0.0:1746066818.570125:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20730 00000100:00100000:1.0:1746066818.570132:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20732 00000100:00100000:1.0:1746066818.570136:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882985171072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.570144:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985170944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (235us total) trans 17179875446 rc 0/0 00000100:00100000:2.0:1746066818.570149:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20731 00000100:00100000:1.0:1746066818.570183:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882985171072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (267us total) trans 17179875447 rc 0/0 00000100:00100000:1.0:1746066818.570188:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20732 00000100:00100000:0.0:1746066818.570204:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985171456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570215:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985171584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.570224:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.570233:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171456 00000100:00100000:1.0:1746066818.570236:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171456 00000100:00100000:0.0:1746066818.570238:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985171968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.570249:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.570253:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171968 00000100:00100000:1.0:1746066818.570255:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171968 00000100:00100000:2.0:1746066818.570258:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20733 00000100:00100000:2.0:1746066818.570262:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3774:x1830882985171456:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066818.570264:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c6b480/2, rc 0, transno 17179875445 00000100:00100000:1.0:1746066818.570265:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20734 00000100:00100000:0.0:1746066818.570267:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985170432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.570269:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3774:x1830882985171968:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066818.570273:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710e00/2, rc 0, transno 17179875446 00000100:00100000:0.0:1746066818.570276:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985170944:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746066818.570287:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066818.570312:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.570325:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570351:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.570354:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3774:x1830882985171456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (129us total) trans 21474842781 rc 0/0 00000100:00100000:2.0:1746066818.570359:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20733 00000004:00080000:1.0:1746066818.570367:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765500/2, rc 0, transno 17179875444 00000100:00100000:2.0:1746066818.570370:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171584 00000100:00100000:1.0:1746066818.570371:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985170560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.570372:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171584 00000004:00080000:1.0:1746066818.570378:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8bb80/2, rc 0, transno 17179875447 00000100:00100000:2.0:1746066818.570381:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985172096 00000100:00100000:1.0:1746066818.570381:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985171072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.570383:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985172096 00000100:00100000:2.0:1746066818.570390:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20735 00000100:00100000:2.0:1746066818.570394:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882985171584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570394:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20736 00000100:00100000:1.0:1746066818.570399:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882985172096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.570441:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985171584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (128us total) trans 21474842783 rc 0/0 00000100:00100000:2.0:1746066818.570445:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20735 00000100:00100000:2.0:1746066818.570457:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985171712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570457:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882985172096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (104us total) trans 21474842784 rc 0/0 00000100:00100000:3.0:1746066818.570458:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985171328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570465:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20736 00000100:00100000:2.0:1746066818.570470:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.570474:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171712 00000100:00100000:1.0:1746066818.570476:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171712 00000100:00100000:2.0:1746066818.570479:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985172224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066818.570480:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.570490:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066818.570493:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985171840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.570501:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171328 00000100:00100000:2.0:1746066818.570504:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171328 00000100:00100000:3.0:1746066818.570506:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066818.570513:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985172352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.570522:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985172224 00000100:00100000:2.0:1746066818.570523:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985172224 00000100:00100000:3.0:1746066818.570525:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.570526:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985171840 00000100:00100000:1.0:1746066818.570528:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985171840 00000100:00100000:2.0:1746066818.570530:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20737 00000100:00100000:2.0:1746066818.570533:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985171328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570535:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985172352 00000004:00080000:3.0:1746066818.570537:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710380/2, rc 0, transno 17179875443 00000100:00100000:1.0:1746066818.570537:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985172352 00000100:00100000:3.0:1746066818.570541:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985170816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.570543:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20738 00000100:00100000:1.0:1746066818.570547:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882985171712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066818.570558:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20739 00000100:00100000:3.0:1746066818.570563:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882985172224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.570579:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985171328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (98us total) trans 21474842785 rc 0/0 00000100:00100000:2.0:1746066818.570583:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20737 00000100:00100000:2.0:1746066818.570590:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20740 00000004:00080000:0.0:1746066818.570593:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e1c00/2, rc 0, transno 21474842781 00000100:00100000:2.0:1746066818.570594:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882985171840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570596:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882985171712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (125us total) trans 21474842786 rc 0/0 00000100:00100000:0.0:1746066818.570597:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985171456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570601:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20738 00000100:00100000:1.0:1746066818.570608:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20741 00000100:00100000:1.0:1746066818.570612:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985172352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.570626:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3776:x1830882985172224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (134us total) trans 21474842787 rc 0/0 00000100:00100000:3.0:1746066818.570631:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20739 00000100:00100000:2.0:1746066818.570632:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882985171840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (125us total) trans 21474842788 rc 0/0 00000100:00100000:2.0:1746066818.570637:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20740 00000004:00080000:3.0:1746066818.570651:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212a00/2, rc 0, transno 21474842785 00000004:00080000:2.0:1746066818.570653:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e0700/2, rc 0, transno 21474842786 00000100:00100000:1.0:1746066818.570653:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882985172352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (127us total) trans 17179875448 rc 0/0 00000100:00100000:3.0:1746066818.570655:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985171328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.570656:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985171712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570657:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20741 00000004:00080000:3.0:1746066818.570662:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e3480/2, rc 0, transno 21474842788 00000004:00080000:2.0:1746066818.570663:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e2a00/2, rc 0, transno 21474842787 00000100:00100000:3.0:1746066818.570665:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985171840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.570666:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985172224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066818.570672:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8a680/2, rc 0, transno 17179875448 00000100:00100000:3.0:1746066818.570675:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985172352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.570701:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985171968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 432us (451us total) trans 21474842782 rc 0/0 00000100:00100000:1.0:1746066818.570706:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20734 00000004:00080000:0.0:1746066818.570723:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e2680/2, rc 0, transno 21474842782 00000004:00080000:1.0:1746066818.570725:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e1880/2, rc 0, transno 21474842783 00000100:00100000:0.0:1746066818.570727:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985171968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.570728:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985171584:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066818.570733:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e1f80/2, rc 0, transno 21474842784 00000100:00100000:1.0:1746066818.570735:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.572971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.572994:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580672 00000100:00100000:2.0:1746066818.573001:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580672 00000100:00100000:2.0:1746066818.573048:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17321 00000100:00100000:2.0:1746066818.573054:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+7:3593:x1830882985580672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.573074:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.573092:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ee5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.573144:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.573156:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.573171:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.573174:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066818.573185:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984baa00, rc 0) 00000100:00100000:2.0:1746066818.573236:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3593:x1830882985580672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 181us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.573241:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17321 00000100:00100000:0.0:1746066818.576305:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.576386:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580800 00000100:00100000:2.0:1746066818.576394:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580800 00000100:00100000:2.0:1746066818.576479:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17322 00000100:00100000:2.0:1746066818.576487:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3593:x1830882985580800:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.576507:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.576525:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba000/0xf1867c21abfb22b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7eec expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.576613:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.576627:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.576638:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.576669:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066818.576674:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066818.576688:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.576710:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba000/0xf1867c21abfb22b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7eec expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.577301:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7eec expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.577311:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.577314:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066818.577317:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59c00, rc 0) 00000100:00100000:2.0:1746066818.577383:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3593:x1830882985580800:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 897us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.577389:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17322 00000100:00100000:0.0:1746066818.579014:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.579044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.579063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.579090:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985580928 00000100:00100000:1.0:1746066818.579099:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985580928 00000100:00100000:3.0:1746066818.579117:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581056 00000100:00100000:3.0:1746066818.579121:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581056 00000100:00100000:0.0:1746066818.579124:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.579228:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581184 00000100:00100000:1.0:1746066818.579232:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581184 00000100:00100000:1.0:1746066818.579258:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581312 00000100:00100000:1.0:1746066818.579260:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581312 00000100:00100000:1.0:1746066818.579275:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20742 00000100:00100000:1.0:1746066818.579282:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985580928:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066818.579296:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066818.579302:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20743 00000100:00100000:3.0:1746066818.579309:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985581056:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066818.579317:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ef3 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.579322:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.579344:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7efa expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066818.579347:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd83, atime: 0x6812dd83, ctime: 0x6812dd83, blocks: 0x800 00002000:00010000:3.0:1746066818.579359:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd83, atime: 0x6812dd81, ctime: 0x6812dd83, blocks: 0x808 00010000:00010000:1.0:1746066818.579365:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.579367:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.579370:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.579371:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.579377:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.579377:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.579390:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.579390:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.579399:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eb600, rc 0) 00010000:00010000:1.0:1746066818.579399:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c000, rc 0) 00000100:00100000:1.0:1746066818.579437:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985580928:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 155us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.579437:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20744 00000100:00100000:1.0:1746066818.579443:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20742 00000100:00100000:1.0:1746066818.579455:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20745 00000100:00100000:1.0:1746066818.579459:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985581312:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066818.579465:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.579472:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f08 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066818.579481:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd83, atime: 0x6812dd83, ctime: 0x6812dd83, blocks: 0x800 00010000:00010000:1.0:1746066818.579488:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.579489:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.579492:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.579500:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066818.579501:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985581184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066818.579507:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c400, rc 0) 00010000:00010000:0.0:1746066818.579520:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.579536:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f01 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066818.579560:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd7f, atime: 0x6812dd7f, ctime: 0x6812dd7f, blocks: 0x800 00010000:00010000:0.0:1746066818.579576:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.579578:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.579585:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.579599:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066818.579635:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985581056:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 325us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.579641:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20743 00010000:00010000:0.0:1746066818.579655:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541200, rc 0) 00000100:00100000:0.0:1746066818.579687:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985581184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 242us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.579693:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20744 00000100:00100000:1.0:1746066818.579719:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985581312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 257us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.579724:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20745 00000100:00100000:0.0:1746066818.579731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.579751:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581440 00000100:00100000:1.0:1746066818.579753:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581440 00000100:00100000:1.0:1746066818.579769:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20746 00000100:00100000:1.0:1746066818.579774:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985581440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066818.579779:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.579785:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f0f expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066818.579794:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 4860352, mtime: 0x6812dd83, atime: 0x6812dd82, ctime: 0x6812dd83, blocks: 0x1518 00010000:00010000:1.0:1746066818.579800:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.579801:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.579804:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.579813:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.579818:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226da00, rc 0) 00000100:00100000:1.0:1746066818.579831:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985581440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 59us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.579834:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20746 00000100:00100000:0.0:1746066818.580038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.580078:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581568 00000100:00100000:2.0:1746066818.580083:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581568 00000100:00100000:2.0:1746066818.580108:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20747 00000100:00100000:2.0:1746066818.580113:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985581568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066818.580121:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.580131:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f16 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066818.580142:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd83, atime: 0x6812dd83, ctime: 0x6812dd83, blocks: 0x1000 00010000:00010000:2.0:1746066818.580151:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.580152:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.580156:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.580165:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.580172:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941a0c00, rc 0) 00000100:00100000:2.0:1746066818.580203:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985581568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.580208:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20747 00000100:00100000:0.0:1746066818.583668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.583700:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.583721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.583737:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.583756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.583765:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581696 00000100:00100000:2.0:1746066818.583775:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581696 00000100:00100000:0.0:1746066818.583781:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.583809:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581952 00000100:00100000:2.0:1746066818.583812:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582208 00000100:00100000:2.0:1746066818.583815:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582208 00000100:00100000:3.0:1746066818.583817:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581952 00000100:00100000:2.0:1746066818.583827:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985581824 00000100:00100000:2.0:1746066818.583829:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985581824 00000100:00100000:1.0:1746066818.583836:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582080 00000100:00100000:2.0:1746066818.583840:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582336 00000100:00100000:1.0:1746066818.583840:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582080 00000100:00100000:2.0:1746066818.583842:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582336 00000100:00100000:3.0:1746066818.583856:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20748 00000100:00100000:3.0:1746066818.583862:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985581696:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066818.583866:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20749 00000100:00100000:2.0:1746066818.583871:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985582208:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066818.583872:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20750 00000100:00100000:1.0:1746066818.583878:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985581824:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066818.583971:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985582208:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.583978:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20749 00000100:00100000:3.0:1746066818.583980:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985581696:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.583987:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20751 00000100:00100000:3.0:1746066818.583992:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20748 00000100:00100000:0.0:1746066818.583994:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985581952:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066818.583996:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20752 00000100:00100000:2.0:1746066818.583999:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985582336:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066818.584010:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20753 00000100:00100000:3.0:1746066818.584015:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985582080:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066818.584024:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985582336:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.584028:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20752 00000100:00100000:0.0:1746066818.584029:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985581952:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.584034:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20751 00000100:00100000:3.0:1746066818.584049:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985582080:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.584054:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20753 00000100:00100000:1.0:1746066818.584098:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985581824:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 220us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.584105:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20750 00000100:00100000:0.0:1746066818.586729:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.586766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.586792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.586812:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582592 00000100:00100000:0.0:1746066818.586821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.586823:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582848 00000100:00100000:1.0:1746066818.586823:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582592 00000100:00100000:2.0:1746066818.586826:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582848 00000100:00100000:0.0:1746066818.586834:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.586862:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985583104 00000100:00100000:1.0:1746066818.586864:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985583104 00000100:00100000:0.0:1746066818.586864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.586973:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582464 00000100:00100000:3.0:1746066818.586975:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582720 00000100:00100000:2.0:1746066818.586976:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582464 00000100:00100000:1.0:1746066818.586978:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985582976 00000100:00100000:3.0:1746066818.586979:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582720 00000100:00100000:1.0:1746066818.586980:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985582976 00000100:00100000:0.0:1746066818.586987:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20754 00000100:00100000:2.0:1746066818.586993:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20755 00000100:00100000:0.0:1746066818.586994:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985582592:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066818.586999:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985582848:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066818.586999:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20756 00000100:00100000:1.0:1746066818.587002:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985583104:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066818.587006:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20757 00000100:00100000:3.0:1746066818.587011:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985582464:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066818.587065:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985582464:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.587065:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985582592:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.587066:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985582848:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.587066:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985583104:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.587071:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20754 00000100:00100000:3.0:1746066818.587073:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20757 00000100:00100000:2.0:1746066818.587076:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20755 00000100:00100000:1.0:1746066818.587079:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20756 00000100:00100000:3.0:1746066818.587083:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20758 00000100:00100000:0.0:1746066818.587086:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20759 00000100:00100000:3.0:1746066818.587087:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985582976:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066818.587090:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985582720:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066818.587115:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985582976:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.587115:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985582720:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.587119:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20759 00000100:00100000:3.0:1746066818.587122:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20758 00000100:00100000:0.0:1746066818.591194:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.591270:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985583360 00000100:00100000:2.0:1746066818.591282:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985583360 00000100:00100000:2.0:1746066818.591349:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17323 00000100:00100000:2.0:1746066818.591357:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:3597:x1830882985583360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.591375:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.591390:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb22ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f1d expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.591449:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591465:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591473:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591485:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591490:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591495:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591577:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591584:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591589:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.591596:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066818.591648:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591653:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591658:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591663:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066818.591667:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591672:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591680:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.591683:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066818.591686:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.591690:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb2304 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066818.591975:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066818.592383:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592389:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592393:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592398:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592401:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066818.592403:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592408:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592415:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066818.592416:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066818.592419:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592422:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfb22f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592436:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592440:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592445:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592449:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066818.592451:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592454:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592460:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9f00) 00010000:00010000:2.0:1746066818.592461:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066818.592463:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592467:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfb22fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.592501:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb22ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f1d expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.592508:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2a00/0xf1867c21abfb22ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f1d expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.592515:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2a00, rc 0) 00000100:00100000:2.0:1746066818.592564:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3597:x1830882985583360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1207us (1378us total) trans 8589937819 rc 301/301 00000100:00100000:2.0:1746066818.592603:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17323 00000100:00100000:3.0:1746066818.592693:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985583616 00000100:00100000:3.0:1746066818.592704:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985583616 00000100:00100000:0.0:1746066818.592750:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.592871:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985583872 00000100:00100000:2.0:1746066818.592875:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985583872 00000100:00100000:2.0:1746066818.592922:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7855 00000100:00100000:2.0:1746066818.592929:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985583616:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:3.0:1746066818.592935:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7856 00000100:00100000:3.0:1746066818.592943:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985583872:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066818.592950:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.592961:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.592963:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.592967:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.592972:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.592977:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.592983:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.592985:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.592989:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.592998:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.594718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.594769:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985584128 00000100:00100000:2.0:1746066818.594775:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985584128 00000100:00100000:2.0:1746066818.594816:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7857 00000100:00100000:2.0:1746066818.594822:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985584128:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066818.594845:0:20360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.594857:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.594859:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.594862:0:20360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.594872:0:20360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.596448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.596505:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.596579:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985584384 00000100:00100000:2.0:1746066818.596585:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985584384 00000100:00100000:2.0:1746066818.596625:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7858 00000100:00100000:2.0:1746066818.596631:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985584384:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066818.596656:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.596667:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.596669:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.596672:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.596681:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.597310:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985584640 00000100:00100000:3.0:1746066818.597320:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985584640 00000100:00100000:3.0:1746066818.597378:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6542 00000100:00100000:3.0:1746066818.597385:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:3597:x1830882985584640:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066818.597609:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:3597:x1830882985584640:12345-192.168.204.16@tcp:35:cat.0 Request processed in 222us (1163us total) trans 8589937820 rc 0/0 00000100:00100000:3.0:1746066818.597615:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6542 00000100:00100000:1.0:1746066818.599623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.599643:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985584896 00000100:00100000:1.0:1746066818.599649:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985584896 00000100:00100000:1.0:1746066818.599705:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7859 00000100:00100000:1.0:1746066818.599712:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985584896:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066818.599741:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.599753:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.599755:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.599759:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.599769:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.600007:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.600162:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985585152 00000100:00100000:3.0:1746066818.600171:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985585152 00000100:00100000:3.0:1746066818.600224:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7860 00000100:00100000:3.0:1746066818.600231:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985585152:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066818.600260:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.600271:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.600273:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.600277:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.600287:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.600404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.600430:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.601032:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985585408 00000100:00100000:3.0:1746066818.601036:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985585408 00000100:00100000:3.0:1746066818.601073:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985585664 00000100:00100000:3.0:1746066818.601076:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985585664 00000100:00100000:3.0:1746066818.601102:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7861 00000100:00100000:3.0:1746066818.601108:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985585408:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:1.0:1746066818.601111:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7862 00000100:00100000:1.0:1746066818.601119:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985585664:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066818.601125:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.601134:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.601135:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.601138:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.601139:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.601146:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.601148:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.601150:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.601153:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.601167:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.604212:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.604276:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985585792 00000100:00100000:2.0:1746066818.604287:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985585792 00000100:00100000:2.0:1746066818.604347:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17324 00000100:00100000:2.0:1746066818.604355:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3597:x1830882985585792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.604371:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.604384:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5600/0xf1867c21abfb234a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f24 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.604461:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.604473:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.604483:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.604503:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:2.0:1746066818.604506:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1746066818.604514:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1746066818.604516:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.604527:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.604534:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5600/0xf1867c21abfb234a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.604535:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.604542:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.604546:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.604547:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.604553:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.604556:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.604556:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066818.604558:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5c00, rc 0) 00010000:00010000:3.0:1746066818.604574:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.604580:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2312 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.604596:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3597:x1830882985585792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 241us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.604601:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17324 00000100:00100000:3.0:1746066818.604655:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985583616:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11725us (12678us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.604664:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7855 00010000:00010000:3.0:1746066818.607528:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607546:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607555:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607562:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943eb200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.607567:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607574:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607597:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.607604:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eb200/0xf1867c21abfb2319 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.607765:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985583872:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14818us (15010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.607776:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7856 00000100:00100000:0.0:1746066818.609010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.609084:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586048 00000100:00100000:2.0:1746066818.609096:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586048 00000100:00100000:2.0:1746066818.609620:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17325 00000100:00100000:2.0:1746066818.609629:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3599:x1830882985586048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.609649:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.609665:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f2b expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.609728:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609738:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609747:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609758:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609763:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609768:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609851:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609861:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.609867:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.609912:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.609928:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 8 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.609937:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.610294:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746066818.611972:0:20360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.611990:0:20360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.611999:0:20360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.612006:0:20360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ba000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.612016:0:20360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.612024:0:20360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.612044:0:20360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.612055:0:20360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb2320 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.612381:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985584128:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 17553us (17660us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.612393:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7857 00010000:00010000:2.0:1746066818.614726:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614741:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614748:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614755:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe5400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.614760:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614767:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614786:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.614792:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfb2327 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.614903:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172480:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.614935:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066818.615161:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985584384:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18527us (18663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.615171:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7858 00000100:00100000:0.0:1746066818.617187:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.617289:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586176 00000100:00100000:3.0:1746066818.617298:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586176 00010000:00010000:3.0:1746066818.617369:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 9 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.617410:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9552 00000100:00100000:3.0:1746066818.617419:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985586176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.617431:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.617436:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 9 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.617446:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 9 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.617463:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb2271 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ede expref: 9 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.617493:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.617498:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.617506:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.617512:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.617850:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.617940:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985586176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 521us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.617947:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9552 00010000:00010000:0.0:1746066818.618116:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618123:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066818.618137:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:0.0:1746066818.618227:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618234:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618238:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618243:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2dc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.618246:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618251:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618259:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.618261:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066818.618263:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618267:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb236d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618285:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618290:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618295:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618299:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618303:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2da00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.618305:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618309:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618315:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066818.618317:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.618319:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.618323:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfb235f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619234:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619242:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619247:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619250:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2d800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.619253:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619258:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619266:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9e00) 00010000:00010000:0.0:1746066818.619268:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.619271:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.619276:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d800/0xf1867c21abfb2366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.619377:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2358 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f2b expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.619385:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f2b expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.619402:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:1.0:1746066818.619443:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3599:x1830882985586048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9814us (10437us total) trans 8589937821 rc 301/301 00000100:00100000:1.0:1746066818.619450:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17325 00010000:00010000:2.0:1746066818.619560:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619569:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619575:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619580:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b226d200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066818.619582:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619587:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619598:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.619603:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfb232e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.619635:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985584896:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19923us (20018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.619645:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7859 00010000:00010000:3.0:1746066818.619729:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619740:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619746:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619751:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943eac00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.619756:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619762:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619772:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.619777:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eac00/0xf1867c21abfb2335 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.619820:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985585152:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19589us (19813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.619827:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7860 00010000:00010000:1.0:1746066818.625167:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625190:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625197:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625203:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b226de00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066818.625206:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625213:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625232:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.625237:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfb2343 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.625304:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985585664:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24182us (24869us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.625313:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7862 00010000:00010000:3.0:1746066818.627924:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627942:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627951:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627957:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943eb000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066818.627961:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627969:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627987:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.627998:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eb000/0xf1867c21abfb233c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.628065:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985585408:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26951us (27656us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.628075:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7861 00000100:00100000:0.0:1746066818.628743:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.629095:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586304 00000100:00100000:3.0:1746066818.629186:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586304 00000100:00100000:3.0:1746066818.629369:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20760 00000100:00100000:3.0:1746066818.629378:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985586304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.629395:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.629409:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f32 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.629428:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.629430:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.629438:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 45 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.629451:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 45 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.629461:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eaa00, rc 0) 00000100:00100000:3.0:1746066818.629491:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985586304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 115us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.629497:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20760 00000100:00100000:0.0:1746066818.629564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.629593:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.629611:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586432 00000100:00100000:1.0:1746066818.629618:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586432 00000100:00100000:1.0:1746066818.629662:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586688 00000100:00100000:1.0:1746066818.629665:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586688 00000100:00100000:1.0:1746066818.629693:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20761 00000100:00100000:1.0:1746066818.629701:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882985586432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.629716:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.629731:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f39 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.629750:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.629751:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.629758:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066818.629761:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20762 00000100:00100000:3.0:1746066818.629768:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985586688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.629771:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.629776:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.629782:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f47 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.629785:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67200, rc 0) 00010000:00010000:3.0:1746066818.629792:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.629793:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.629796:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 46 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.629802:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 46 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.629807:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943ea200, rc 0) 00000100:00100000:3.0:1746066818.629832:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882985586688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.629835:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20762 00000100:00100000:1.0:1746066818.630119:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985586432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.630127:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20761 00000100:00100000:0.0:1746066818.630790:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.630816:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.630916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.630972:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586944 00000100:00100000:1.0:1746066818.630976:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586944 00000100:00100000:3.0:1746066818.630990:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586560 00000100:00100000:3.0:1746066818.630993:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586560 00000100:00100000:1.0:1746066818.630994:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985586816 00000100:00100000:1.0:1746066818.630996:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985586816 00000100:00100000:3.0:1746066818.631009:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20763 00000100:00100000:1.0:1746066818.631013:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20764 00000100:00100000:3.0:1746066818.631014:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985586944:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066818.631017:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985586560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.631026:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.631036:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.631037:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f55 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.631041:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f40 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.631049:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.631049:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.631050:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.631051:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.631055:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.631055:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.631065:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.631065:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.631073:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eae00, rc 0) 00010000:00010000:1.0:1746066818.631073:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67400, rc 0) 00000100:00100000:1.0:1746066818.631096:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985586560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.631100:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20764 00000100:00100000:1.0:1746066818.631114:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20765 00000100:00100000:1.0:1746066818.631124:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882985586816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066818.631130:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066818.631137:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f4e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.631148:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.631149:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.631153:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.631162:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066818.631169:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66400, rc 0) 00000100:00100000:3.0:1746066818.631213:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985586944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 197us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.631218:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20763 00000100:00100000:1.0:1746066818.631280:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882985586816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.631285:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20765 00000100:00100000:0.0:1746066818.636134:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.636182:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985587200 00000100:00100000:1.0:1746066818.636194:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985587200 00000100:00100000:1.0:1746066818.636250:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17326 00000100:00100000:1.0:1746066818.636257:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3593:x1830882985587200:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066818.636296:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.636319:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59c00/0xf1867c21abfb22be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7eec expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.636346:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066818.636351:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066818.636391:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.636442:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.636448:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.636473:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.636483:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 30 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.636495:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066818.636702:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.640951:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.640983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.640999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.641023:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.641024:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985587584 00000100:00100000:1.0:1746066818.641031:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985587712 00000100:00100000:3.0:1746066818.641037:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985587584 00000100:00100000:2.0:1746066818.641037:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588096 00000100:00100000:1.0:1746066818.641037:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985587712 00000100:00100000:2.0:1746066818.641041:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588096 00000100:00100000:0.0:1746066818.641056:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066818.641075:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800958ace00 x1830882985587584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.641075:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958afb80 x1830882985588096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.641075:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958ad880 x1830882985587712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.641083:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ace00 with x1830882985587584 ext(0->1048575) 00002000:00100000:2.0:1746066818.641083:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882985588096 ext(1048576->2097151) 00002000:00100000:1.0:1746066818.641083:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882985587712 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.641087:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ace00 00002000:00010000:2.0:1746066818.641087:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958afb80 00002000:00010000:1.0:1746066818.641087:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ad880 00000100:00100000:2.0:1746066818.641102:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985587968 00000100:00100000:2.0:1746066818.641104:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985587968 00000100:00100000:3.0:1746066818.641112:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7863 00002000:00100000:2.0:1746066818.641112:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958af480 x1830882985587968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066818.641117:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7864 00000100:00100000:3.0:1746066818.641118:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985588096:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066818.641119:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af480 with x1830882985587968 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.641121:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958af480 00000100:00100000:1.0:1746066818.641122:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985587584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066818.641130:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7865 00000100:00100000:2.0:1746066818.641134:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985587712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.641767:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7866 00000100:00100000:3.0:1746066818.641773:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985587968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.642065:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.642085:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066818.642713:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588352 00000100:00100000:3.0:1746066818.642718:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588352 00010000:00010000:3.0:1746066818.642737:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 31 pid: 10125 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.642767:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9553 00000100:00100000:3.0:1746066818.642773:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985588352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.642782:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.642787:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 31 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.642797:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 31 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.642814:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfb2351 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f24 expref: 31 pid: 10125 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.642825:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.642829:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.642836:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.642842:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.642863:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.642913:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985588352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.642919:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9553 00010000:00010000:1.0:1746066818.642928:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.642935:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00010000:1.0:1746066818.643036:0:10125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800958aea00 reply state ffff880135d44000 transno 8589937822 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.643045:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066818.643054:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066818.643057:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746066818.643059:0:10125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066818.643104:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3593:x1830882985587200:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 6848us (6981us total) trans 8589937822 rc 0/0 00000100:00100000:1.0:1746066818.643110:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17326 00000100:00100000:0.0:1746066818.651202:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.651229:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.651259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.651272:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.651292:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588480 00000100:00100000:0.0:1746066818.651300:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588480 00000100:00100000:0.0:1746066818.651342:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588608 00000100:00100000:0.0:1746066818.651345:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588608 00000100:00100000:0.0:1746066818.651358:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588736 00000100:00100000:0.0:1746066818.651360:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588736 00000100:00100000:2.0:1746066818.651366:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588864 00000100:00100000:2.0:1746066818.651370:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588864 00000100:00100000:0.0:1746066818.651373:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20766 00000100:00100000:0.0:1746066818.651380:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985588480:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746066818.651390:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20767 00000100:00100000:2.0:1746066818.651395:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985588608:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066818.651481:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066818.651482:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066818.651484:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:0.0:1746066818.651485:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:0.0:1746066818.651486:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.651487:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066817 -> 1746066819 00002000:00010000:2.0:1746066818.651489:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:0.0:1746066818.651489:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.651490:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746066818.651490:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066818.651524:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985588608:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 128us (294us total) trans 21474842789 rc 0/0 00000100:00100000:2.0:1746066818.651529:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20767 00000100:00100000:2.0:1746066818.651542:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20768 00000100:00100000:2.0:1746066818.651546:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985588736:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066818.651576:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066818.651579:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066815 -> 1746066819 00002000:00010000:2.0:1746066818.651580:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066815 -> 1746066819 00002000:00010000:2.0:1746066818.651582:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066815 -> 1746066819 00002000:00010000:2.0:1746066818.651584:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066818.652405:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985588736:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 856us (1142us total) trans 21474842790 rc 0/0 00000100:00100000:2.0:1746066818.652411:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20768 00000100:00100000:2.0:1746066818.652426:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20769 00000100:00100000:0.0:1746066818.652427:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985588480:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 1047us (1233us total) trans 17179875449 rc 0/0 00000100:00100000:2.0:1746066818.652431:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985588864:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066818.652432:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20766 00000100:00100000:0.0:1746066818.652466:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746066818.652475:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066818.652477:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.652479:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.652480:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00000100:00100000:0.0:1746066818.652481:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985588992 00002000:00010000:2.0:1746066818.652482:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066818.652483:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985588992 00000100:00100000:2.0:1746066818.652498:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985588864:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 67us (1225us total) trans 17179875450 rc 0/0 00000100:00100000:0.0:1746066818.652498:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20770 00000100:00100000:0.0:1746066818.652501:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985588992:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746066818.652502:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20769 00000100:00100000:2.0:1746066818.652540:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066818.652542:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:0.0:1746066818.652544:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:0.0:1746066818.652546:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066818 -> 1746066819 00000100:00100000:3.0:1746066818.652547:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985588096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11428us (11545us total) trans 0 rc 1048576/1048576 00002000:00010000:0.0:1746066818.652547:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:0.0:1746066818.652549:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:2.0:1746066818.652553:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985589120 00000100:00100000:3.0:1746066818.652555:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7863 00000100:00100000:2.0:1746066818.652555:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985589120 00000100:00100000:0.0:1746066818.652562:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985588992:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 60us (96us total) trans 17179875451 rc 0/0 00002000:00100000:3.0:1746066818.652563:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958afb80 x1830882985588096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066818.652570:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20770 00002000:00100000:3.0:1746066818.652572:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882985588096 ext(1048576->2097151) 00000100:00100000:2.0:1746066818.652575:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20771 00002000:00010000:3.0:1746066818.652576:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958afb80 00000100:00100000:2.0:1746066818.652578:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985589120:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066818.652615:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066818.652617:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.652619:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.652620:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:2.0:1746066818.652622:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066818.652637:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985589120:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 58us (96us total) trans 21474842791 rc 0/0 00000100:00100000:2.0:1746066818.652643:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20771 00010000:00010000:0.0:1746066818.666094:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066818.666466:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985587712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25323us (25474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.666476:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7865 00002000:00100000:2.0:1746066818.666487:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958ad880 x1830882985587712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.666496:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882985587712 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.666501:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ad880 00000100:00100000:0.0:1746066818.666626:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.666709:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882985587584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25586us (25770us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066818.666714:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7864 00002000:00100000:0.0:1746066818.666720:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800958ace00 x1830882985587584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066818.666726:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ace00 with x1830882985587584 ext(0->1048575) 00002000:00010000:0.0:1746066818.666729:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ace00 00000100:00100000:0.0:1746066818.666748:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985589376 00000100:00100000:0.0:1746066818.666754:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985589376 00000100:00100000:0.0:1746066818.666785:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17327 00000100:00100000:0.0:1746066818.666790:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3601:x1830882985589376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066818.666806:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.666819:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfb23ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f5c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.666878:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.666907:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.666915:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.666925:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.666931:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.666935:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.667013:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.667020:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.667025:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066818.667033:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:2.0:1746066818.667658:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066818.668668:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668678:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668685:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668691:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ce1400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.668694:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668701:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668712:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.668715:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066818.668718:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668722:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1400/0xf1867c21abfb23c1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668752:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668757:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668761:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668765:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668769:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ce0a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.668771:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668775:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668781:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066818.668783:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.668785:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668789:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0a00/0xf1867c21abfb23b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668796:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668801:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668805:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668809:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ce0e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.668811:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668815:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668820:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ead00) 00010000:00010000:0.0:1746066818.668822:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.668824:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.668828:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0e00/0xf1867c21abfb23ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066818.668837:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985587968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27062us (27812us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.668846:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7866 00002000:00100000:2.0:1746066818.668853:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958af480 x1830882985587968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.668862:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af480 with x1830882985587968 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.668866:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958af480 00010000:00010000:0.0:1746066818.668867:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfb23ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f5c expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.668874:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985589632 00010000:00010000:0.0:1746066818.668874:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfb23ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f5c expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.668896:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985589632 00010000:00010000:0.0:1746066818.668897:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0400, rc 0) 00000100:00100000:0.0:1746066818.668916:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3601:x1830882985589376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2125us (2289us total) trans 8589937823 rc 301/301 00000100:00100000:0.0:1746066818.668925:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17327 00000100:00100000:1.0:1746066818.669184:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6543 00000100:00100000:1.0:1746066818.669191:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3593:x1830882985589632:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066818.670709:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3593:x1830882985589632:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 1515us (3049us total) trans 8589937824 rc 0/0 00000100:00100000:1.0:1746066818.670716:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6543 00000100:00100000:0.0:1746066818.673523:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.673700:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985589888 00000100:00100000:1.0:1746066818.673709:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985589888 00000100:00100000:1.0:1746066818.673755:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6544 00000100:00100000:1.0:1746066818.673764:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3593:x1830882985589888:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066818.674644:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.674779:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985590016 00000100:00100000:2.0:1746066818.674790:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985590016 00000100:00100000:2.0:1746066818.674848:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17328 00000100:00100000:2.0:1746066818.674856:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3597:x1830882985590016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.674875:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.674910:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb23cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f63 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.674955:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb23cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f63 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.674965:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb23cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f63 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.674978:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.674982:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066818.674985:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d400, rc 0) 00000100:00100000:1.0:1746066818.674997:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+11:3593:x1830882985589888:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 1233us (1481us total) trans 8589937825 rc 0/0 00000100:00100000:1.0:1746066818.675005:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6544 00000100:00100000:2.0:1746066818.675032:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3597:x1830882985590016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 177us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.675038:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17328 00000100:00100000:0.0:1746066818.690987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.691121:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985590272 00000100:00100000:2.0:1746066818.691129:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985590272 00000100:00100000:2.0:1746066818.691185:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17329 00000100:00100000:2.0:1746066818.691193:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3599:x1830882985590272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.691214:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.691218:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066818.691247:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb23cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f63 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.691267:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.691272:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066818.691283:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb23d6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f6a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.691341:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.691353:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.691360:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.691393:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.691404:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 10 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746066818.691416:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.692113:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.693591:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985172736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.693612:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066818.694380:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.694571:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985590400 00000100:00100000:3.0:1746066818.694578:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985590400 00010000:00010000:3.0:1746066818.694611:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 11 pid: 7244 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746066818.694753:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.694794:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.694840:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985590656 00000100:00100000:0.0:1746066818.694843:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985590656 00002000:00100000:0.0:1746066818.694877:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8801310f0700 x1830882985590656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066818.694931:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9554 00000100:00100000:3.0:1746066818.694938:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985590400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.694980:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.694987:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 11 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.694997:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 11 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.695018:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfb22b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ee5 expref: 11 pid: 7244 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.695043:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.695048:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.695057:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.695063:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00002000:00100000:0.0:1746066818.695085:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0700 with x1830882985590656 ext(2097152->4194303) 00000100:00100000:2.0:1746066818.695117:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985590912 00000100:00100000:2.0:1746066818.695120:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985590912 00002000:00100000:2.0:1746066818.695139:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8801310f2d80 x1830882985590912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.695146:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2d80 with x1830882985590912 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.695149:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2d80 00000100:00100000:2.0:1746066818.695164:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7867 00000100:00100000:2.0:1746066818.695169:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985590912:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746066818.695508:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.695562:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985590400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 624us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.695570:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9554 00010000:00010000:3.0:1746066818.695594:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.695599:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00002000:00010000:0.0:1746066818.695666:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0700 00000100:00100000:0.0:1746066818.695694:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7868 00000100:00100000:0.0:1746066818.695702:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882985590656:12345-192.168.204.16@tcp:3:multiop.0 00000040:00080000:3.0:1746066818.696227:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1257, 88 off118208 00000004:00080000:3.0:1746066818.696234:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907349937ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696278:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1260, 88 off118384 00000004:00080000:3.0:1746066818.696281:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907398022ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696294:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1261, 88 off118472 00000004:00080000:3.0:1746066818.696296:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907412778ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696304:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1258, 88 off118296 00000004:00080000:3.0:1746066818.696306:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907422990ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696313:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1259, 88 off118384 00000004:00080000:3.0:1746066818.696315:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907431930ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696322:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1262, 88 off118560 00000004:00080000:3.0:1746066818.696325:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907441407ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696347:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1263, 88 off118648 00000004:00080000:3.0:1746066818.696351:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907467607ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696358:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1264, 88 off118736 00000004:00080000:3.0:1746066818.696361:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907477487ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696368:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1260, 88 off118472 00000004:00080000:3.0:1746066818.696372:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907488370ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696475:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1265, 88 off118824 00000004:00080000:3.0:1746066818.696479:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907595890ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696490:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1261, 88 off118560 00000004:00080000:3.0:1746066818.696493:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907609705ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696500:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1266, 88 off118912 00000004:00080000:3.0:1746066818.696588:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786907704228ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066818.696600:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1262, 88 off118648 00000004:00080000:3.0:1746066818.696603:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907719587ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696814:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1263, 88 off118736 00000004:00080000:3.0:1746066818.696818:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907934737ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696859:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1264, 88 off118824 00000004:00080000:3.0:1746066818.696863:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907979597ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696873:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1265, 88 off118912 00000004:00080000:3.0:1746066818.696876:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 786907992407ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066818.696906:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1267, 88 off119000 00000004:00080000:3.0:1746066818.696909:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786908026000ns, next at 733263917711ns, rc = 0 00000001:00080000:2.0:1746066818.702962:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937826 is committed 00000004:00080000:2.0:1746066818.703366:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1241 committed 00000004:00080000:2.0:1746066818.703387:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1241 committed 00000004:00080000:2.0:1746066818.703402:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1240 committed 00000004:00080000:2.0:1746066818.703404:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1239 committed 00000004:00080000:2.0:1746066818.703405:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1238 committed 00000004:00080000:2.0:1746066818.703407:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1240 committed 00000004:00080000:2.0:1746066818.703409:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1237 committed 00000004:00080000:2.0:1746066818.703410:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1239 committed 00000004:00080000:2.0:1746066818.703412:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1236 committed 00000004:00080000:2.0:1746066818.703413:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1238 committed 00000004:00080000:2.0:1746066818.703415:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1237 committed 00000004:00080000:2.0:1746066818.703418:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1236 committed 00000004:00080000:2.0:1746066818.703419:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1235 committed 00000004:00080000:2.0:1746066818.703424:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1234 committed 00000004:00080000:2.0:1746066818.703426:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1235 committed 00000004:00080000:2.0:1746066818.703428:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1234 committed 00000004:00080000:2.0:1746066818.703430:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1233 committed 00000001:00080000:2.0:1746066818.703450:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937825 is committed 00000001:00080000:2.0:1746066818.703457:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937823 is committed 00000100:00100000:1.0:1746066818.703635:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.703707:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.703737:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985173504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.703750:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.703768:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066818.703772:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.703785:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.703795:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985173376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.703806:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.703827:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985172992 00000100:00100000:1.0:1746066818.703834:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985172992 00000100:00100000:1.0:1746066818.703872:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173504 00000100:00100000:1.0:1746066818.703874:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173504 00000100:00100000:1.0:1746066818.703903:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985172864 00000100:00100000:1.0:1746066818.703905:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985172864 00000100:00100000:1.0:1746066818.703914:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173376 00000100:00100000:1.0:1746066818.703915:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173376 00000100:00100000:1.0:1746066818.703928:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20772 00000100:00100000:1.0:1746066818.703935:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985172992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.703987:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20773 00000100:00100000:0.0:1746066818.703994:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985173504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.704049:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985173888:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066818.704076:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746066818.704078:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066818.704079:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704081:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704083:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704085:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066818.704093:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.704112:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985172992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (409us total) trans 21474842792 rc 0/0 00000100:00100000:0.0:1746066818.704112:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.704118:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20772 00000100:00100000:0.0:1746066818.704126:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066818.704131:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.704143:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173888 00000100:00100000:1.0:1746066818.704145:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173888 00000100:00100000:0.0:1746066818.704146:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.704158:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174400 00000100:00100000:0.0:1746066818.704158:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.704159:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174400 00000100:00100000:1.0:1746066818.704170:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174016 00000100:00100000:1.0:1746066818.704172:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174016 00000100:00100000:0.0:1746066818.704173:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.704177:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174528 00000100:00100000:1.0:1746066818.704179:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174528 00000100:00100000:1.0:1746066818.704186:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20774 00000100:00100000:2.0:1746066818.704187:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.704190:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985172864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.704194:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20775 00000100:00100000:0.0:1746066818.704200:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985173376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.704211:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.704224:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173632:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066818.704230:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066818.704232:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704234:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704236:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00000100:00100000:2.0:1746066818.704238:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066818.704238:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066818.704244:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.704253:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985172864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (467us total) trans 21474842794 rc 0/0 00000100:00100000:1.0:1746066818.704258:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20774 00000100:00100000:2.0:1746066818.704259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066818.704264:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985173376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (456us total) trans 21474842795 rc 0/0 00000100:00100000:2.0:1746066818.704266:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.704266:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173120 00000100:00100000:1.0:1746066818.704268:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173120 00000100:00100000:0.0:1746066818.704269:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20775 00000100:00100000:1.0:1746066818.704274:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173632 00000100:00100000:1.0:1746066818.704276:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173632 00000100:00100000:2.0:1746066818.704278:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066818.704279:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174144 00000100:00100000:1.0:1746066818.704281:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174656 00000100:00100000:0.0:1746066818.704281:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174144 00000100:00100000:1.0:1746066818.704283:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174656 00000100:00100000:2.0:1746066818.704285:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746066818.704289:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.704290:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20776 00000100:00100000:1.0:1746066818.704294:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3774:x1830882985173888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.704306:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.704314:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.704339:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066818.704348:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174272:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066818.704359:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066818.704361:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00000100:00100000:2.0:1746066818.704362:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066818.704363:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704364:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.704366:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066818.704368:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066818.704378:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.704383:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985173888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (306us total) trans 17179875452 rc 0/0 00000100:00100000:2.0:1746066818.704394:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173248 00000100:00100000:2.0:1746066818.704397:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173248 00010000:00010000:3.0:1746066818.704574:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704586:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704595:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704602:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f67a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066818.704606:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704617:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704635:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.704637:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066818.704642:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.704647:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67a00/0xf1867c21abfb23a5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066818.704677:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985173760 00000100:00100000:3.0:1746066818.704696:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985173760 00000100:00100000:1.0:1746066818.705133:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20776 00000100:00100000:0.0:1746066818.705137:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174272 00000100:00100000:0.0:1746066818.705142:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174272 00000100:00100000:0.0:1746066818.705158:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174784 00000100:00100000:1.0:1746066818.705177:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20777 00000100:00100000:1.0:1746066818.705182:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985174400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.705197:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20778 00000100:00100000:3.0:1746066818.705206:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882985174016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066818.705235:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:1.0:1746066818.705237:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066818.705239:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066818.705240:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066818.705242:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066818.705265:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985174400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1153us total) trans 17179875453 rc 0/0 00000100:00100000:1.0:1746066818.705270:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20777 00000100:00100000:1.0:1746066818.705279:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20779 00000100:00100000:1.0:1746066818.705284:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882985174528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066818.705285:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066818.705288:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705291:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705293:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705295:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066818.705337:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985174016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (1178us total) trans 17179875454 rc 0/0 00000100:00100000:3.0:1746066818.705343:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20778 00000100:00100000:1.0:1746066818.705349:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985174528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1174us total) trans 17179875455 rc 0/0 00000100:00100000:3.0:1746066818.705353:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20780 00000100:00100000:3.0:1746066818.705362:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985173120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066818.705413:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066818.705415:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705417:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705423:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:3.0:1746066818.705425:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066818.705454:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985173120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1238us total) trans 21474842796 rc 0/0 00000100:00100000:1.0:1746066818.705595:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20779 00000100:00100000:1.0:1746066818.705606:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20781 00000100:00100000:1.0:1746066818.705612:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985173632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066818.705667:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985173632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1428us total) trans 21474842797 rc 0/0 00000100:00100000:1.0:1746066818.705672:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20781 00000100:00100000:1.0:1746066818.705681:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20782 00000100:00100000:1.0:1746066818.705684:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985174656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.705734:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985174656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (1455us total) trans 17179875456 rc 0/0 00000100:00100000:1.0:1746066818.705738:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20782 00000100:00100000:1.0:1746066818.705746:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20783 00000100:00100000:1.0:1746066818.705751:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985174144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066818.705785:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:1.0:1746066818.705787:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.705788:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.705790:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066818.705792:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00000100:00100000:1.0:1746066818.705810:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985174144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1550us total) trans 17179875457 rc 0/0 00000100:00100000:1.0:1746066818.705814:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20783 00000100:00100000:1.0:1746066818.705823:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20784 00000100:00100000:1.0:1746066818.705827:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985174272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066818.705874:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985174272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1511us total) trans 17179875458 rc 0/0 00000100:00100000:1.0:1746066818.705879:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20784 00000100:00100000:0.0:1746066818.705913:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174784 00000100:00100000:2.0:1746066818.705917:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20785 00000100:00100000:2.0:1746066818.705924:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985173248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.705931:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20786 00000100:00100000:0.0:1746066818.705936:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985173760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066818.705988:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3776:x1830882985173248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1686us total) trans 21474842798 rc 0/0 00000100:00100000:2.0:1746066818.705993:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20785 00000100:00100000:2.0:1746066818.706004:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20787 00000100:00100000:0.0:1746066818.706004:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985173760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1676us total) trans 21474842799 rc 0/0 00000100:00100000:2.0:1746066818.706008:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985174784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066818.706009:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20786 00002000:00010000:2.0:1746066818.706044:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:2.0:1746066818.706048:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066818.706049:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066818.706051:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:0.0:1746066818.706051:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882985173504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2058us (2299us total) trans 21474842793 rc 0/0 00002000:00010000:2.0:1746066818.706053:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066818.706056:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20773 00000100:00100000:2.0:1746066818.706072:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985174784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1692us total) trans 17179875459 rc 0/0 00000100:00100000:2.0:1746066818.706078:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20787 00000004:00080000:0.0:1746066818.706094:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3100/2, rc 0, transno 17179875454 00000100:00100000:0.0:1746066818.706105:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066818.706113:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e2d80/2, rc 0, transno 17179875455 00000100:00100000:0.0:1746066818.706116:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066818.706124:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1180/2, rc 0, transno 17179875452 00000100:00100000:0.0:1746066818.706127:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985173888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066818.706134:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e0000/2, rc 0, transno 17179875453 00000100:00100000:0.0:1746066818.706137:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066818.706187:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066818.706194:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a88e00/2, rc 0, transno 21474842794 00000100:00100000:1.0:1746066818.706198:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066818.706209:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89f80/2, rc 0, transno 21474842795 00000100:00100000:0.0:1746066818.706211:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066818.706212:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985173376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066818.706220:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8b100/2, rc 0, transno 21474842792 00000100:00100000:1.0:1746066818.706223:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985172992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066818.706229:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8a300/2, rc 0, transno 21474842793 00000100:00100000:1.0:1746066818.706231:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985173504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066818.706236:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985174912 00000100:00100000:0.0:1746066818.706239:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985174912 00000100:00100000:0.0:1746066818.706253:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20788 00000100:00100000:0.0:1746066818.706257:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985174912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066818.706339:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882985174912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (127us total) trans 17179875460 rc 0/0 00000100:00100000:0.0:1746066818.706344:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20788 00000004:00080000:1.0:1746066818.706445:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f54e00/2, rc 0, transno 17179875460 00000100:00100000:1.0:1746066818.706449:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985174912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066818.706516:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20780 00000004:00080000:2.0:1746066818.706564:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a88000/2, rc 0, transno 21474842798 00000100:00100000:2.0:1746066818.706567:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066818.706573:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677f480/2, rc 0, transno 21474842799 00010000:00010000:3.0:1746066818.706574:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.706576:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066818.706581:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e3b80/2, rc 0, transno 17179875458 00010000:00010000:3.0:1746066818.706584:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:2.0:1746066818.706584:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174272:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066818.706587:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1746066818.706588:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e3100/2, rc 0, transno 17179875459 00000100:00100000:2.0:1746066818.706590:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066818.706596:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8b800/2, rc 0, transno 21474842796 00000100:00100000:2.0:1746066818.706598:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173120:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066818.706599:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb23d6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 29 pid: 10125 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1746066818.706604:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c777480/2, rc 0, transno 21474842797 00000100:00100000:2.0:1746066818.706606:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985173632:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066818.706612:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746066818.706612:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e0a80/2, rc 0, transno 17179875457 00000100:00100000:2.0:1746066818.706614:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066818.706618:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930e1180/2, rc 0, transno 17179875456 00000100:00100000:2.0:1746066818.706621:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985174656:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066818.706635:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066818.706638:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066818.706646:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2dc00, rc 0) 00000100:00100000:3.0:1746066818.706679:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3599:x1830882985590272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 15488us (15704us total) trans 8589937826 rc 0/0 00000100:00100000:3.0:1746066818.706685:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17329 00000100:00100000:2.0:1746066818.709836:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985590912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14655us (15031us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066818.709848:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7867 00002000:00100000:2.0:1746066818.709859:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8801310f2d80 x1830882985590912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.709868:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2d80 with x1830882985590912 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.709875:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2d80 00000100:00100000:2.0:1746066818.718541:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882985590656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 22828us (23776us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066818.718554:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7868 00002000:00100000:2.0:1746066818.718567:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8801310f0700 x1830882985590656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.718576:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0700 with x1830882985590656 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.718582:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0700 00000100:00100000:0.0:1746066818.734670:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.734812:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985591040 00000100:00100000:2.0:1746066818.734822:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985591040 00000100:00100000:2.0:1746066818.734873:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20789 00000100:00100000:2.0:1746066818.734911:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:3599:x1830882985591040:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.734935:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.734956:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f71 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.734988:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.734996:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 48 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.735003:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.735005:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.735009:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 48 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.735042:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 48 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.735055:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 48 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.735068:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.736138:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.736148:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 12 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.736157:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175168:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.737084:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.737109:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175040:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.739383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.739421:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.739470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.739513:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985591424 00000100:00100000:0.0:1746066818.739520:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985591424 00002000:00100000:0.0:1746066818.739567:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f54000 x1830882985591424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066818.739577:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54000 with x1830882985591424 ext(2097152->4194303) 00002000:00010000:0.0:1746066818.739582:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f54000 00000100:00100000:0.0:1746066818.739597:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985591680 00000100:00100000:0.0:1746066818.739600:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985591680 00002000:00100000:0.0:1746066818.739613:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880098f55500 x1830882985591680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066818.739625:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882985591680 ext(3145728->4194303) 00002000:00010000:0.0:1746066818.739629:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f55500 00000100:00100000:0.0:1746066818.739642:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7869 00000100:00100000:0.0:1746066818.739649:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985591424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.741111:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7870 00000100:00100000:0.0:1746066818.741122:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985591680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.741470:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985591296 00000100:00100000:3.0:1746066818.741476:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985591296 00010000:00010000:3.0:1746066818.741501:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 51 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.741530:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9555 00000100:00100000:3.0:1746066818.741535:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985591296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066818.741546:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066818.741562:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 51 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.741573:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 51 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.741596:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb237b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f32 expref: 51 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746066818.741616:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066818.741656:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985591296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 120us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.741663:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9555 00000100:00100000:3.0:1746066818.741750:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.741780:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 49 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.741790:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:3.0:1746066818.741808:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:3599:x1830882985591040:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6929us (7152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.741814:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20789 00000100:00100000:0.0:1746066818.741958:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.742016:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985591808 00000100:00100000:0.0:1746066818.742019:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985591808 00010000:00010000:0.0:1746066818.742034:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 13 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746066818.742059:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9556 00000100:00100000:0.0:1746066818.742064:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985591808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066818.742073:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066818.742082:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 13 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.742091:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 13 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.742104:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfb22c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ef3 expref: 13 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746066818.742129:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.742131:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.742138:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 48 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.742147:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 48 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.742176:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 48 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.742189:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985175296:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066818.742242:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.749107:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.749140:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.749203:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f57800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985175296:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066818.749227:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.749298:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985591808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7232us (7339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.749311:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9556 00000100:00100000:0.0:1746066818.749527:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592192 00000100:00100000:0.0:1746066818.749534:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592192 00000100:00100000:0.0:1746066818.749594:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17330 00000100:00100000:0.0:1746066818.749601:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3601:x1830882985592192:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066818.749692:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592064 00000100:00100000:3.0:1746066818.749696:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592064 00002000:00100000:3.0:1746066818.749720:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->438271) req@ffff880098f57100 x1830882985592064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746066818.749938:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.749956:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f78 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066818.750050:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57100 with x1830882985592064 ext(434176->438271) 00002000:00010000:3.0:1746066818.750055:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f57100 00000100:00100000:3.0:1746066818.750078:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7871 00000100:00100000:3.0:1746066818.750083:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985592064:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066818.750152:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.750169:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.750185:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.750188:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066818.750190:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45200, rc 0) 00000100:00100000:0.0:1746066818.750236:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3601:x1830882985592192:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 636us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.750241:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17330 00000100:00100000:3.0:1746066818.750355:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985592064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 272us (1257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.750361:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7871 00002000:00100000:3.0:1746066818.750366:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->438271) req@ffff880098f57100 x1830882985592064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.750373:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57100 with x1830882985592064 ext(434176->438271) 00002000:00010000:3.0:1746066818.750375:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f57100 00000100:00100000:2.0:1746066818.752606:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985591424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12946us (13173us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066818.752616:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7869 00002000:00100000:2.0:1746066818.752627:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f54000 x1830882985591424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.752636:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54000 with x1830882985591424 ext(2097152->4194303) 00002000:00010000:2.0:1746066818.752641:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f54000 00000100:00100000:2.0:1746066818.753089:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882985591680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11970us (13619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.753095:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7870 00002000:00100000:2.0:1746066818.753101:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880098f55500 x1830882985591680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.753107:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882985591680 ext(3145728->4194303) 00002000:00010000:2.0:1746066818.753110:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f55500 00000100:00100000:0.0:1746066818.755751:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.755814:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592320 00000100:00100000:3.0:1746066818.755822:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592320 00000100:00100000:3.0:1746066818.755873:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20790 00000100:00100000:3.0:1746066818.755900:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3601:x1830882985592320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066818.755916:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.755930:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f7f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.755954:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.755966:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 46 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.755971:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.755973:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.755976:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3747840->4194303] (req 3747840->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.756000:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 46 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.756011:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 46 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.756021:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175424:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.756135:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.756144:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 11 pid: 13363 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.756152:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.756170:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.759514:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175424:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066818.761010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.761037:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.761064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.761103:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592448 00000100:00100000:2.0:1746066818.761119:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592448 00000100:00100000:1.0:1746066818.761119:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592704 00000100:00100000:1.0:1746066818.761125:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592704 00010000:00010000:2.0:1746066818.761163:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 12 pid: 13363 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.761170:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20791 00000100:00100000:1.0:1746066818.761178:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882985592704:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066818.761194:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592576 00010000:00010000:1.0:1746066818.761194:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066818.761197:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592576 00010000:00010000:2.0:1746066818.761205:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 48 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.761209:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575bc00/0xf1867c21abfb23f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f86 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.761223:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9557 00000100:00100000:2.0:1746066818.761229:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985592448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.761229:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.761238:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575bc00/0xf1867c21abfb23f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f86 expref: 49 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.761243:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.761248:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575bc00/0xf1867c21abfb23f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f86 expref: 49 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.761262:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 12 pid: 13363 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.761263:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575bc00, rc 0) 00010000:00010000:2.0:1746066818.761271:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 12 pid: 13363 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.761292:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.761300:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985592704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (236us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066818.761307:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20791 00000100:00100000:2.0:1746066818.761324:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985592448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.761338:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9557 00000100:00100000:2.0:1746066818.761352:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9558 00000100:00100000:2.0:1746066818.761356:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985592576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066818.761362:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066818.761367:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 48 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.761375:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 48 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.761385:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfb239e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f4e expref: 48 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746066818.761405:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.761406:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.761412:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.761420:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.761478:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.761487:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985175680:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.761539:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c03c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066818.761619:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226da00/0xf1867c21abfb22e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f0f expref: 11 pid: 13363 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.761633:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985175552:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.761652:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.761661:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecee00, rc 0) 00000100:00100000:3.0:1746066818.761683:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3601:x1830882985592320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5804us (5940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.761689:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20790 00000100:00100000:0.0:1746066818.762406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.762486:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592832 00000100:00100000:3.0:1746066818.762490:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592832 00000100:00100000:3.0:1746066818.762520:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20792 00000100:00100000:3.0:1746066818.762525:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:3599:x1830882985592832:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066818.762534:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.762544:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f8d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.762560:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.762567:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.762572:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.762574:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.762577:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.762598:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.762608:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 26 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.762618:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985175808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.762675:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.762682:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 10 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.762689:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985175936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.762704:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.764402:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.764521:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985592960 00000100:00100000:2.0:1746066818.764526:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985592960 00000100:00100000:2.0:1746066818.764558:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20793 00000100:00100000:2.0:1746066818.764562:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:3597:x1830882985592960:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066818.764570:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066818.764571:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.764582:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f94 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.764598:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.764603:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.764604:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.764608:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4861951] (req 4194304->4861951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.764622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066818.764627:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.764635:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 23 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746066818.764639:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985593344 00000100:00100000:1.0:1746066818.764642:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985593344 00000100:00100000:2.0:1746066818.764644:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985176064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066818.764657:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 27 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.764676:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9559 00000100:00100000:1.0:1746066818.764682:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985593344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.764689:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066818.764690:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066818.764704:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 27 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.764714:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 27 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.764728:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.764745:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985593344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.764751:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9559 00000100:00100000:1.0:1746066818.764838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.764851:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985593472 00000100:00100000:1.0:1746066818.764854:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985593472 00010000:00010000:1.0:1746066818.764867:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 11 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.764900:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9560 00000100:00100000:1.0:1746066818.764905:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985593472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.764911:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.764919:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 11 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.764926:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 11 pid: 9591 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.764935:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.764937:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.764941:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.764948:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.764968:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.764976:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985176192:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.765011:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8540 going to sleep for 11 seconds 00010000:00010000:3.0:1746066818.765128:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67200/0xf1867c21abfb2382 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f39 expref: 26 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.765140:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985175808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.765149:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eb600/0xf1867c21abfb22cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7efa expref: 11 pid: 9591 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746066818.765157:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985175936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.765175:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.765183:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf200, rc 0) 00000100:00100000:3.0:1746066818.765204:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:3599:x1830882985592832:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2679us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.765209:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20792 00000100:00100000:3.0:1746066818.765231:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985593216 00000100:00100000:3.0:1746066818.765233:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985593216 00002000:00100000:3.0:1746066818.765252:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->3751935) req@ffff88009677ed80 x1830882985593216/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.765260:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882985593216 ext(3747840->3751935) 00010000:00010000:3.0:1746066818.765265:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.765274:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.765280:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677ed80 00000100:00100000:3.0:1746066818.765297:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2248 00000100:00100000:3.0:1746066818.765303:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985593216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066818.765396:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985593216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 93us (826us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.765401:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2248 00002000:00100000:3.0:1746066818.765406:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->3751935) req@ffff88009677ed80 x1830882985593216/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.765413:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882985593216 ext(3747840->3751935) 00010000:00010000:3.0:1746066818.765417:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.765425:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.765430:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677ed80 00000100:00100000:2.0:1746066818.765506:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985175680:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066818.765515:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.765540:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985592576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4183us (4502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.765553:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9558 00000100:00100000:1.0:1746066818.767068:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985176192:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.767080:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.767101:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985593472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2196us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.767107:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9560 00000100:00100000:0.0:1746066818.767147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.767344:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985593728 00000100:00100000:3.0:1746066818.767349:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985593728 00002000:00100000:3.0:1746066818.767372:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1073152->1077247) req@ffff88008e435180 x1830882985593728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.767379:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435180 with x1830882985593728 ext(1073152->1077247) 00002000:00010000:3.0:1746066818.767383:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e435180 00000100:00100000:3.0:1746066818.767401:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7872 00000100:00100000:3.0:1746066818.767406:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985593728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066818.767498:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985593728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 92us (351us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.767503:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7872 00002000:00100000:3.0:1746066818.767508:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa1:0x0] (1073152->1077247) req@ffff88008e435180 x1830882985593728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.767515:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435180 with x1830882985593728 ext(1073152->1077247) 00002000:00010000:3.0:1746066818.767517:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e435180 00000100:00100000:2.0:1746066818.767666:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985176064:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.767685:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->4861951] (req 4194304->4861951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.767695:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2c00, rc 0) 00000100:00100000:2.0:1746066818.767715:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:3597:x1830882985592960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3152us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.767721:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20793 00000100:00100000:0.0:1746066818.769355:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.769434:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985593984 00000100:00100000:1.0:1746066818.769439:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985593984 00000100:00100000:1.0:1746066818.769482:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6545 00000100:00100000:1.0:1746066818.769488:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3599:x1830882985593984:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066818.769656:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3599:x1830882985593984:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 167us (305us total) trans 8589937827 rc 0/0 00000100:00100000:1.0:1746066818.769662:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6545 00000100:00100000:0.0:1746066818.776011:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.776053:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.776073:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985594624 00000100:00100000:0.0:1746066818.776080:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985594624 00000100:00100000:1.0:1746066818.776174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.776621:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985594368 00000100:00100000:2.0:1746066818.776625:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985594368 00000100:00100000:2.0:1746066818.776657:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20794 00000100:00100000:2.0:1746066818.776664:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3601:x1830882985594368:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.776678:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.776692:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7f9b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.776718:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.776726:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 24 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.776732:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.776733:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.776737:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.776762:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 24 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.776771:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 24 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.776782:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985176320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.776859:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.776870:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 9 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746066818.776877:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985176448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.776912:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.777050:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17331 00000100:00100000:0.0:1746066818.777057:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3605:x1830882985594624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.777065:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.777074:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fa2 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.777131:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777140:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777150:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777159:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777164:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777168:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777249:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777256:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777262:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066818.777269:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:3.0:1746066818.777297:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985594240 00000100:00100000:3.0:1746066818.777301:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985594240 00002000:00100000:3.0:1746066818.777321:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->4194303) req@ffff8800986cc700 x1830882985594240/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746066818.777323:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777339:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00002000:00100000:3.0:1746066818.777340:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cc700 with x1830882985594240 ext(3747840->4194303) 00010000:00010000:3.0:1746066818.777345:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.777347:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777352:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066818.777354:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 24 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.777357:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa44600 already unused, calling callback (ffffffffa0f1c690) 00002000:00010000:3.0:1746066818.777359:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800986cc700 00010000:00010000:0.0:1746066818.777360:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777365:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066818.777371:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2249 00010000:00010000:0.0:1746066818.777374:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00000100:00100000:3.0:1746066818.777375:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985594240:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:0.0:1746066818.777377:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.777380:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777385:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44600/0xf1867c21abfb241c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777401:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777405:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777409:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777413:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066818.777415:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777421:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777426:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ea200) 00010000:00010000:0.0:1746066818.777427:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066818.777429:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777433:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2423 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066818.777459:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.777467:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.777472:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066818.777473:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066818.777475:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44e00, rc 0) 00000100:00100000:0.0:1746066818.777497:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3605:x1830882985594624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 441us (1444us total) trans 8589937828 rc 0/0 00000100:00100000:0.0:1746066818.778040:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17331 00000100:00100000:3.0:1746066818.782645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.782729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.782928:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595008 00000100:00100000:1.0:1746066818.782936:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595008 00000100:00100000:1.0:1746066818.782982:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6546 00000100:00100000:1.0:1746066818.782989:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3605:x1830882985595008:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066818.783446:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985176320:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.783456:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985176448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.783480:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.783492:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00000100:00100000:2.0:1746066818.783514:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3601:x1830882985594368:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6850us (7511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.783514:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3605:x1830882985595008:12345-192.168.204.16@tcp:35:cat.0 Request processed in 525us (876us total) trans 8589937829 rc 0/0 00000100:00100000:1.0:1746066818.783519:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6546 00000100:00100000:2.0:1746066818.783530:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20794 00000100:00100000:1.0:1746066818.783540:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985594752 00000100:00100000:1.0:1746066818.783542:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985594752 00010000:00010000:1.0:1746066818.783556:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 10 pid: 20361 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.783580:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9561 00000100:00100000:1.0:1746066818.783586:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985594752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.783594:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.783608:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 10 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.783617:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 10 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.783632:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb22e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f16 expref: 10 pid: 20361 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.783640:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.783668:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985594752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.783673:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9561 00000100:00100000:3.0:1746066818.783721:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985594240:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6344us (7546us total) trans 17179875461 rc 0/0 00000100:00100000:3.0:1746066818.783728:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2249 00002000:00100000:3.0:1746066818.783735:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->4194303) req@ffff8800986cc700 x1830882985594240/t17179875461(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.783744:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cc700 with x1830882985594240 ext(3747840->4194303) 00010000:00010000:3.0:1746066818.783750:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 26 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.783759:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 26 pid: 1893 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746066818.783764:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800986cc700 00000100:00100000:0.0:1746066818.783983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.784378:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595136 00000100:00100000:1.0:1746066818.784381:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595136 00010000:00010000:1.0:1746066818.784394:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 25 pid: 9592 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746066818.785118:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9562 00000100:00100000:1.0:1746066818.785129:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985595136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.785137:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.785150:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 25 pid: 9592 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.785159:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 25 pid: 9592 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.785176:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eae00/0xf1867c21abfb2390 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f55 expref: 25 pid: 9592 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746066818.785185:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.785186:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.785191:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.785198:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.785222:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.785231:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985176576:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.785291:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.787359:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.787394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.787418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.787439:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.787454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.787472:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.788221:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595520 00000100:00100000:1.0:1746066818.788221:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595264 00000100:00100000:1.0:1746066818.788230:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595264 00000100:00100000:0.0:1746066818.788234:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595776 00000100:00100000:0.0:1746066818.788241:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595776 00000100:00100000:2.0:1746066818.788243:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595520 00000100:00100000:1.0:1746066818.788274:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595392 00000100:00100000:1.0:1746066818.788277:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595392 00000100:00100000:0.0:1746066818.788284:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595648 00000100:00100000:0.0:1746066818.788286:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595648 00000100:00100000:1.0:1746066818.788291:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985595904 00000100:00100000:1.0:1746066818.788294:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985595904 00000100:00100000:0.0:1746066818.788307:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20795 00000100:00100000:0.0:1746066818.788315:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985595264:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066818.788320:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20796 00000100:00100000:2.0:1746066818.788339:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985595776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066818.788346:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.788353:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.788362:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45800/0xf1867c21abfb2438 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fa9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.788366:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb243f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fc5 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.788413:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985176704:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066818.788413:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985176832:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066818.788424:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20797 00000100:00100000:3.0:1746066818.788433:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985595392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.788440:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.788449:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfb2446 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fb0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.788480:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985176960:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.788533:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20798 00000100:00100000:0.0:1746066818.788538:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.788539:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985595520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.788545:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.788551:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fb7 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.788558:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20799 00010000:00010000:2.0:1746066818.788562:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.788563:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066818.788563:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985595648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.788570:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.788570:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066818.788576:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fbe expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.788582:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.788587:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.788589:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066818.788596:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3c00, rc 0) 00010000:00010000:0.0:1746066818.788596:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066818.788606:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066818.788608:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.788617:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44200, rc 0) 00000100:00100000:2.0:1746066818.788618:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985595520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.788624:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20798 00000100:00100000:0.0:1746066818.788637:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985595648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 74us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.788640:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20800 00000100:00100000:0.0:1746066818.788644:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20799 00000100:00100000:2.0:1746066818.788645:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985595904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.788651:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.788657:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfb245b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fcc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.788674:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985176576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066818.788676:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985177088:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.788686:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066818.788696:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.788696:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.788702:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985595136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3578us (4720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.788710:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9562 00000100:00100000:2.0:1746066818.788715:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.788715:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985596032 00000100:00100000:0.0:1746066818.788718:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985596032 00010000:00010000:0.0:1746066818.788730:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 31 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746066818.788758:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9563 00000100:00100000:0.0:1746066818.788763:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985596032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066818.788771:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066818.788789:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 31 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.788800:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 31 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746066818.788824:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.788825:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066818.788831:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.788838:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066818.788857:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066818.788870:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985177216:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066818.788919:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.790842:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.791074:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985596288 00000100:00100000:3.0:1746066818.791080:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985596288 00002000:00100000:3.0:1746066818.791115:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff880094372a00 x1830882985596288/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.791125:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372a00 with x1830882985596288 ext(3313664->3317759) 00002000:00010000:3.0:1746066818.791130:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372a00 00000100:00100000:3.0:1746066818.791147:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7873 00000100:00100000:3.0:1746066818.791153:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985596288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066818.792105:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985596288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 951us (1266us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.792114:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7873 00002000:00100000:3.0:1746066818.792120:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff880094372a00 x1830882985596288/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.792128:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372a00 with x1830882985596288 ext(3313664->3317759) 00002000:00010000:3.0:1746066818.792131:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372a00 00000100:00100000:0.0:1746066818.795793:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985176832:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066818.795831:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45800/0xf1867c21abfb2438 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa9 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.795845:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45800/0xf1867c21abfb2438 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa9 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066818.795854:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45800, rc 0) 00000100:00100000:0.0:1746066818.795919:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985595264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7603us (8568us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066818.795927:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20795 00000100:00100000:0.0:1746066818.796098:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985177216:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066818.796108:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066818.796124:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985596032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7361us (7428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066818.796132:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9563 00000100:00100000:0.0:1746066818.796179:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.796198:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882985177088:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.796230:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfb245b lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fcc expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.796242:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfb245b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fcc expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.796253:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2e00, rc 0) 00000100:00100000:2.0:1746066818.796305:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985595904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7658us (8829us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.796312:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20800 00010000:00010000:3.0:1746066818.796356:0:12233:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff8800967a9180 x1830882985176704) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 28 pid: 1893 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746066818.796377:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecee00/0xf1867c21abfb23f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f7f expref: 28 pid: 1893 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746066818.796390:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985176704:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.796407:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb243f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fc5 expref: 27 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.796416:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eaa00/0xf1867c21abfb243f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fc5 expref: 27 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.796423:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eaa00, rc 0) 00000100:00100000:3.0:1746066818.796441:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985595776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8114us (9022us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.796446:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20796 00000100:00100000:3.0:1746066818.796478:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985176960:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.796494:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfb2446 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb0 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.796502:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfb2446 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb0 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.796510:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecec00, rc 0) 00000100:00100000:3.0:1746066818.796523:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985595392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8093us (9083us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.796528:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20797 00000100:00100000:3.0:1746066818.796547:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985596544 00000100:00100000:3.0:1746066818.796552:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985596544 00002000:00100000:3.0:1746066818.796583:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094370700 x1830882985596544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.796591:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370700 with x1830882985596544 ext(4194304->4861951) 00002000:00010000:3.0:1746066818.796596:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094370700 00000100:00100000:3.0:1746066818.796628:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7874 00000100:00100000:3.0:1746066818.796635:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985596544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.798358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.798429:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985596800 00000100:00100000:1.0:1746066818.798436:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985596800 00000100:00100000:1.0:1746066818.798466:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6547 00000100:00100000:1.0:1746066818.798473:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3601:x1830882985596800:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066818.798640:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3601:x1830882985596800:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 166us (287us total) trans 8589937830 rc 0/0 00000100:00100000:1.0:1746066818.798647:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6547 00000100:00100000:3.0:1746066818.800674:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985596544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4033us (4488us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066818.800685:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7874 00002000:00100000:3.0:1746066818.800695:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880094370700 x1830882985596544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.800705:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094370700 with x1830882985596544 ext(4194304->4861951) 00002000:00010000:3.0:1746066818.800710:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094370700 00000100:00100000:0.0:1746066818.801264:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.801332:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985596928 00000100:00100000:3.0:1746066818.801339:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985596928 00000100:00100000:3.0:1746066818.801370:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20801 00000100:00100000:3.0:1746066818.801377:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3605:x1830882985596928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.801392:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.801409:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fd3 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.801433:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 46 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.801440:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.801442:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.801446:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.801474:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 46 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.801486:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 46 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066818.801497:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985177344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.801568:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.804827:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.804944:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597056 00000100:00100000:2.0:1746066818.804952:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597056 00000100:00100000:2.0:1746066818.805001:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20802 00000100:00100000:2.0:1746066818.805008:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985597056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066818.805027:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.805044:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfb2469 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fda expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066818.805090:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985177472:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066818.805163:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066818.806466:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.806532:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597184 00000100:00100000:2.0:1746066818.806537:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597184 00002000:00100000:2.0:1746066818.806568:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->1048575) req@ffff880095803100 x1830882985597184/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.806584:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882985597184 ext(434176->1048575) 00010000:00010000:2.0:1746066818.806591:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 47 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066818.806604:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 47 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066818.806611:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803100 00000100:00100000:2.0:1746066818.806624:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2250 00000100:00100000:2.0:1746066818.806630:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985597184:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066818.806831:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985177344:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.806851:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.806869:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095dd0000, rc 0) 00000100:00100000:3.0:1746066818.807915:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3605:x1830882985596928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6535us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.807923:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20801 00000100:00100000:3.0:1746066818.808458:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985177472:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.808483:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfb2469 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fda expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.808494:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfb2469 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fda expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.808815:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2800, rc 0) 00000100:00100000:3.0:1746066818.808860:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985597056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3852us (4043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.808866:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20802 00000100:00100000:1.0:1746066818.812924:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.812962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.813035:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597440 00000100:00100000:3.0:1746066818.813043:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597440 00000100:00100000:3.0:1746066818.813095:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597312 00000100:00100000:3.0:1746066818.813098:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597312 00000100:00100000:3.0:1746066818.813116:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20803 00000100:00100000:3.0:1746066818.813123:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985597440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.813143:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.813161:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2470 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fe8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.813221:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985177600:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066818.813295:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.813314:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20804 00000100:00100000:3.0:1746066818.813320:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882985597312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.813340:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.813349:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb2477 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fe1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066818.813375:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985177728:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066818.813394:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066818.814544:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985597184:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7909us (8078us total) trans 17179875462 rc 0/0 00000100:00100000:2.0:1746066818.814554:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2250 00002000:00100000:2.0:1746066818.814564:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (434176->1048575) req@ffff880095803100 x1830882985597184/t17179875462(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.814573:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882985597184 ext(434176->1048575) 00010000:00010000:2.0:1746066818.814580:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 51 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066818.814592:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 51 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066818.814599:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803100 00000100:00100000:2.0:1746066818.815952:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985177600:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066818.815983:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2470 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fe8 expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.815995:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2470 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fe8 expref: 25 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066818.816010:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095dd0200, rc 0) 00000100:00100000:2.0:1746066818.816047:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985597440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2925us (3135us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066818.816054:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20803 00000100:00100000:3.0:1746066818.816549:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985177728:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066818.816565:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb2477 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fe1 expref: 50 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.816574:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfb2477 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fe1 expref: 50 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066818.816581:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2e00, rc 0) 00000100:00100000:3.0:1746066818.816607:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882985597312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3287us (3644us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066818.816613:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20804 00000100:00100000:0.0:1746066818.816744:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.816873:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597568 00000100:00100000:1.0:1746066818.816880:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597568 00010000:00010000:1.0:1746066818.816935:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 49 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066818.816971:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9564 00000100:00100000:1.0:1746066818.816977:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985597568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.816989:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.816999:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 49 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.817009:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 49 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.817030:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb23e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f71 expref: 49 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.817060:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.817062:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.817070:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.817077:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.817105:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.817116:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985177856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.817178:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.818087:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985177856:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.818102:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.818136:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985597568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1159us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.818144:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9564 00000100:00100000:0.0:1746066818.821692:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.822312:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597824 00000100:00100000:2.0:1746066818.822322:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597824 00002000:00100000:2.0:1746066818.822377:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095802680 x1830882985597824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.822387:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882985597824 ext(0->1048575) 00002000:00010000:2.0:1746066818.822393:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:2.0:1746066818.822409:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7875 00000100:00100000:2.0:1746066818.822414:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985597824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066818.832239:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985597824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9812us (10546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.832251:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7875 00002000:00100000:2.0:1746066818.832263:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095802680 x1830882985597824/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.832273:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882985597824 ext(0->1048575) 00002000:00010000:2.0:1746066818.832280:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:0.0:1746066818.837927:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.838048:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985597952 00000100:00100000:3.0:1746066818.838057:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985597952 00000100:00100000:3.0:1746066818.838106:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20805 00000100:00100000:3.0:1746066818.838114:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3605:x1830882985597952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.838133:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.838149:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7fef expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.838180:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.838187:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.838189:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.838193:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.838222:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.838233:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 23 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066818.838244:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985177984:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.838312:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.839773:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985177984:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.839795:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.839807:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4359400, rc 0) 00000100:00100000:3.0:1746066818.839844:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3605:x1830882985597952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1729us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.839852:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20805 00000100:00100000:0.0:1746066818.840644:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.841774:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985598080 00000100:00100000:2.0:1746066818.841783:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985598080 00002000:00100000:2.0:1746066818.841824:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1077247) req@ffff880095800380 x1830882985598080/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.841835:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800380 with x1830882985598080 ext(1048576->1077247) 00010000:00010000:2.0:1746066818.841843:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 24 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066818.841857:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 24 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066818.841864:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800380 00000100:00100000:2.0:1746066818.841900:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2251 00000100:00100000:2.0:1746066818.841907:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985598080:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066818.844256:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985598080:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2341us (3605us total) trans 21474842800 rc 0/0 00000100:00100000:2.0:1746066818.844266:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2251 00002000:00100000:2.0:1746066818.844277:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1077247) req@ffff880095800380 x1830882985598080/t21474842800(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.844286:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800380 with x1830882985598080 ext(1048576->1077247) 00010000:00010000:2.0:1746066818.844294:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066818.844307:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066818.844319:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800380 00000100:00100000:0.0:1746066818.846294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.846385:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985598208 00000100:00100000:1.0:1746066818.846393:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985598208 00010000:00010000:1.0:1746066818.846421:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066818.846456:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9565 00000100:00100000:1.0:1746066818.846462:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985598208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.846474:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.846491:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.846502:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.846529:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfb2400 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f8d expref: 26 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.846546:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.846548:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.846554:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.846563:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.846589:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.846600:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178112:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.847092:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.848530:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178112:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.848547:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.849015:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985598208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2551us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.849026:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9565 00000100:00100000:0.0:1746066818.853999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.854038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066818.854310:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.854478:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985598464 00000100:00100000:2.0:1746066818.854488:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985598464 00002000:00100000:2.0:1746066818.854531:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880097c00e00 x1830882985598464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.854546:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00e00 with x1830882985598464 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.854551:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c00e00 00000100:00100000:2.0:1746066818.854573:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985598720 00000100:00100000:2.0:1746066818.854575:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985598720 00002000:00100000:2.0:1746066818.854586:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880097c02300 x1830882985598720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.854592:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02300 with x1830882985598720 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.854595:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c02300 00000100:00100000:2.0:1746066818.854603:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985598976 00000100:00100000:2.0:1746066818.854605:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985598976 00002000:00100000:2.0:1746066818.854613:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880097c00700 x1830882985598976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.854620:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00700 with x1830882985598976 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.854622:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c00700 00000100:00100000:2.0:1746066818.854631:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7876 00000100:00100000:2.0:1746066818.854637:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985598464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.855056:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7877 00000100:00100000:1.0:1746066818.855065:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985598720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066818.855371:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7878 00000100:00100000:2.0:1746066818.855376:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985598976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066818.867333:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985598464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12675us (13324us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066818.867345:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7876 00002000:00100000:2.0:1746066818.867357:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880097c00e00 x1830882985598464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066818.867367:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00e00 with x1830882985598464 ext(1048576->2097151) 00002000:00010000:2.0:1746066818.867373:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c00e00 00000100:00100000:1.0:1746066818.873475:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985598720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18404us (19428us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.873487:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7877 00002000:00100000:1.0:1746066818.873498:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880097c02300 x1830882985598720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.873507:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02300 with x1830882985598720 ext(1048576->2097151) 00002000:00010000:1.0:1746066818.873512:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c02300 00000100:00100000:3.0:1746066818.875119:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985598976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19734us (20799us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066818.875129:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7878 00002000:00100000:3.0:1746066818.875139:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880097c00700 x1830882985598976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.875149:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00700 with x1830882985598976 ext(1048576->2097151) 00002000:00010000:3.0:1746066818.875154:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c00700 00000100:00100000:0.0:1746066818.888946:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.889144:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985599104 00000100:00100000:3.0:1746066818.889152:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985599104 00000100:00100000:3.0:1746066818.889297:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20806 00000100:00100000:3.0:1746066818.889305:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3605:x1830882985599104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.889334:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.889352:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ff6 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.889381:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.889383:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066818.889391:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.889406:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.889416:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30c00, rc 0) 00000100:00100000:3.0:1746066818.889459:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3605:x1830882985599104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 155us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.889465:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20806 00000100:00100000:0.0:1746066818.894419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.894725:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985599360 00000100:00100000:2.0:1746066818.894734:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985599360 00000100:00100000:2.0:1746066818.894783:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17332 00000100:00100000:2.0:1746066818.894790:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3610:x1830882985599360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.894814:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.894834:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb248c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d7ffd expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.894928:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.894941:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.894953:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.894967:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.894972:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.894977:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895065:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895072:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895078:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066818.895086:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066818.895151:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895157:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895162:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895167:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895172:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd1400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066818.895175:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895180:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895189:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066818.895191:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066818.895195:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895200:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895229:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895233:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895238:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895242:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943eaa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066818.895244:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895248:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895252:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a576c200) 00010000:00010000:2.0:1746066818.895254:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066818.895255:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895259:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eaa00/0xf1867c21abfb249a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066818.895291:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb248c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.895300:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.895306:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066818.895309:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066818.895311:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2e00, rc 0) 00000100:00100000:2.0:1746066818.895389:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3610:x1830882985599360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 598us (982us total) trans 8589937831 rc 0/0 00000100:00100000:2.0:1746066818.895394:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17332 00000100:00100000:0.0:1746066818.900571:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.900621:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985599616 00000100:00100000:0.0:1746066818.900621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.900630:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985599616 00002000:00100000:3.0:1746066818.900673:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c03100 x1830882985599616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066818.900673:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985599872 00000100:00100000:1.0:1746066818.900677:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985599872 00002000:00100000:3.0:1746066818.900683:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03100 with x1830882985599616 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.900688:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03100 00002000:00100000:1.0:1746066818.900698:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880097c03480 x1830882985599872/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.900706:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03480 with x1830882985599872 ext(2097152->4194303) 00002000:00010000:1.0:1746066818.900710:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c03480 00000100:00100000:3.0:1746066818.900716:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7879 00000100:00100000:3.0:1746066818.900722:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985599616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.900724:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7880 00000100:00100000:1.0:1746066818.900729:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985599872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.911828:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066818.911931:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600000 00000100:00100000:2.0:1746066818.911940:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600000 00000100:00100000:2.0:1746066818.912253:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20807 00000100:00100000:2.0:1746066818.912262:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:3610:x1830882985600000:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066818.912282:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066818.912299:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8004 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.912339:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.912348:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.912349:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066818.912353:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3231744->3358719] (req 3231744->3358719) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.912381:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.912391:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 17 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066818.912404:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985178240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066818.914943:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.915479:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985599616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14751us (14914us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066818.915490:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7879 00002000:00100000:3.0:1746066818.915502:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880097c03100 x1830882985599616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.915512:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03100 with x1830882985599616 ext(2097152->4194303) 00002000:00010000:3.0:1746066818.915517:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097c03100 00000100:00100000:2.0:1746066818.918178:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985178240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066818.918210:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3231744->3358719] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066818.918229:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2a00, rc 0) 00000100:00100000:2.0:1746066818.918270:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:3610:x1830882985600000:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6008us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066818.918278:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20807 00000100:00100000:0.0:1746066818.918547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.918638:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600128 00000100:00100000:3.0:1746066818.918645:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600128 00002000:00100000:3.0:1746066818.918679:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3317759) req@ffff880097c02d80 x1830882985600128/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.918689:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02d80 with x1830882985600128 ext(3145728->3317759) 00010000:00010000:3.0:1746066818.918696:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 18 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066818.918714:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 18 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066818.918720:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c02d80 00000100:00100000:3.0:1746066818.918735:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2252 00000100:00100000:3.0:1746066818.918740:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985600128:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066818.922277:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.922354:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600256 00000100:00100000:3.0:1746066818.922364:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600256 00000100:00100000:3.0:1746066818.922414:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20808 00000100:00100000:3.0:1746066818.922423:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3605:x1830882985600256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.922442:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.922460:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d800b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.922487:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.922490:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.922494:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.922505:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.922516:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:3.0:1746066818.922629:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3605:x1830882985600256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 206us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.922640:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20808 00000100:00100000:3.0:1746066818.924491:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985600128:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5745us (5939us total) trans 21474842801 rc 0/0 00000100:00100000:3.0:1746066818.924500:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2252 00002000:00100000:3.0:1746066818.924510:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3317759) req@ffff880097c02d80 x1830882985600128/t21474842801(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.924519:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02d80 with x1830882985600128 ext(3145728->3317759) 00010000:00010000:3.0:1746066818.924528:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066818.924542:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066818.924548:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c02d80 00000100:00100000:1.0:1746066818.924793:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985599872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24061us (24170us total) trans 0 rc 1925120/1925120 00000100:00100000:1.0:1746066818.924799:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7880 00002000:00100000:1.0:1746066818.924804:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880097c03480 x1830882985599872/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 504/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1925120/1925120 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.924810:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03480 with x1830882985599872 ext(2097152->4194303) 00010000:00010000:1.0:1746066818.924814:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.924822:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746066818.924828:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097c03480 00000100:00100000:0.0:1746066818.932083:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.932315:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600384 00000100:00100000:1.0:1746066818.932353:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600384 00010000:00010000:1.0:1746066818.932393:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066818.932441:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9566 00000100:00100000:1.0:1746066818.932449:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985600384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.932464:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.932485:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.933512:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.933540:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfb240e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f9b expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.933576:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.933578:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.933586:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.933593:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.933610:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.933611:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.933615:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.933621:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.933657:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.933669:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.933787:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.933795:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178496:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.933816:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.935210:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.935221:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178496:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.935242:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.935415:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985600384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2964us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.935425:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9566 00000100:00100000:0.0:1746066818.937678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.937735:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600640 00000100:00100000:1.0:1746066818.937743:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600640 00002000:00100000:1.0:1746066818.937780:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3235839) req@ffff880097c00380 x1830882985600640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.937790:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00380 with x1830882985600640 ext(3231744->3235839) 00002000:00010000:1.0:1746066818.937795:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c00380 00000100:00100000:1.0:1746066818.937823:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7881 00000100:00100000:1.0:1746066818.937830:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985600640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066818.937967:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985600640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (295us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066818.937973:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7881 00002000:00100000:1.0:1746066818.937978:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3235839) req@ffff880097c00380 x1830882985600640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.937985:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c00380 with x1830882985600640 ext(3231744->3235839) 00002000:00010000:1.0:1746066818.937988:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c00380 00000100:00100000:0.0:1746066818.938537:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.938604:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985600896 00000100:00100000:1.0:1746066818.938608:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985600896 00002000:00100000:1.0:1746066818.938623:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880097c02680 x1830882985600896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.938631:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02680 with x1830882985600896 ext(2097152->3145727) 00002000:00010000:1.0:1746066818.938634:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c02680 00000100:00100000:1.0:1746066818.938658:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7882 00000100:00100000:1.0:1746066818.938663:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985600896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066818.940864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.940953:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985601152 00000100:00100000:3.0:1746066818.940959:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985601152 00002000:00100000:3.0:1746066818.940990:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880097c03b80 x1830882985601152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.940999:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03b80 with x1830882985601152 ext(3354624->3358719) 00002000:00010000:3.0:1746066818.941003:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c03b80 00000100:00100000:3.0:1746066818.941030:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7883 00000100:00100000:3.0:1746066818.941036:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985601152:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066818.941168:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985601152:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 131us (308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066818.941178:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7883 00002000:00100000:3.0:1746066818.941183:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880097c03b80 x1830882985601152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066818.941189:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c03b80 with x1830882985601152 ext(3354624->3358719) 00002000:00010000:3.0:1746066818.941191:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c03b80 00000100:00100000:0.0:1746066818.945105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.945267:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985600896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6602us (6730us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.945281:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7882 00002000:00100000:1.0:1746066818.945291:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880097c02680 x1830882985600896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.945299:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c02680 with x1830882985600896 ext(2097152->3145727) 00002000:00010000:1.0:1746066818.945305:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c02680 00000100:00100000:2.0:1746066818.945382:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985601408 00000100:00100000:2.0:1746066818.945389:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985601408 00000100:00100000:2.0:1746066818.945421:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6548 00000100:00100000:2.0:1746066818.945427:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:3610:x1830882985601408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066818.945569:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3610:x1830882985601408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 142us (472us total) trans 8589937832 rc 0/0 00000100:00100000:2.0:1746066818.945575:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6548 00000100:00100000:0.0:1746066818.957176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066818.957313:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985601536 00000100:00100000:3.0:1746066818.957331:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985601536 00000100:00100000:3.0:1746066818.957373:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20809 00000100:00100000:3.0:1746066818.957380:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3605:x1830882985601536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066818.957395:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066818.957410:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8012 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.957487:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.957494:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.957495:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066818.957498:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 19 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.957525:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.957537:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 25 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066818.957554:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985178624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066818.957759:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066818.960175:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985178624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066818.960199:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 19 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066818.960214:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31a00, rc 0) 00000100:00100000:3.0:1746066818.961600:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3605:x1830882985601536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4213us (4426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066818.961610:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20809 00000100:00100000:2.0:1746066818.962344:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.962391:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985601664 00000100:00100000:1.0:1746066818.962398:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985601664 00002000:00100000:1.0:1746066818.962430:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3358719) req@ffff8800967aaa00 x1830882985601664/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.962437:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882985601664 ext(3231744->3358719) 00010000:00010000:1.0:1746066818.962442:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 26 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.962450:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 26 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746066818.962455:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aaa00 00000100:00100000:1.0:1746066818.962475:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2253 00000100:00100000:1.0:1746066818.962481:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985601664:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066818.965071:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985601664:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2577us (2717us total) trans 21474842802 rc 0/0 00000100:00100000:1.0:1746066818.965084:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2253 00002000:00100000:1.0:1746066818.965096:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3231744->3358719) req@ffff8800967aaa00 x1830882985601664/t21474842802(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:224/0 lens 488/448 e 0 to 0 dl 1746066829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.965112:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882985601664 ext(3231744->3358719) 00010000:00010000:1.0:1746066818.965122:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.965137:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746066818.965144:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aaa00 00000100:00100000:0.0:1746066818.967990:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.968320:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985601792 00000100:00100000:1.0:1746066818.968469:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985601792 00010000:00010000:1.0:1746066818.968506:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066818.968550:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9567 00000100:00100000:1.0:1746066818.968558:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882985601792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066818.968571:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066818.968591:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.968602:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.968626:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2a00/0xf1867c21abfb24af lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3231744->3358719) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8004 expref: 28 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066818.968662:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.968664:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066818.968671:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.968680:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066818.968713:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066818.968726:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066818.968822:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066818.970348:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985178752:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066818.970371:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066818.970409:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985601792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1851us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066818.970418:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9567 00000100:00100000:0.0:1746066818.972109:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.972280:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985602048 00000100:00100000:1.0:1746066818.972287:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985602048 00002000:00100000:1.0:1746066818.972337:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88012ea37480 x1830882985602048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.972347:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37480 with x1830882985602048 ext(3145728->4194303) 00002000:00010000:1.0:1746066818.972353:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37480 00000100:00100000:1.0:1746066818.972580:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7884 00000100:00100000:1.0:1746066818.972597:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985602048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.977936:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985602048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5334us (5822us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066818.977949:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7884 00002000:00100000:1.0:1746066818.977961:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88012ea37480 x1830882985602048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.977971:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37480 with x1830882985602048 ext(3145728->4194303) 00002000:00010000:1.0:1746066818.977976:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37480 00000100:00100000:0.0:1746066818.983589:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066818.983656:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985602304 00000100:00100000:1.0:1746066818.983665:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985602304 00002000:00100000:1.0:1746066818.983712:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012ea35500 x1830882985602304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/0 e 0 to 0 dl 1746066829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.983722:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985602304 ext(4194304->4861951) 00002000:00010000:1.0:1746066818.983727:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea35500 00000100:00100000:1.0:1746066818.983760:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7885 00000100:00100000:1.0:1746066818.983768:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985602304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066818.988907:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985602304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5107us (5295us total) trans 0 rc 667648/667648 00000100:00100000:1.0:1746066818.988918:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7885 00002000:00100000:1.0:1746066818.988930:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff88012ea35500 x1830882985602304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:224/0 lens 488/440 e 0 to 0 dl 1746066829 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066818.988939:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985602304 ext(4194304->4861951) 00002000:00010000:1.0:1746066818.988944:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea35500 00000100:00100000:0.0:1746066819.015052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.015121:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985602560 00000100:00100000:2.0:1746066819.015130:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985602560 00000100:00100000:2.0:1746066819.015202:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17333 00000100:00100000:2.0:1746066819.015211:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3614:x1830882985602560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.015236:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746066819.015252:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066819.015259:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfb24c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8019 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.015488:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.015509:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.015521:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.015526:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.015556:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.015569:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 31 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.015581:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985178880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.015712:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.015719:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 14 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.015726:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985179008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.015744:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.017648:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985178880:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.017661:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.017737:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.017796:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985602688 00000100:00100000:1.0:1746066819.017803:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985602688 00000100:00100000:3.0:1746066819.017826:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985602816 00000100:00100000:3.0:1746066819.017832:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985602816 00010000:00010000:1.0:1746066819.017839:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 32 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.017856:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 15 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.017865:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9568 00000100:00100000:1.0:1746066819.017872:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985602688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.017902:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1746066819.017905:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746066819.017908:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 32 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.017917:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 32 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.017932:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfb24a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ffd expref: 32 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.017948:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066819.017952:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066819.017958:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066819.017963:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.017973:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9569 00000100:00100000:3.0:1746066819.017980:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985602816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.017990:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066819.017995:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985602688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066819.017996:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 15 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.018001:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9568 00010000:00010000:3.0:1746066819.018006:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 15 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.018023:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.018028:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066819.018035:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066819.018042:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066819.018057:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066819.018081:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb242a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fa2 expref: 15 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.018091:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985602816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.018098:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9569 00000100:00100000:2.0:1746066819.018098:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882985179008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.018120:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.018127:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.018132:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066819.018146:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066819.018728:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfb24c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.018741:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.018748:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.018750:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066819.018752:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945c00, rc 0) 00000100:00100000:2.0:1746066819.018825:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3614:x1830882985602560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3615us (3783us total) trans 8589937833 rc 0/0 00000100:00100000:2.0:1746066819.018832:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17333 00000100:00100000:0.0:1746066819.043564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.043731:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603072 00000100:00100000:2.0:1746066819.043741:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603072 00000100:00100000:2.0:1746066819.043795:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17334 00000100:00100000:2.0:1746066819.043802:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:3617:x1830882985603072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.043824:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.043841:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb24d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8020 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.043959:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.043972:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.043981:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.043992:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.043997:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044001:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044093:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044101:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044106:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066819.044113:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066819.044197:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044203:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044208:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044214:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044220:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b945e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066819.044224:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044229:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044239:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066819.044242:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066819.044245:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044250:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfb24e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044265:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044269:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044273:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044280:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b945a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066819.044282:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044287:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044291:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a576cd00) 00010000:00010000:2.0:1746066819.044293:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066819.044295:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044299:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb24e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.044347:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb24d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 34 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.044359:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.044365:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.044366:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066819.044369:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944800, rc 0) 00000100:00100000:2.0:1746066819.044423:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:3617:x1830882985603072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 620us (868us total) trans 8589937834 rc 0/0 00000100:00100000:2.0:1746066819.044429:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17334 00000100:00100000:0.0:1746066819.045661:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.045748:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603328 00000100:00100000:1.0:1746066819.045755:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603328 00000100:00100000:1.0:1746066819.045799:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6549 00000100:00100000:1.0:1746066819.045806:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:3617:x1830882985603328:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066819.045959:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3617:x1830882985603328:12345-192.168.204.16@tcp:35:cat.0 Request processed in 153us (302us total) trans 8589937835 rc 0/0 00000100:00100000:1.0:1746066819.045966:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6549 00000100:00100000:0.0:1746066819.049609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.049657:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.049697:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.049736:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603456 00000100:00100000:0.0:1746066819.049743:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603456 00000100:00100000:0.0:1746066819.049787:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603584 00000100:00100000:0.0:1746066819.049789:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603584 00000100:00100000:0.0:1746066819.049801:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603712 00000100:00100000:0.0:1746066819.049802:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603712 00000100:00100000:0.0:1746066819.049819:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20810 00000100:00100000:0.0:1746066819.049827:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985603456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.049844:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.049860:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8027 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.049910:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.049913:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.049921:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 49 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.049937:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 49 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.049949:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c400, rc 0) 00000100:00100000:0.0:1746066819.049991:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985603456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.050000:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20810 00000100:00100000:0.0:1746066819.050013:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20811 00000100:00100000:0.0:1746066819.050017:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985603584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.050024:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.050033:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d802e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.050044:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.050046:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.050050:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.050058:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.050066:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0de00, rc 0) 00000100:00100000:0.0:1746066819.050080:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985603584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.050085:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20811 00000100:00100000:0.0:1746066819.050194:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20812 00000100:00100000:0.0:1746066819.050200:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985603712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.050205:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.050211:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8035 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.050220:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.050222:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.050227:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.050235:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.050241:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d200, rc 0) 00000100:00100000:0.0:1746066819.050254:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985603712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 55us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.050259:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20812 00000100:00080000:0.0:1746066819.050273:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066819.050276:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066819.058781:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.058827:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.058854:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985603968 00000100:00100000:1.0:1746066819.058864:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985603968 00000100:00100000:0.0:1746066819.058866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.058881:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985604224 00000100:00100000:3.0:1746066819.058907:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985604224 00000100:00100000:0.0:1746066819.058917:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985604480 00000100:00100000:0.0:1746066819.058921:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985604480 00002000:00100000:3.0:1746066819.058934:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd4380 x1830882985604224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066819.058934:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095dd5f80 x1830882985603968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.058939:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880095dd4a80 x1830882985604480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.058944:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4380 with x1830882985604224 ext(1048576->2097151) 00002000:00100000:1.0:1746066819.058944:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5f80 with x1830882985603968 ext(0->1048575) 00002000:00100000:0.0:1746066819.058948:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4a80 with x1830882985604480 ext(1048576->2097151) 00002000:00010000:1.0:1746066819.058949:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5f80 00002000:00010000:3.0:1746066819.058950:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4380 00002000:00010000:0.0:1746066819.058952:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4a80 00000100:00100000:3.0:1746066819.058974:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7886 00000100:00100000:3.0:1746066819.058980:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985604224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066819.059034:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7887 00000100:00100000:1.0:1746066819.059039:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985603968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066819.059042:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7888 00000100:00100000:0.0:1746066819.059049:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985604480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066819.062509:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.062648:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985604736 00000100:00100000:3.0:1746066819.062658:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985604736 00002000:00100000:3.0:1746066819.062703:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880095dd7100 x1830882985604736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.062714:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7100 with x1830882985604736 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.062720:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7100 00000100:00100000:3.0:1746066819.062753:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7889 00000100:00100000:3.0:1746066819.062762:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985604736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066819.072312:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985604480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13251us (13434us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.072341:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7888 00002000:00100000:2.0:1746066819.072353:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880095dd4a80 x1830882985604480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.072361:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4a80 with x1830882985604480 ext(1048576->2097151) 00002000:00010000:2.0:1746066819.072368:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4a80 00000100:00100000:1.0:1746066819.076006:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985603968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16953us (17228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066819.076017:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7887 00002000:00100000:1.0:1746066819.076029:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095dd5f80 x1830882985603968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066819.076039:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5f80 with x1830882985603968 ext(0->1048575) 00002000:00010000:1.0:1746066819.076046:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5f80 00000100:00100000:3.0:1746066819.082033:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985604224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23041us (23193us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.082044:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7886 00002000:00100000:3.0:1746066819.082055:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd4380 x1830882985604224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.082064:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4380 with x1830882985604224 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.082071:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4380 00000100:00100000:2.0:1746066819.082270:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985604736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19508us (19771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.082278:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7889 00002000:00100000:2.0:1746066819.082283:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880095dd7100 x1830882985604736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.082290:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7100 with x1830882985604736 ext(1048576->2097151) 00002000:00010000:2.0:1746066819.082294:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7100 00000100:00100000:0.0:1746066819.100351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.100398:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.100765:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605248 00000100:00100000:2.0:1746066819.100765:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605120 00000100:00100000:3.0:1746066819.100774:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605248 00000100:00100000:2.0:1746066819.100774:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605120 00002000:00100000:2.0:1746066819.100821:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095dd4700 x1830882985605120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.100824:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800930e2300 x1830882985605248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.100832:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882985605120 ext(2097152->4194303) 00002000:00100000:3.0:1746066819.100835:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2300 with x1830882985605248 ext(2097152->4194303) 00002000:00010000:2.0:1746066819.100838:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd4700 00002000:00010000:3.0:1746066819.100839:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e2300 00000100:00100000:3.0:1746066819.100871:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7890 00000100:00100000:2.0:1746066819.100876:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7891 00000100:00100000:3.0:1746066819.100878:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882985605248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066819.100905:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985605120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.112657:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882985605248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11765us (12243us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066819.112670:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7890 00002000:00100000:3.0:1746066819.112682:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800930e2300 x1830882985605248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.112692:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2300 with x1830882985605248 ext(2097152->4194303) 00002000:00010000:3.0:1746066819.112698:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e2300 00000100:00100000:2.0:1746066819.120180:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985605120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19287us (19827us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066819.120191:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7891 00002000:00100000:2.0:1746066819.120204:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095dd4700 x1830882985605120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.120214:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882985605120 ext(2097152->4194303) 00002000:00010000:2.0:1746066819.120219:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd4700 00000100:00100000:0.0:1746066819.145785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.145928:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605376 00000100:00100000:1.0:1746066819.145936:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605376 00000100:00100000:1.0:1746066819.145984:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20813 00000100:00100000:1.0:1746066819.145991:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3614:x1830882985605376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066819.146012:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.146028:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d803c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.146055:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.146063:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.146069:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.146070:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.146073:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.146101:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.146111:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 28 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.146122:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179136:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.146215:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.146223:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.146237:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179264:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.146256:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.148065:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.148076:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179264:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.148102:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.148116:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8a00, rc 0) 00000100:00100000:1.0:1746066819.148169:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3614:x1830882985605376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2176us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.148177:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20813 00000100:00100000:0.0:1746066819.148876:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.148933:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605504 00000100:00100000:2.0:1746066819.148940:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605504 00000100:00100000:0.0:1746066819.148951:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066819.148966:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.148989:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605632 00000100:00100000:2.0:1746066819.148991:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605632 00010000:00010000:2.0:1746066819.148999:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.149019:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9570 00000100:00100000:2.0:1746066819.149024:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985605504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066819.149029:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9571 00000100:00100000:1.0:1746066819.149035:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985605632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.149036:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.149043:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.149054:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.149055:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.149063:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.149617:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.149641:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4359400/0xf1867c21abfb247e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fef expref: 20 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.149667:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.149692:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985605632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 657us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.149698:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9571 00010000:00010000:2.0:1746066819.149816:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfb2503 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d802e expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.149839:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.149841:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.149847:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.149858:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.150012:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.150258:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985179392:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.150328:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.152095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.152384:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985179392:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.152402:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.152412:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985605888 00000100:00100000:3.0:1746066819.152420:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985605888 00002000:00100000:3.0:1746066819.152457:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->1679359) req@ffff880097c01500 x1830882985605888/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.152466:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01500 with x1830882985605888 ext(1675264->1679359) 00002000:00010000:3.0:1746066819.152471:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c01500 00000100:00100000:3.0:1746066819.152487:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7892 00000100:00100000:3.0:1746066819.152493:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985605888:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066819.152655:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985605504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3629us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.152664:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9570 00000100:00100000:3.0:1746066819.152843:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985605888:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 349us (752us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.152850:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7892 00002000:00100000:3.0:1746066819.152855:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->1679359) req@ffff880097c01500 x1830882985605888/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.152862:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c01500 with x1830882985605888 ext(1675264->1679359) 00002000:00010000:3.0:1746066819.152865:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c01500 00000100:00100000:0.0:1746066819.159870:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.159973:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606016 00000100:00100000:1.0:1746066819.160281:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606016 00000100:00100000:1.0:1746066819.160338:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20814 00000100:00100000:1.0:1746066819.160345:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3614:x1830882985606016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066819.160364:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.160381:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8043 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.160408:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.160416:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.160423:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.160427:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.160429:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.160431:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1572863] (req 1048576->1572863) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.160461:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.160471:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 27 pid: 20361 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.160483:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.161388:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.161402:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.161414:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.161455:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.161463:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 8 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.161469:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179776:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.161483:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.164489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.164555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.164563:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.164576:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.164579:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.164582:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985179776:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.164611:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1572863] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 20 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.164616:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606144 00000100:00100000:0.0:1746066819.164621:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606144 00010000:00010000:1.0:1746066819.164623:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8400, rc 0) 00010000:00010000:0.0:1746066819.164650:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 9 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.164651:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3614:x1830882985606016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4307us (4792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.164657:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20814 00000100:00100000:0.0:1746066819.164668:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606272 00000100:00100000:0.0:1746066819.164669:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606272 00010000:00010000:0.0:1746066819.164676:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 887 lvb_type: 1 00000100:00080000:1.0:1746066819.164733:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066819.164869:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606400 00000100:00100000:0.0:1746066819.164871:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606400 00010000:00010000:0.0:1746066819.164878:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 28 pid: 20361 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.164930:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9572 00000100:00100000:2.0:1746066819.164936:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985606144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.164949:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.164963:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 9 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.164970:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 9 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.164990:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb22da lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f01 expref: 9 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.164996:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9573 00010000:00010000:2.0:1746066819.165002:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.165004:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985606272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.165011:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066819.165020:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985606144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.165025:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9572 00010000:00010000:1.0:1746066819.165025:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.165033:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.165036:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9574 00000100:00100000:2.0:1746066819.165040:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985606400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.165045:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3c00/0xf1867c21abfb244d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fb7 expref: 20 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.165047:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.165054:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 28 pid: 20361 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.165059:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066819.165062:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 28 pid: 20361 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.165073:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67400/0xf1867c21abfb2397 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f40 expref: 28 pid: 20361 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.165078:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985606272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (522us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066819.165081:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.165082:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066819.165087:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9573 00010000:00010000:2.0:1746066819.165088:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.165095:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.165116:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.165126:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985179904:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.165785:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.167306:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985179904:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.167331:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.167367:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985606400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2325us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.167374:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9574 00000100:00100000:0.0:1746066819.170197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.170356:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606656 00000100:00100000:3.0:1746066819.170364:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606656 00002000:00100000:3.0:1746066819.170400:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1568768->1572863) req@ffff88011d857480 x1830882985606656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.170406:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857480 with x1830882985606656 ext(1568768->1572863) 00002000:00010000:3.0:1746066819.170410:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d857480 00000100:00100000:3.0:1746066819.170462:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7893 00000100:00100000:3.0:1746066819.170467:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985606656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.170572:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985606656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 104us (380us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.170578:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7893 00002000:00100000:3.0:1746066819.170583:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1568768->1572863) req@ffff88011d857480 x1830882985606656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.170590:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857480 with x1830882985606656 ext(1568768->1572863) 00002000:00010000:3.0:1746066819.170592:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d857480 00000100:00100000:0.0:1746066819.176038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.176590:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985606912 00000100:00100000:2.0:1746066819.176599:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985606912 00000100:00100000:2.0:1746066819.176656:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17335 00000100:00100000:2.0:1746066819.176664:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:3621:x1830882985606912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.176685:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.176702:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfb251f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d804a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.176772:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176784:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176793:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176808:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176813:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176817:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176922:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945800/0xf1867c21abfb2534 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176930:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945800/0xf1867c21abfb2534 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.176936:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945800/0xf1867c21abfb2534 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066819.176944:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:2.0:1746066819.177000:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177005:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177010:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177016:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177021:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b945a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066819.177024:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177030:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177038:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066819.177041:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066819.177044:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177049:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfb2526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177078:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177083:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177088:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177092:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066819.177095:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177099:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177105:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a576c400) 00010000:00010000:2.0:1746066819.177107:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066819.177109:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177113:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944c00/0xf1867c21abfb252d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066819.177144:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfb251f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d804a expref: 37 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.177154:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945800/0xf1867c21abfb2534 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d804a expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.177159:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.177161:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066819.177163:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945800, rc 0) 00000100:00100000:2.0:1746066819.177211:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:3621:x1830882985606912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 547us (1179us total) trans 8589937836 rc 0/0 00000100:00100000:2.0:1746066819.177217:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17335 00000100:00100000:0.0:1746066819.178991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.179274:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607040 00000100:00100000:2.0:1746066819.179280:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607040 00000100:00100000:2.0:1746066819.179342:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 951 00000100:00100000:2.0:1746066819.179348:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985607040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.179359:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.179375:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945800/0xf1867c21abfb2534 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d804a expref: 36 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.179388:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.179391:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.180120:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985607040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 769us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.180126:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 951 00000100:00100000:0.0:1746066819.191371:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.191429:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607168 00000100:00100000:3.0:1746066819.191438:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607168 00000100:00100000:3.0:1746066819.191487:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17336 00000100:00100000:3.0:1746066819.191495:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:3623:x1830882985607168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.191515:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.191530:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8051 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.191580:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191590:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191599:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191609:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191615:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191619:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191688:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191698:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.191704:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.191729:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.191740:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 13 pid: 7244 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.191750:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985180032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.191836:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.193250:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985180032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.193267:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066819.193445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.193498:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607424 00000100:00100000:2.0:1746066819.193504:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607424 00000100:00100000:2.0:1746066819.193542:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6550 00000100:00100000:2.0:1746066819.193549:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:314:x1830882985607424:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066819.193785:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:314:x1830882985607424:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 235us (340us total) trans 8589937837 rc 0/0 00000100:00100000:2.0:1746066819.193792:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6550 00000100:00100000:0.0:1746066819.199541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.199644:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607552 00000100:00100000:2.0:1746066819.199652:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607552 00010000:00010000:2.0:1746066819.199685:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 15 pid: 7244 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.199855:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9575 00000100:00100000:1.0:1746066819.199864:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985607552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.199876:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.199907:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 15 pid: 7244 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.199918:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 15 pid: 7244 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.199935:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfb24cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8019 expref: 15 pid: 7244 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.199953:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066819.199958:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.199966:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.199971:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.200011:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.200045:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985607552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 183us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.200050:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9575 00010000:00010000:3.0:1746066819.200764:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200773:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.200825:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066819.200829:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066819.200845:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200854:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200864:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200870:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200875:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200881:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200919:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecf200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.200923:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200929:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200937:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066819.200939:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.200942:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200946:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200967:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200975:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200979:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200983:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ece200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.200984:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200988:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200992:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f600) 00010000:00010000:3.0:1746066819.200994:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.200996:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.200999:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb2550 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.201026:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.201037:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.201042:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.201044:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066819.201046:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfc00, rc 0) 00000100:00100000:3.0:1746066819.201242:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3623:x1830882985607168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9747us (9877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.201249:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17336 00000100:00100000:0.0:1746066819.205134:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.205169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.205191:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.205222:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.205289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.205315:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607680 00000100:00100000:0.0:1746066819.205331:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607680 00000100:00100000:0.0:1746066819.205368:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607936 00000100:00100000:0.0:1746066819.205369:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607936 00000100:00100000:0.0:1746066819.205381:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985608192 00000100:00100000:0.0:1746066819.205382:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985608192 00000100:00100000:0.0:1746066819.205390:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985607808 00000100:00100000:0.0:1746066819.205392:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985607808 00000100:00100000:0.0:1746066819.205400:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985608064 00000100:00100000:0.0:1746066819.205401:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985608064 00000100:00100000:0.0:1746066819.205413:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20815 00000100:00100000:0.0:1746066819.205420:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985607680:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066819.205438:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066819.205450:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20816 00010000:00010000:0.0:1746066819.205457:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8058 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.205467:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985607936:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066819.205480:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.205482:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.205486:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.205491:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.205501:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2565 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8066 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.205506:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.205517:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83c00, rc 0) 00000100:00100000:3.0:1746066819.205548:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985180160:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066819.205562:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2014:x1830882985607680:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 142us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.205569:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20815 00000100:00100000:0.0:1746066819.205584:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20817 00000100:00100000:0.0:1746066819.205588:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985608192:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066819.205595:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.205602:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8074 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.205612:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.205614:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.205618:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066819.205621:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066819.205626:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066819.205627:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20818 00010000:00010000:0.0:1746066819.205634:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83600, rc 0) 00000100:00100000:1.0:1746066819.205636:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985607808:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.205643:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066819.205648:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20819 00010000:00010000:1.0:1746066819.205650:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfb2573 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d805f expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.205652:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985608192:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 63us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.205655:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985608064:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746066819.205658:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20817 00010000:00010000:3.0:1746066819.205663:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066819.205671:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985180288:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066819.205674:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d806d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.205686:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.205688:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066819.205693:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db59c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066819.205695:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.205708:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.205717:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfe00, rc 0) 00000100:00100000:3.0:1746066819.205738:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985608064:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 84us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.205745:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20819 00002000:00010000:2.0:1746066819.209340:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066819 -> 1746066820 00002000:00010000:1.0:1746066819.209340:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066819 -> 1746066820 00002000:00010000:2.0:1746066819.209346:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066819 -> 1746066820 00002000:00010000:1.0:1746066819.209347:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066819 -> 1746066820 00002000:00010000:2.0:1746066819.209348:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066819 -> 1746066820 00002000:00010000:1.0:1746066819.209349:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066819 -> 1746066820 00000100:00100000:2.0:1746066819.209364:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985180160:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066819.209364:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985180288:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066819.209393:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2565 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8066 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.209393:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfb2573 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d805f expref: 12 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.209404:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2565 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8066 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.209404:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfb2573 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d805f expref: 12 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.209418:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00010000:00010000:1.0:1746066819.209420:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8000, rc 0) 00000100:00100000:1.0:1746066819.209580:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985607808:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3944us (4356us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066819.209588:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20818 00000100:00100000:2.0:1746066819.209744:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985607936:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4283us (4572us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066819.209751:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20816 00000100:00100000:0.0:1746066819.212217:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.212264:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985608448 00000100:00100000:3.0:1746066819.212272:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985608448 00000100:00100000:3.0:1746066819.212333:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17337 00000100:00100000:3.0:1746066819.212340:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3623:x1830882985608448:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.212356:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.212371:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb2581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d807b expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.212458:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.212472:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.212478:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.212505:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.212516:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 8 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.212526:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985180416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.212943:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.215024:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985180416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.215048:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066819.215203:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.215275:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.215455:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985608832 00000100:00100000:2.0:1746066819.215462:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985608832 00010000:00010000:2.0:1746066819.215490:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 9 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.215522:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9576 00000100:00100000:2.0:1746066819.215528:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985608832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.215539:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.215544:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 9 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.215555:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 9 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.215572:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfb2557 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8051 expref: 9 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.215584:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.215588:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.215597:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.215602:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.215618:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.215649:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985608832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.215655:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9576 00010000:00010000:3.0:1746066819.215750:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.215756:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.215772:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.215871:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb2581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d807b expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.215911:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d807b expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.215917:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.215920:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066819.215922:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfa00, rc 0) 00000100:00100000:3.0:1746066819.215941:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3623:x1830882985608448:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3602us (3731us total) trans 8589937838 rc 0/0 00000100:00100000:3.0:1746066819.215947:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17337 00000100:00100000:3.0:1746066819.215959:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985608704 00000100:00100000:3.0:1746066819.215962:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985608704 00000100:00100000:3.0:1746066819.215975:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17338 00000100:00100000:3.0:1746066819.215979:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3626:x1830882985608704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.215992:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.216001:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8082 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.216048:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216056:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216063:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216072:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216077:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216082:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216148:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216154:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216159:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.216164:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.216874:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216918:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216924:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216930:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216935:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecee00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.216939:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216944:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216952:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066819.216955:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.216957:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216961:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb259d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216970:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216974:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216978:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216982:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ece200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.216984:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216989:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.216994:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f700) 00010000:00010000:3.0:1746066819.216996:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.216998:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.217002:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb25a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.217033:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 17 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.217041:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 16 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.217046:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.217048:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066819.217050:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4359400, rc 0) 00000100:00100000:3.0:1746066819.217090:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3626:x1830882985608704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1109us (1888us total) trans 8589937839 rc 0/0 00000100:00100000:3.0:1746066819.217097:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17338 00000100:00100000:0.0:1746066819.217853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.218064:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985609088 00000100:00100000:3.0:1746066819.218076:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985609088 00000100:00100000:3.0:1746066819.218219:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17339 00000100:00100000:3.0:1746066819.218229:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3623:x1830882985609088:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.218253:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.218257:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066819.218280:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2588 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d807b expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.218296:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.218299:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.218312:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb25b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8089 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.218410:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218421:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218430:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218439:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218444:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218449:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218455:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095778600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.218458:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218464:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218471:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.218473:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066819.218476:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.218480:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778600/0xf1867c21abfb25c0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066819.218503:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066819.218505:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb25b9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8089 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.218513:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb25b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8089 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.218519:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779400, rc 0) 00000100:00100000:3.0:1746066819.218567:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3623:x1830882985609088:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 340us (715us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066819.218573:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17339 00000100:00100000:2.0:1746066819.219395:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985609344 00000100:00100000:2.0:1746066819.219404:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985609344 00000100:00100000:2.0:1746066819.219457:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6551 00000100:00100000:2.0:1746066819.219464:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3626:x1830882985609344:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066819.219630:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3626:x1830882985609344:12345-192.168.204.16@tcp:35:cat.0 Request processed in 165us (1126us total) trans 8589937840 rc 0/0 00000100:00100000:2.0:1746066819.219635:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6551 00000100:00100000:0.0:1746066819.223787:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.223941:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985609600 00000100:00100000:1.0:1746066819.223950:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985609600 00000100:00100000:1.0:1746066819.223999:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6552 00000100:00100000:1.0:1746066819.224006:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3623:x1830882985609600:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066819.224179:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3623:x1830882985609600:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 173us (401us total) trans 8589937841 rc 0/0 00000100:00100000:1.0:1746066819.224186:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6552 00000100:00100000:0.0:1746066819.228258:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.228521:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985609728 00000100:00100000:2.0:1746066819.228531:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985609728 00000100:00100000:2.0:1746066819.228571:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20820 00000100:00100000:2.0:1746066819.228579:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:3621:x1830882985609728:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.228594:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.228610:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8090 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.228637:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.228645:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.228651:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 50 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.228657:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.228658:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.228661:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [331776->913407] (req 331776->913407) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.228695:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 50 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.228705:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 50 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.228716:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.229843:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.229851:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 12 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.229860:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180672:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.229962:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.230006:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.230788:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985609984 00000100:00100000:3.0:1746066819.230795:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985609984 00002000:00100000:3.0:1746066819.230831:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1675263) req@ffff88006e211500 x1830882985609984/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.230841:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211500 with x1830882985609984 ext(1048576->1675263) 00002000:00010000:3.0:1746066819.230845:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211500 00000100:00100000:3.0:1746066819.230860:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985610240 00000100:00100000:3.0:1746066819.230863:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985610240 00002000:00100000:3.0:1746066819.230873:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1572864->2097151) req@ffff88006e210a80 x1830882985610240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.230879:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882985610240 ext(1572864->2097151) 00002000:00010000:3.0:1746066819.230904:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:3.0:1746066819.230922:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7894 00000100:00100000:3.0:1746066819.230929:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985609984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.231809:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7895 00000100:00100000:3.0:1746066819.231816:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985610240:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746066819.232573:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.232587:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 27 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.232603:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.233534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.233597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.233674:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985610368 00000100:00100000:3.0:1746066819.233681:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985610368 00010000:00010000:3.0:1746066819.233708:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 13 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746066819.233730:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985610496 00000100:00100000:3.0:1746066819.233732:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985610496 00010000:00010000:3.0:1746066819.233741:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 51 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746066819.233763:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9577 00000100:00100000:3.0:1746066819.233769:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985610368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.233777:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.233793:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 13 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.233804:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 13 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.233822:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.233846:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985610368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.233853:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9577 00000100:00100000:3.0:1746066819.233869:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9578 00000100:00100000:3.0:1746066819.233873:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985610496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.233901:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.233908:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 51 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.233917:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 51 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.233928:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.233941:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985610496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.233946:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9578 00000100:00100000:2.0:1746066819.234040:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066819.234064:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfb24fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8027 expref: 50 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.234079:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.234089:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83c00/0xf1867c21abfb255e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8058 expref: 12 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.234096:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.240844:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985609984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9907us (10874us total) trans 0 rc 626688/626688 00000100:00100000:3.0:1746066819.240856:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7894 00002000:00100000:3.0:1746066819.240867:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1675263) req@ffff88006e211500 x1830882985609984/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.240875:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211500 with x1830882985609984 ext(1048576->1675263) 00002000:00010000:3.0:1746066819.240880:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211500 00000100:00100000:3.0:1746066819.241734:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985610240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9917us (11727us total) trans 0 rc 524288/524288 00000100:00100000:3.0:1746066819.241739:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7895 00002000:00100000:3.0:1746066819.241743:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1572864->2097151) req@ffff88006e210a80 x1830882985610240/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 524288/524288 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.241748:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882985610240 ext(1572864->2097151) 00002000:00010000:3.0:1746066819.241750:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:2.0:1746066819.241919:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985180800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.241955:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [331776->913407] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 49 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.242005:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945c00, rc 0) 00000100:00100000:2.0:1746066819.242029:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:3621:x1830882985609728:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13452us (13778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.242035:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20820 00000100:00100000:0.0:1746066819.244826:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.244908:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985610624 00000100:00100000:1.0:1746066819.244917:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985610624 00010000:00010000:1.0:1746066819.244952:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.244979:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9579 00000100:00100000:1.0:1746066819.244986:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985610624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.244997:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.245014:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.245031:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.245050:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095dd0000/0xf1867c21abfb2462 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fd3 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.245078:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.245080:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.245087:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.245094:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.245128:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.245138:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985180928:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066819.245219:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.246197:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985180928:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066819.246214:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.246250:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985610624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1264us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.246259:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9579 00000100:00100000:0.0:1746066819.246545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.246979:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985610880 00000100:00100000:3.0:1746066819.246985:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985610880 00002000:00100000:3.0:1746066819.247016:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->335871) req@ffff88006e211f80 x1830882985610880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.247026:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211f80 with x1830882985610880 ext(331776->335871) 00002000:00010000:3.0:1746066819.247030:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e211f80 00000100:00100000:3.0:1746066819.247054:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7896 00000100:00100000:3.0:1746066819.247060:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985610880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.247171:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985610880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (631us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.247176:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7896 00002000:00100000:3.0:1746066819.247181:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->335871) req@ffff88006e211f80 x1830882985610880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.247188:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211f80 with x1830882985610880 ext(331776->335871) 00002000:00010000:3.0:1746066819.247190:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e211f80 00000100:00100000:0.0:1746066819.250693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.251061:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985611008 00000100:00100000:2.0:1746066819.251072:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985611008 00000100:00100000:2.0:1746066819.251136:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20821 00000100:00100000:2.0:1746066819.251143:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985611008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.251159:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.251173:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5e200/0xf1867c21abfb25ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8097 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.251217:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985181056:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066819.251328:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05600 going to sleep for 11 seconds 00002000:00010000:2.0:1746066819.254541:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066819 -> 1746066820 00002000:00010000:2.0:1746066819.254548:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066819 -> 1746066820 00002000:00010000:2.0:1746066819.254550:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066819 -> 1746066820 00000100:00100000:2.0:1746066819.254568:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985181056:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066819.254599:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e200/0xf1867c21abfb25ce lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8097 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.254611:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e200/0xf1867c21abfb25ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8097 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.254643:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5e200, rc 0) 00000100:00100000:2.0:1746066819.254695:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985611008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3552us (4010us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066819.254702:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20821 00000100:00100000:0.0:1746066819.256975:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.257063:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985611264 00000100:00100000:3.0:1746066819.257074:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985611264 00000100:00100000:3.0:1746066819.257143:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17340 00000100:00100000:3.0:1746066819.257150:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3630:x1830882985611264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.257172:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.257188:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb25d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d809e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.257250:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257265:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257274:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257285:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257290:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257295:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257392:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257401:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257406:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.257414:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.257473:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257478:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257484:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257489:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257494:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf57000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.257498:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257504:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257512:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066819.257515:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.257518:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257522:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57000/0xf1867c21abfb25dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257550:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257555:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257559:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257564:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf57600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.257566:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257570:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257576:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f500) 00010000:00010000:3.0:1746066819.257578:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.257581:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257585:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb25e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.257617:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb25d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.257627:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 37 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.257632:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.257634:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066819.257636:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57a00, rc 0) 00000100:00100000:3.0:1746066819.257695:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3630:x1830882985611264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 544us (730us total) trans 8589937842 rc 0/0 00000100:00100000:3.0:1746066819.257700:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17340 00000100:00100000:0.0:1746066819.259232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.259276:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.259305:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985611520 00000100:00100000:3.0:1746066819.259315:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985611520 00002000:00100000:3.0:1746066819.259360:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (909312->913407) req@ffff88006e213b80 x1830882985611520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.259369:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213b80 with x1830882985611520 ext(909312->913407) 00002000:00010000:3.0:1746066819.259373:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e213b80 00000100:00100000:3.0:1746066819.259406:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7897 00000100:00100000:3.0:1746066819.259413:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985611520:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.259542:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985611520:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 129us (316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.259551:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7897 00002000:00100000:3.0:1746066819.259556:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (909312->913407) req@ffff88006e213b80 x1830882985611520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.259563:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213b80 with x1830882985611520 ext(909312->913407) 00002000:00010000:3.0:1746066819.259566:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e213b80 00000100:00100000:1.0:1746066819.259853:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.259982:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985611904 00000100:00100000:3.0:1746066819.259986:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985611904 00000100:00100000:3.0:1746066819.260006:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6553 00000100:00100000:3.0:1746066819.260011:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:3630:x1830882985611904:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066819.260129:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:3630:x1830882985611904:12345-192.168.204.16@tcp:35:cat.0 Request processed in 117us (277us total) trans 8589937843 rc 0/0 00000100:00100000:3.0:1746066819.260134:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6553 00000100:00100000:2.0:1746066819.260251:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985611648 00000100:00100000:2.0:1746066819.260256:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985611648 00000100:00100000:2.0:1746066819.260279:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20822 00000100:00100000:2.0:1746066819.260284:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985611648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.260293:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.260305:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb25f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80a5 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.260356:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985181184:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066819.260401:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.262597:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985181184:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066819.262625:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb25f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80a5 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.262636:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb25f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80a5 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.263344:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5e000, rc 0) 00000100:00100000:2.0:1746066819.263405:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985611648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3118us (4127us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066819.263412:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20822 00000100:00100000:1.0:1746066819.263733:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.263797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.263841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.263860:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612416 00000100:00100000:1.0:1746066819.263865:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612416 00000100:00100000:1.0:1746066819.263925:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6554 00000100:00100000:1.0:1746066819.263935:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3621:x1830882985612416:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066819.263961:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612032 00000100:00100000:3.0:1746066819.263965:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612032 00000100:00100000:3.0:1746066819.263983:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612160 00000100:00100000:3.0:1746066819.263984:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612160 00000100:00100000:3.0:1746066819.263997:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20823 00000100:00100000:3.0:1746066819.264002:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985612032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.264011:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.264023:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb25ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80ac expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.264060:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985181312:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066819.264089:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3621:x1830882985612416:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 154us (247us total) trans 8589937844 rc 0/0 00000100:00100000:1.0:1746066819.264094:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6554 00000100:00100000:3.0:1746066819.264112:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.264130:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20824 00000100:00100000:3.0:1746066819.264136:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985612160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.264142:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.264148:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2606 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80b3 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.264168:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985181440:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066819.264185:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.265172:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.265214:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612544 00000100:00100000:2.0:1746066819.265218:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612544 00000100:00100000:2.0:1746066819.265257:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20825 00000100:00100000:2.0:1746066819.265262:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985612544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.265272:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.265283:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5ee00/0xf1867c21abfb260d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80ba expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.265313:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985181568:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066819.265384:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.266481:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985181312:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066819.266502:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb25ff lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80ac expref: 30 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.266517:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf56400/0xf1867c21abfb25ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80ac expref: 30 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.266531:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56400, rc 0) 00000100:00100000:3.0:1746066819.266558:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985612032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2555us (2825us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066819.266563:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20823 00000100:00100000:2.0:1746066819.266781:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985181440:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066819.266799:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2606 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80b3 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.266808:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2606 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80b3 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.266819:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56a00, rc 0) 00000100:00100000:2.0:1746066819.266854:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985612160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2717us (3055us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066819.266860:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20824 00000100:00100000:2.0:1746066819.267740:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985181568:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066819.267759:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5ee00/0xf1867c21abfb260d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80ba expref: 28 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.267768:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5ee00/0xf1867c21abfb260d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80ba expref: 28 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.267775:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5ee00, rc 0) 00000100:00100000:2.0:1746066819.267925:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985612544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2661us (2755us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066819.267931:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20825 00000100:00100000:1.0:1746066819.270534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.271370:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612800 00000100:00100000:0.0:1746066819.271379:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612800 00002000:00100000:0.0:1746066819.271422:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800986cf100 x1830882985612800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 504/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.271432:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cf100 with x1830882985612800 ext(0->1048575) 00002000:00010000:0.0:1746066819.271437:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cf100 00000100:00100000:0.0:1746066819.271475:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7898 00000100:00100000:0.0:1746066819.271482:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882985612800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066819.276100:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882985612800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4609us (5565us total) trans 0 rc 466944/466944 00000100:00100000:2.0:1746066819.276111:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7898 00002000:00100000:2.0:1746066819.276122:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800986cf100 x1830882985612800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 504/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.276135:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cf100 with x1830882985612800 ext(0->1048575) 00002000:00010000:2.0:1746066819.276140:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cf100 00000100:00100000:0.0:1746066819.280518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.280906:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985612928 00000100:00100000:2.0:1746066819.280914:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985612928 00000100:00100000:2.0:1746066819.280953:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20826 00000100:00100000:2.0:1746066819.280959:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+27:3630:x1830882985612928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.280975:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.280989:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80c1 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.281013:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.281019:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.281021:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.281024:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.281048:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.281058:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 18 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.281068:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985181696:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.282179:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.284161:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.284504:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613056 00000100:00100000:3.0:1746066819.284513:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613056 00002000:00100000:3.0:1746066819.284547:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->2097151) req@ffff88006e210380 x1830882985613056/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.284556:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210380 with x1830882985613056 ext(1675264->2097151) 00010000:00010000:3.0:1746066819.284564:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.284581:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.284586:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e210380 00000100:00100000:3.0:1746066819.284605:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2254 00000100:00100000:3.0:1746066819.284612:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985613056:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066819.284676:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985181696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.284699:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.284717:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5ec00, rc 0) 00000100:00100000:2.0:1746066819.284740:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:3630:x1830882985612928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3780us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.284746:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20826 00000100:00100000:3.0:1746066819.291614:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985613056:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6990us (7446us total) trans 21474842803 rc 0/0 00000100:00100000:3.0:1746066819.291627:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2254 00002000:00100000:3.0:1746066819.291640:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->2097151) req@ffff88006e210380 x1830882985613056/t21474842803(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.291649:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210380 with x1830882985613056 ext(1675264->2097151) 00010000:00010000:3.0:1746066819.291659:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.291676:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.291683:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e210380 00000100:00100000:0.0:1746066819.297170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.297216:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613184 00000100:00100000:1.0:1746066819.297224:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613184 00010000:00010000:1.0:1746066819.297258:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.297299:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9580 00000100:00100000:1.0:1746066819.297306:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985613184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.297328:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.297347:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.297357:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.297376:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfb2511 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d803c expref: 21 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.297710:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.297713:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.297720:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 27 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.297729:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 27 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.297758:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 27 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.297769:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985181824:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066819.297844:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.299201:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985181824:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066819.299218:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.299257:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985613184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1950us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.299266:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9580 00000100:00100000:0.0:1746066819.300861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.301045:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613440 00000100:00100000:3.0:1746066819.301056:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613440 00002000:00100000:3.0:1746066819.301109:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012b54c380 x1830882985613440/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.301119:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c380 with x1830882985613440 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.301126:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c380 00000100:00100000:3.0:1746066819.301162:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7899 00000100:00100000:3.0:1746066819.301170:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985613440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.307698:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985613440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6515us (6826us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.307711:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7899 00002000:00100000:3.0:1746066819.307725:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012b54c380 x1830882985613440/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.307734:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c380 with x1830882985613440 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.307741:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c380 00000100:00100000:0.0:1746066819.315056:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.315154:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613568 00000100:00100000:2.0:1746066819.315162:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613568 00000100:00100000:2.0:1746066819.315201:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20827 00000100:00100000:2.0:1746066819.315207:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:3630:x1830882985613568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.315221:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.315235:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80c8 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.315261:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.315268:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.315270:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.315273:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.315298:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.315309:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 19 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.315338:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985181952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.315723:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.317832:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985181952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.317855:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.317868:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5fc00, rc 0) 00000100:00100000:2.0:1746066819.317932:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+29:3630:x1830882985613568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2724us (2882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.317939:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20827 00000100:00100000:0.0:1746066819.319389:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.319449:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613696 00000100:00100000:3.0:1746066819.319457:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613696 00002000:00100000:3.0:1746066819.319487:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1572863) req@ffff88012b54fb80 x1830882985613696/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.319495:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54fb80 with x1830882985613696 ext(1048576->1572863) 00010000:00010000:3.0:1746066819.319501:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 20 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.319512:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 20 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.319519:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b54fb80 00000100:00100000:3.0:1746066819.319541:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2255 00000100:00100000:3.0:1746066819.319547:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985613696:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066819.327031:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985613696:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7472us (7633us total) trans 21474842804 rc 0/0 00000100:00100000:3.0:1746066819.327043:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2255 00002000:00100000:3.0:1746066819.327054:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1572863) req@ffff88012b54fb80 x1830882985613696/t21474842804(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.327063:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54fb80 with x1830882985613696 ext(1048576->1572863) 00010000:00010000:3.0:1746066819.327073:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.327088:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.327095:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b54fb80 00000100:00100000:1.0:1746066819.341551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.341696:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985613824 00000100:00100000:0.0:1746066819.341706:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985613824 00010000:00010000:0.0:1746066819.341737:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.342391:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9581 00000100:00100000:0.0:1746066819.342400:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985613824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.342411:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.342429:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.342440:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.342459:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb2518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8043 expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.342485:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.342487:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.342492:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.342499:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.342528:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.342538:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985182080:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066819.342618:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.345559:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985182080:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.345583:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.345640:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985613824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3241us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.345650:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9581 00000100:00100000:0.0:1746066819.346105:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.346226:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614080 00000100:00100000:3.0:1746066819.346232:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614080 00002000:00100000:3.0:1746066819.346265:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012b54e680 x1830882985614080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.346275:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54e680 with x1830882985614080 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.346278:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54e680 00000100:00100000:3.0:1746066819.346293:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7900 00000100:00100000:3.0:1746066819.346298:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985614080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.355590:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985614080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9278us (9474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.355601:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7900 00002000:00100000:3.0:1746066819.355613:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012b54e680 x1830882985614080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.355629:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54e680 with x1830882985614080 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.355634:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54e680 00000100:00100000:0.0:1746066819.391308:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.391406:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614336 00000100:00100000:3.0:1746066819.391417:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614336 00000100:00100000:3.0:1746066819.391484:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17341 00000100:00100000:3.0:1746066819.391493:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3635:x1830882985614336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066819.391521:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.391540:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfb2622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80cf expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.391617:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391632:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391643:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391654:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391659:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391663:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391758:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391770:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391775:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.391783:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.391852:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391858:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391863:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391868:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391873:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.391876:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391925:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391936:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066819.391938:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.391942:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391947:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391966:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391971:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391975:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391978:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576b400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066819.391980:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391984:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391989:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfdf00) 00010000:00010000:3.0:1746066819.391992:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066819.391994:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.391998:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.392032:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfb2622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.392042:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.392048:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.392050:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066819.392052:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56a00, rc 0) 00000100:00100000:3.0:1746066819.392107:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3635:x1830882985614336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 616us (807us total) trans 8589937845 rc 0/0 00000100:00100000:3.0:1746066819.392114:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17341 00000100:00100000:0.0:1746066819.409735:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.409975:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614464 00000100:00100000:2.0:1746066819.409984:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614464 00000100:00100000:2.0:1746066819.410033:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20828 00000100:00100000:2.0:1746066819.410041:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3635:x1830882985614464:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.410056:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.410070:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80d6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410096:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410105:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.410112:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.410119:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410125:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.410126:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.410130:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 7/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2875392->3145727] (req 2875392->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410154:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410166:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.410177:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.410271:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.410279:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 28 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.410287:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182336:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.410312:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.410330:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 8 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.410338:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.410499:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.410507:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 22 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.410514:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.410526:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.412293:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.412304:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.412310:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.412330:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985182592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.412360:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2875392->3145727] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.412378:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5f600, rc 0) 00000100:00100000:2.0:1746066819.412836:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3635:x1830882985614464:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2794us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.412843:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20828 00000100:00100000:0.0:1746066819.414142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.414409:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614592 00000100:00100000:2.0:1746066819.414416:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614592 00010000:00010000:2.0:1746066819.414442:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 9 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.414479:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9582 00000100:00100000:2.0:1746066819.414486:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985614592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.414496:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.414512:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 9 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.414522:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 9 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.414541:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83600/0xf1867c21abfb256c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8074 expref: 9 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.414571:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.414598:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985614592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.414605:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9582 00000100:00100000:0.0:1746066819.416394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.416490:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.416629:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614720 00000100:00100000:2.0:1746066819.416637:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614720 00010000:00010000:2.0:1746066819.416666:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.416706:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614848 00000100:00100000:2.0:1746066819.416708:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614848 00010000:00010000:2.0:1746066819.416718:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.416733:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9583 00000100:00100000:2.0:1746066819.416739:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985614720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.416759:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.416775:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.416784:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.416799:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb24b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d800b expref: 22 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.416812:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.416863:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985614720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.416870:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9583 00000100:00100000:2.0:1746066819.416912:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9584 00000100:00100000:2.0:1746066819.416917:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985614848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.416924:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.416930:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.416937:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.416947:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0d200/0xf1867c21abfb250a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8035 expref: 29 pid: 9590 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.416954:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.416967:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985614848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.416971:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9584 00000100:00100000:0.0:1746066819.417630:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.417707:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985614976 00000100:00100000:2.0:1746066819.417711:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985614976 00010000:00010000:2.0:1746066819.417725:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 21 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.417790:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9585 00000100:00100000:2.0:1746066819.417797:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985614976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.417803:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.417812:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 21 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.417820:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 21 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.417832:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb24bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8012 expref: 21 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.417841:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.417843:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.417848:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.417856:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.417881:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.417926:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985182720:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.417990:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.419281:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985182720:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.419304:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.419348:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985614976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1551us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.419355:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9585 00000100:00100000:0.0:1746066819.419701:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.419768:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985615232 00000100:00100000:3.0:1746066819.419772:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985615232 00002000:00100000:3.0:1746066819.419799:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->2879487) req@ffff8800966e2300 x1830882985615232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.419807:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985615232 ext(2875392->2879487) 00002000:00010000:3.0:1746066819.419810:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:3.0:1746066819.419824:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7901 00000100:00100000:3.0:1746066819.419829:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985615232:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.419946:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985615232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 116us (245us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.419951:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7901 00002000:00100000:3.0:1746066819.419956:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->2879487) req@ffff8800966e2300 x1830882985615232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.419962:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985615232 ext(2875392->2879487) 00002000:00010000:3.0:1746066819.419965:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:0.0:1746066819.423364:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.423446:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985615360 00000100:00100000:2.0:1746066819.423454:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985615360 00000100:00100000:2.0:1746066819.423493:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20829 00000100:00100000:2.0:1746066819.423500:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3635:x1830882985615360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.423521:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.423536:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80dd expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423560:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423568:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.423573:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423578:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.423580:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.423586:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423611:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423621:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.423632:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985182848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.423729:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.423740:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 11 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.423747:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985182976:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.423776:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.423784:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 48 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.423791:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985183104:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.423808:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.425485:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985182848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.425494:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985182976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.425499:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985183104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.425520:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.425529:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5e000, rc 0) 00000100:00100000:2.0:1746066819.425562:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3635:x1830882985615360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2062us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.425568:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20829 00000100:00100000:0.0:1746066819.429831:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.430115:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985615488 00000100:00100000:2.0:1746066819.430125:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985615488 00010000:00010000:2.0:1746066819.430162:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 12 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.430216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.430343:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985615616 00000100:00100000:2.0:1746066819.430346:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985615616 00010000:00010000:2.0:1746066819.430361:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.430390:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9586 00000100:00100000:3.0:1746066819.430434:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985615488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.430448:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066819.430508:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9587 00000100:00100000:2.0:1746066819.430515:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985615616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.430525:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.430539:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.430601:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.430612:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 12 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.430625:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 12 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.430625:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb2485 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7ff6 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.430635:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb257a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d806d expref: 12 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.430652:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.430762:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.430877:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985615616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 362us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.430907:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9587 00000100:00100000:3.0:1746066819.430979:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985615488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 548us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.430984:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9586 00000100:00100000:2.0:1746066819.431200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.431420:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985615744 00000100:00100000:3.0:1746066819.431424:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985615744 00010000:00010000:3.0:1746066819.431439:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 49 pid: 12233 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.431452:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9588 00000100:00100000:3.0:1746066819.431457:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985615744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.431463:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.431469:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 49 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.431477:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 49 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.431488:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfb2407 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4861951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f94 expref: 49 pid: 12233 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.431498:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.431499:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.431505:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.431514:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.431545:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.431556:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985183232:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066819.431755:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.433143:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985183232:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066819.433158:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.433192:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985615744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1734us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.433200:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9588 00000100:00100000:0.0:1746066819.433637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.433679:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616000 00000100:00100000:3.0:1746066819.433684:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616000 00002000:00100000:3.0:1746066819.433714:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3227648->3231743) req@ffff8800966e0a80 x1830882985616000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.433724:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882985616000 ext(3227648->3231743) 00002000:00010000:3.0:1746066819.433729:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:3.0:1746066819.433753:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7902 00000100:00100000:3.0:1746066819.433759:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985616000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.433880:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985616000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 119us (243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.433910:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7902 00002000:00100000:3.0:1746066819.433914:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3227648->3231743) req@ffff8800966e0a80 x1830882985616000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.433922:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882985616000 ext(3227648->3231743) 00002000:00010000:3.0:1746066819.433924:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:0.0:1746066819.436129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.436256:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616256 00000100:00100000:1.0:1746066819.436270:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616256 00000100:00100000:3.0:1746066819.436387:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6555 00000100:00100000:3.0:1746066819.436397:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3635:x1830882985616256:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066819.437049:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3635:x1830882985616256:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 653us (926us total) trans 8589937846 rc 0/0 00000100:00100000:3.0:1746066819.437056:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6555 00000100:00100000:0.0:1746066819.482805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.482922:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616512 00000100:00100000:3.0:1746066819.482931:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616512 00000100:00100000:3.0:1746066819.482994:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17342 00000100:00100000:3.0:1746066819.483003:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3638:x1830882985616512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066819.483028:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.483048:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb2653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80e4 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.483170:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.483184:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.483193:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.483198:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.483228:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.483239:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 19 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.483251:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985183360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.483363:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.483370:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 40 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.483377:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985183488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.483395:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.487760:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.487878:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985183360:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.488002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.488226:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985183488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.488253:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066819.489069:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616640 00000100:00100000:2.0:1746066819.489077:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616640 00010000:00010000:2.0:1746066819.489112:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 20 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.489146:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616768 00000100:00100000:2.0:1746066819.489149:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616768 00010000:00010000:2.0:1746066819.489160:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.489183:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9589 00000100:00100000:2.0:1746066819.489191:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985616640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.489205:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.489212:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 20 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.489222:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 20 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.489233:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9590 00010000:00010000:2.0:1746066819.489245:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb2637 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80cf expref: 20 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.489247:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985616768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.489256:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.489261:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.489270:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.489275:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.489283:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.489288:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066819.489292:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.489306:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb25ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d809e expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.489330:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066819.489333:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.489339:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066819.489343:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985616640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (1594us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066819.489344:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066819.489350:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9589 00010000:00010000:0.0:1746066819.489378:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.489392:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985616768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (1391us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066819.489420:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.489425:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.489443:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000100:00100000:0.0:1746066819.489486:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9590 00010000:00010000:3.0:1746066819.489701:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb2653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.489722:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.489728:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.489730:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066819.489732:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57200, rc 0) 00000100:00100000:3.0:1746066819.489759:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3638:x1830882985616512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6758us (6966us total) trans 8589937847 rc 0/0 00000100:00100000:3.0:1746066819.489764:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17342 00000100:00100000:0.0:1746066819.493581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.493620:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.493652:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985616896 00000100:00100000:0.0:1746066819.493654:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.493661:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985616896 00000100:00100000:1.0:1746066819.493682:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617024 00000100:00100000:1.0:1746066819.493686:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617024 00000100:00100000:2.0:1746066819.493696:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617152 00000100:00100000:2.0:1746066819.493697:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617152 00000100:00100000:1.0:1746066819.493776:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20830 00000100:00100000:2.0:1746066819.493782:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20831 00000100:00100000:1.0:1746066819.493785:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985616896:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066819.493789:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985617024:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066819.493790:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20832 00010000:00010000:2.0:1746066819.493798:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.493798:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066819.493802:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985617152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.493810:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80f2 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.493810:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb266f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80eb expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.493815:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.493826:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.493828:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d80f9 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.493828:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.493833:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 22 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.493844:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 23 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.493848:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.493850:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.493850:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5ea00, rc 0) 00000100:00100000:1.0:1746066819.493851:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985183616:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066819.493858:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.493871:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.493880:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a400, rc 0) 00000100:00100000:2.0:1746066819.493920:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985617024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.493925:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20831 00000100:00100000:1.0:1746066819.493936:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.493937:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985617152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 139us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.493943:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20832 00000100:00100000:1.0:1746066819.496039:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985183616:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066819.496059:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb266f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80eb expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.496070:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb266f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80eb expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.496091:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ac00, rc 0) 00000100:00100000:1.0:1746066819.496124:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985616896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2340us (2554us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066819.496129:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20830 00000100:00100000:0.0:1746066819.502175:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.502525:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617280 00000100:00100000:1.0:1746066819.502533:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617280 00000100:00100000:1.0:1746066819.502612:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20833 00000100:00100000:1.0:1746066819.502620:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3641:x1830882985617280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066819.502640:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.502656:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8100 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.502685:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.502692:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066819.502694:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066819.502697:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.502724:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.502734:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 47 pid: 20361 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.502750:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985183744:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.503239:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.504630:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985183744:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.504654:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.504668:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:1.0:1746066819.504696:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3641:x1830882985617280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2076us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.504702:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20833 00000100:00100000:0.0:1746066819.506275:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.506370:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617408 00000100:00100000:2.0:1746066819.506377:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617408 00002000:00100000:2.0:1746066819.506476:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->913407) req@ffff880098fbe300 x1830882985617408/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.506494:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882985617408 ext(331776->913407) 00010000:00010000:2.0:1746066819.506502:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 48 pid: 20361 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.506515:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 48 pid: 20361 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066819.506521:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbe300 00000100:00100000:2.0:1746066819.506553:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2256 00000100:00100000:2.0:1746066819.506560:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985617408:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066819.516040:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985617408:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9465us (9757us total) trans 17179875463 rc 0/0 00000100:00100000:2.0:1746066819.516055:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2256 00002000:00100000:2.0:1746066819.516072:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (331776->913407) req@ffff880098fbe300 x1830882985617408/t17179875463(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.516082:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882985617408 ext(331776->913407) 00010000:00010000:2.0:1746066819.516094:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.516111:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066819.516119:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbe300 00000100:00100000:0.0:1746066819.519343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.519487:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617536 00000100:00100000:2.0:1746066819.519498:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617536 00010000:00010000:2.0:1746066819.519542:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.519603:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9591 00000100:00100000:2.0:1746066819.519613:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985617536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.519630:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.519655:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.519668:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.519694:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfb25c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->913407) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8090 expref: 50 pid: 20361 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.519743:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.519746:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.519756:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.519765:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.519804:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.519819:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985183872:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.520705:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.526667:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985183872:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.526692:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.526758:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985617536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7146us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.526770:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9591 00000100:00100000:0.0:1746066819.531491:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.531548:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.533057:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.533381:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985617792 00000100:00100000:2.0:1746066819.533393:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985617792 00002000:00100000:2.0:1746066819.533442:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098fbd180 x1830882985617792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.533452:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882985617792 ext(0->1048575) 00002000:00010000:2.0:1746066819.533457:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:2.0:1746066819.533582:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618048 00000100:00100000:2.0:1746066819.533586:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618048 00002000:00100000:2.0:1746066819.533600:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbdf80 x1830882985618048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.533606:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdf80 with x1830882985618048 ext(1048576->2097151) 00000100:00100000:3.0:1746066819.533609:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7903 00002000:00010000:2.0:1746066819.533609:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdf80 00000100:00100000:3.0:1746066819.533628:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985617792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066819.533641:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7904 00000100:00100000:2.0:1746066819.533648:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985618048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066819.534215:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618304 00000100:00100000:1.0:1746066819.534219:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618304 00002000:00100000:1.0:1746066819.534235:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880098fbed80 x1830882985618304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066819.534241:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbed80 with x1830882985618304 ext(1048576->2097151) 00002000:00010000:1.0:1746066819.534244:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbed80 00000100:00100000:1.0:1746066819.534265:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7905 00000100:00100000:1.0:1746066819.534270:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985618304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.553304:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985618048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19643us (21743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.553327:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7904 00002000:00100000:3.0:1746066819.553339:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbdf80 x1830882985618048/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.553348:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdf80 with x1830882985618048 ext(1048576->2097151) 00002000:00010000:3.0:1746066819.553355:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdf80 00000100:00100000:3.0:1746066819.553947:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985617792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20326us (22467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.553953:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7903 00002000:00100000:3.0:1746066819.553958:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098fbd180 x1830882985617792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.553965:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882985617792 ext(0->1048575) 00002000:00010000:3.0:1746066819.553969:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:0.0:1746066819.555071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.555223:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618432 00000100:00100000:1.0:1746066819.555231:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618432 00000100:00100000:1.0:1746066819.555279:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20834 00000100:00100000:1.0:1746066819.555287:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:3638:x1830882985618432:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066819.555303:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.555333:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8107 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.555361:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 27 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.555368:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066819.555370:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066819.555373:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3747840->4194303] (req 3747840->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 50 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.555379:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985618304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21109us (22327us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066819.555385:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7905 00002000:00100000:0.0:1746066819.555391:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880098fbed80 x1830882985618304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.555398:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbed80 with x1830882985618304 ext(1048576->2097151) 00010000:00010000:1.0:1746066819.555402:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 27 pid: 13726 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066819.555402:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbed80 00010000:00010000:1.0:1746066819.555413:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 27 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.555424:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985184000:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.555486:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.556744:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800986cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985184000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.556767:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3747840->4194303] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 50 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.556780:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b000, rc 0) 00000100:00100000:1.0:1746066819.556823:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+50:3638:x1830882985618432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1536us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.556829:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20834 00000100:00100000:0.0:1746066819.559122:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.559359:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618560 00000100:00100000:2.0:1746066819.559368:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618560 00002000:00100000:2.0:1746066819.559414:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3231743) req@ffff880098fbd500 x1830882985618560/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.559425:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882985618560 ext(3145728->3231743) 00010000:00010000:2.0:1746066819.559435:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 28 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.559449:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 28 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066819.559456:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd500 00000100:00100000:2.0:1746066819.559874:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2257 00000100:00100000:2.0:1746066819.559919:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985618560:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066819.563160:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.563421:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618816 00000100:00100000:3.0:1746066819.563431:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618816 00000100:00100000:3.0:1746066819.563493:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17343 00000100:00100000:3.0:1746066819.563502:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3644:x1830882985618816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066819.563533:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.563554:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb268b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d810e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.563673:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.563688:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.563699:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.563710:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.563825:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb268b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.563854:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.563862:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.563864:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066819.563868:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46000, rc 0) 00000100:00100000:3.0:1746066819.563966:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3644:x1830882985618816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 464us (818us total) trans 8589937848 rc 0/0 00000100:00100000:3.0:1746066819.563975:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17343 00000100:00100000:1.0:1746066819.565332:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.565386:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985618944 00000100:00100000:2.0:1746066819.565391:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985618944 00000100:00100000:2.0:1746066819.565432:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20835 00000100:00100000:2.0:1746066819.565440:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3641:x1830882985618944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.565451:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.565466:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8115 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.565487:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.565490:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.565493:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.565504:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.565515:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:2.0:1746066819.565545:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3641:x1830882985618944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.565552:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20835 00000100:00100000:2.0:1746066819.566671:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985618560:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6785us (7554us total) trans 17179875464 rc 0/0 00000100:00100000:2.0:1746066819.566681:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2257 00002000:00100000:2.0:1746066819.566690:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3231743) req@ffff880098fbd500 x1830882985618560/t17179875464(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.566699:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882985618560 ext(3145728->3231743) 00010000:00010000:2.0:1746066819.566705:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.566715:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066819.566720:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd500 00000100:00100000:0.0:1746066819.569052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.569259:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619072 00000100:00100000:2.0:1746066819.569271:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619072 00010000:00010000:2.0:1746066819.569327:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.569438:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9592 00000100:00100000:2.0:1746066819.569449:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985619072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.569467:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066819.569486:0:11928:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066819 -> 1746066820 00002000:00010000:2.0:1746066819.569489:0:11928:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066819 -> 1746066820 00010000:00010000:2.0:1746066819.569496:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.569510:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.569536:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e000/0xf1867c21abfb264c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80dd expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.569780:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.569783:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.569793:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 49 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.569802:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 49 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.569812:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.569813:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.569817:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.569824:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.569861:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.569876:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985184128:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.570420:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 49 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.570431:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985184256:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.570463:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.591326:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.591365:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.591388:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.591409:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619200 00000100:00100000:3.0:1746066819.591419:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619200 00000100:00100000:2.0:1746066819.591449:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619456 00000100:00100000:2.0:1746066819.591461:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619456 00000100:00100000:3.0:1746066819.591474:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619328 00000100:00100000:3.0:1746066819.591477:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619328 00000100:00100000:0.0:1746066819.591481:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20836 00000100:00100000:0.0:1746066819.591491:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985619200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.591511:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.591529:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d811c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.591546:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20837 00000100:00100000:3.0:1746066819.591554:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985619328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.591557:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.591559:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.591561:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.591567:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 52 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.591569:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8123 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.591582:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 53 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.591592:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9000, rc 0) 00000100:00100000:3.0:1746066819.591609:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985184384:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066819.591632:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985619200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.591638:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20836 00000100:00100000:3.0:1746066819.591655:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.591658:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20838 00000100:00100000:0.0:1746066819.591662:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985619456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.591669:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.591678:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb26b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d812a expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.591701:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985184512:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066819.591721:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.591751:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985184128:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066819.591760:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985184256:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066819.591776:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.591798:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985619072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 22352us (22758us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.591807:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9592 00000100:00100000:0.0:1746066819.592805:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.592968:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619712 00000100:00100000:2.0:1746066819.592973:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619712 00002000:00100000:2.0:1746066819.593001:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->3751935) req@ffff880098924700 x1830882985619712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.593010:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882985619712 ext(3747840->3751935) 00002000:00010000:2.0:1746066819.593014:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924700 00000100:00100000:2.0:1746066819.593032:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7906 00000100:00100000:2.0:1746066819.593036:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+53:2013:x1830882985619712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066819.593963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.594022:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066819.594076:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066819 -> 1746066820 00002000:00010000:0.0:1746066819.594079:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066819 -> 1746066820 00002000:00010000:0.0:1746066819.594081:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066819 -> 1746066820 00000100:00100000:0.0:1746066819.594093:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985184512:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066819.594117:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb26b5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d812a expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.594128:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfb26b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d812a expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.594140:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9e00, rc 0) 00000100:00100000:0.0:1746066819.594156:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985619456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2494us (2792us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066819.594163:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20838 00002000:00010000:0.0:1746066819.594233:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066819 -> 1746066820 00000100:00100000:0.0:1746066819.594240:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985184384:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066819.594254:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8123 expref: 53 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.594262:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8123 expref: 53 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.594268:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:0.0:1746066819.594286:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985619328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2733us (2898us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066819.594291:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20837 00000100:00100000:0.0:1746066819.594336:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985619968 00000100:00100000:0.0:1746066819.594339:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985619968 00000100:00100000:2.0:1746066819.594343:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882985619712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 918us (1151us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066819.594351:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7906 00002000:00100000:2.0:1746066819.594357:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->3751935) req@ffff880098924700 x1830882985619712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.594358:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d27480 x1830882985619968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.594365:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882985619712 ext(3747840->3751935) 00002000:00100000:0.0:1746066819.594365:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27480 with x1830882985619968 ext(2097152->3145727) 00002000:00010000:0.0:1746066819.594368:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d27480 00002000:00010000:2.0:1746066819.594369:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924700 00000100:00100000:2.0:1746066819.594379:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620224 00000100:00100000:2.0:1746066819.594382:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620224 00000100:00100000:0.0:1746066819.594384:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7907 00000100:00100000:0.0:1746066819.594388:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985619968:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066819.594393:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2875391) req@ffff8800a4d27b80 x1830882985620224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.594400:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27b80 with x1830882985620224 ext(2097152->2875391) 00002000:00010000:2.0:1746066819.594403:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27b80 00000100:00100000:2.0:1746066819.594424:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7908 00000100:00100000:2.0:1746066819.594429:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985620224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066819.600935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.601002:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620480 00000100:00100000:3.0:1746066819.601012:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620480 00002000:00100000:3.0:1746066819.601054:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a4d24700 x1830882985620480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.601064:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24700 with x1830882985620480 ext(0->1048575) 00002000:00010000:3.0:1746066819.601070:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24700 00000100:00100000:3.0:1746066819.601091:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7909 00000100:00100000:3.0:1746066819.601099:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985620480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066819.601352:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985620224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6914us (7321us total) trans 0 rc 778240/778240 00000100:00100000:2.0:1746066819.601364:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7908 00002000:00100000:2.0:1746066819.601375:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2875391) req@ffff8800a4d27b80 x1830882985620224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.601383:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27b80 with x1830882985620224 ext(2097152->2875391) 00002000:00010000:2.0:1746066819.601389:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27b80 00000100:00100000:2.0:1746066819.602166:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985619968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7776us (8202us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.602172:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7907 00002000:00100000:2.0:1746066819.602277:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d27480 x1830882985619968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.602284:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27480 with x1830882985619968 ext(2097152->3145727) 00002000:00010000:2.0:1746066819.602288:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d27480 00000100:00100000:0.0:1746066819.605725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.605823:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620608 00000100:00100000:2.0:1746066819.605832:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620608 00000100:00100000:2.0:1746066819.605871:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20839 00000100:00100000:2.0:1746066819.605877:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:3638:x1830882985620608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066819.605924:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.605942:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8131 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.605973:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.605979:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.605981:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.605983:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.606009:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.606017:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 21 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.606026:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985184640:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.606116:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.607591:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.607687:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985184640:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.607713:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.607728:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3a00, rc 0) 00000100:00100000:2.0:1746066819.607761:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:3638:x1830882985620608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1884us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.607770:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20839 00000100:00100000:2.0:1746066819.607799:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620736 00000100:00100000:2.0:1746066819.607804:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620736 00002000:00100000:2.0:1746066819.607827:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->3145727) req@ffff8800a4d24a80 x1830882985620736/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.607835:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24a80 with x1830882985620736 ext(2875392->3145727) 00010000:00010000:2.0:1746066819.607840:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 22 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.607850:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 22 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746066819.607855:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d24a80 00000100:00100000:2.0:1746066819.607867:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2258 00000100:00100000:2.0:1746066819.607873:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985620736:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066819.608085:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985620480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6986us (7213us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.608091:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7909 00002000:00100000:3.0:1746066819.608096:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a4d24700 x1830882985620480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.608105:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24700 with x1830882985620480 ext(0->1048575) 00002000:00010000:3.0:1746066819.608108:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24700 00000100:00100000:0.0:1746066819.608701:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.608823:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620864 00000100:00100000:2.0:1746066819.608826:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620864 00000100:00100000:2.0:1746066819.608845:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20840 00000100:00100000:2.0:1746066819.608850:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3641:x1830882985620864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.608857:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.608869:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8138 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.608904:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.608906:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.608910:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.608917:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.608925:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8400, rc 0) 00000100:00100000:2.0:1746066819.609035:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3641:x1830882985620864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 183us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.609040:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20840 00000100:00100000:0.0:1746066819.609558:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.609581:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985620992 00000100:00100000:0.0:1746066819.609587:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985620992 00000100:00100000:0.0:1746066819.609618:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20841 00000100:00100000:0.0:1746066819.609625:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3644:x1830882985620992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066819.609640:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.609653:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d813f expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.609673:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066819.609679:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.609685:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066819.609688:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3059711] (req 2514944->3059711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.609718:0:13726:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.609728:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3059711] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.609743:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:0.0:1746066819.609790:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3644:x1830882985620992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 165us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.609796:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20841 00000100:00100000:3.0:1746066819.610867:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985620736:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2991us (3281us total) trans 21474842805 rc 0/0 00000100:00100000:3.0:1746066819.610876:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2258 00002000:00100000:3.0:1746066819.610903:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->3145727) req@ffff8800a4d24a80 x1830882985620736/t21474842805(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.610916:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24a80 with x1830882985620736 ext(2875392->3145727) 00010000:00010000:3.0:1746066819.610924:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.610935:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.610941:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d24a80 00000100:00100000:0.0:1746066819.614548:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.615103:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985621120 00000100:00100000:2.0:1746066819.615112:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985621120 00010000:00010000:2.0:1746066819.615145:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.615186:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9593 00000100:00100000:2.0:1746066819.615193:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985621120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.615204:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.615222:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.615234:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.615254:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5f600/0xf1867c21abfb2645 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80d6 expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.615280:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.615282:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.615288:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.615295:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.615302:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.615303:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.615305:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.615322:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.615349:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.615359:0:11928:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.615370:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985184896:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.615466:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.615482:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.615502:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.615539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.616476:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985621248 00000100:00100000:0.0:1746066819.616481:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985621248 00000100:00100000:0.0:1746066819.616508:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20842 00000100:00100000:0.0:1746066819.616514:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+51:3647:x1830882985621248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066819.616526:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.616538:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8146 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.616555:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.616556:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.616561:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 52 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.616570:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 52 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.616578:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30c00, rc 0) 00000100:00100000:0.0:1746066819.616618:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+52:3647:x1830882985621248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 103us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.616623:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20842 00000100:00100000:2.0:1746066819.619016:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985184896:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.619028:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185024:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.619051:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.619082:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985621120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3890us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.619091:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9593 00000100:00100000:0.0:1746066819.619937:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.620161:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985621504 00000100:00100000:3.0:1746066819.620172:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985621504 00000100:00100000:0.0:1746066819.620200:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066819.620215:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff8800a4d25180 x1830882985621504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.620225:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25180 with x1830882985621504 ext(3313664->3317759) 00002000:00010000:3.0:1746066819.620230:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d25180 00000100:00100000:3.0:1746066819.620254:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985621760 00000100:00100000:3.0:1746066819.620257:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985621760 00002000:00100000:3.0:1746066819.620268:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098924380 x1830882985621760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066819.620271:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7910 00002000:00100000:3.0:1746066819.620279:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924380 with x1830882985621760 ext(2097152->3145727) 00000100:00100000:2.0:1746066819.620281:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985621504:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066819.620285:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.620296:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.620301:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924380 00000100:00100000:3.0:1746066819.620331:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2259 00000100:00100000:3.0:1746066819.620338:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985621760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066819.620634:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985621504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 354us (698us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066819.620640:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7910 00002000:00100000:2.0:1746066819.620647:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff8800a4d25180 x1830882985621504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.620654:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25180 with x1830882985621504 ext(3313664->3317759) 00002000:00010000:2.0:1746066819.620659:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d25180 00000100:00100000:0.0:1746066819.622371:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.623124:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622016 00000100:00100000:2.0:1746066819.623131:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622016 00002000:00100000:2.0:1746066819.623162:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098926a00 x1830882985622016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.623171:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882985622016 ext(2097152->3145727) 00002000:00010000:2.0:1746066819.623176:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098926a00 00000100:00100000:2.0:1746066819.623203:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7911 00000100:00100000:2.0:1746066819.623209:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985622016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.627654:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985621760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7302us (7440us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.627667:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2259 00002000:00100000:3.0:1746066819.627685:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098924380 x1830882985621760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.627696:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924380 with x1830882985621760 ext(2097152->3145727) 00010000:00010000:3.0:1746066819.627707:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.627721:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.627728:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924380 00000100:00100000:2.0:1746066819.628733:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985622016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5516us (6358us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.628745:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7911 00002000:00100000:2.0:1746066819.628755:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098926a00 x1830882985622016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.628764:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882985622016 ext(2097152->3145727) 00002000:00010000:2.0:1746066819.628769:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098926a00 00000100:00100000:0.0:1746066819.631970:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.632924:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622144 00000100:00100000:2.0:1746066819.632933:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622144 00000100:00100000:2.0:1746066819.632978:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20843 00000100:00100000:2.0:1746066819.632985:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3641:x1830882985622144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.632999:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.633015:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d814d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.633037:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 51 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.633044:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.633046:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.633049:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.633078:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 51 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.633088:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 51 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.633098:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985185152:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.633164:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.634131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.634395:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622272 00000100:00100000:2.0:1746066819.634403:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622272 00010000:00010000:2.0:1746066819.634435:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.634471:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9594 00000100:00100000:2.0:1746066819.634479:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985622272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.634492:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.634511:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.634522:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.634543:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8400/0xf1867c21abfb26c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8138 expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.634577:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.634579:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.634586:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.634592:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.634620:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.634630:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185280:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.634688:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.635603:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.635738:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985185152:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.635763:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.635774:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3600, rc 0) 00000100:00100000:2.0:1746066819.635819:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3641:x1830882985622144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2831us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.635827:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20843 00000100:00100000:2.0:1746066819.635847:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622400 00000100:00100000:2.0:1746066819.635851:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622400 00000100:00100000:2.0:1746066819.635902:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20844 00000100:00100000:2.0:1746066819.635908:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:3647:x1830882985622400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066819.635922:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.635935:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8154 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.635952:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.635958:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.635959:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066819.635962:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.635980:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.635990:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.635998:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985185408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.636042:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.637994:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185280:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.638009:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066819.638013:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.638046:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.638047:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985622272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3569us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.638065:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9594 00000100:00100000:0.0:1746066819.638144:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622784 00000100:00100000:3.0:1746066819.638152:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985622528 00000100:00100000:0.0:1746066819.638152:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622784 00000100:00100000:3.0:1746066819.638157:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985622528 00002000:00100000:3.0:1746066819.638188:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->4194303) req@ffff88012d802300 x1830882985622528/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.638188:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->2519039) req@ffff88012d803b80 x1830882985622784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.638198:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803b80 with x1830882985622784 ext(2514944->2519039) 00010000:00010000:0.0:1746066819.638206:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.638217:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:0.0:1746066819.638223:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d803b80 00000100:00100000:0.0:1746066819.638250:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2260 00000100:00100000:0.0:1746066819.638257:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985622784:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:3.0:1746066819.638423:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802300 with x1830882985622528 ext(3747840->4194303) 00010000:00010000:3.0:1746066819.638432:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 52 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.638442:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 52 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.638448:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d802300 00000100:00100000:3.0:1746066819.638580:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2261 00000100:00100000:3.0:1746066819.638587:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985622528:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066819.639517:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985622784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1257us (1509us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066819.639525:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2260 00002000:00100000:0.0:1746066819.639531:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->2519039) req@ffff88012d803b80 x1830882985622784/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066819.639539:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803b80 with x1830882985622784 ext(2514944->2519039) 00010000:00010000:0.0:1746066819.639546:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.639555:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:0.0:1746066819.639561:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d803b80 00000100:00100000:3.0:1746066819.639638:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985185408:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.639765:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.639779:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2200, rc 0) 00000100:00100000:3.0:1746066819.639820:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:3647:x1830882985622400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3911us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.639828:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20844 00000100:00100000:3.0:1746066819.645399:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985622528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6801us (7341us total) trans 17179875465 rc 0/0 00000100:00100000:3.0:1746066819.645411:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2261 00002000:00100000:3.0:1746066819.645423:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (3747840->4194303) req@ffff88012d802300 x1830882985622528/t17179875465(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.645431:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802300 with x1830882985622528 ext(3747840->4194303) 00010000:00010000:3.0:1746066819.645441:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.645454:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.645459:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d802300 00000100:00100000:1.0:1746066819.646138:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.646804:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623040 00000100:00100000:3.0:1746066819.646812:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623040 00002000:00100000:3.0:1746066819.646846:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3055616->3059711) req@ffff88011d857100 x1830882985623040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.646854:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857100 with x1830882985623040 ext(3055616->3059711) 00010000:00010000:3.0:1746066819.646861:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.646870:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.646881:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d857100 00000100:00100000:3.0:1746066819.647039:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2262 00000100:00100000:3.0:1746066819.647048:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985623040:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.647181:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985623040:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 134us (1043us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066819.647188:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2262 00002000:00100000:3.0:1746066819.647194:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3055616->3059711) req@ffff88011d857100 x1830882985623040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/4536 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.647200:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857100 with x1830882985623040 ext(3055616->3059711) 00010000:00010000:3.0:1746066819.647205:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.647213:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.647218:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d857100 00000100:00100000:2.0:1746066819.647854:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.647988:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623168 00000100:00100000:3.0:1746066819.647992:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623168 00010000:00010000:3.0:1746066819.648014:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.648042:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9595 00000100:00100000:3.0:1746066819.648048:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+54:2013:x1830882985623168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.648057:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.648072:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.648082:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.648104:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356b000/0xf1867c21abfb2684 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3747840->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8107 expref: 54 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.648296:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.648298:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.648306:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.648325:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.648357:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.648370:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985185536:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.649451:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.651691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.652581:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623424 00000100:00100000:3.0:1746066819.652588:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623424 00000100:00100000:2.0:1746066819.652625:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985185536:192.168.204.16@tcp:105: 00002000:00100000:3.0:1746066819.652629:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->3059711) req@ffff880096ec9500 x1830882985623424/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.652638:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882985623424 ext(2514944->3059711) 00010000:00010000:2.0:1746066819.652645:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.652648:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.652660:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 24 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.652666:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec9500 00000100:00100000:2.0:1746066819.652697:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+53:2013:x1830882985623168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4650us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.652700:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2263 00000100:00100000:3.0:1746066819.652707:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985623424:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066819.652708:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9595 00000100:00100000:0.0:1746066819.655032:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.655152:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623680 00000100:00100000:2.0:1746066819.655163:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623680 00002000:00100000:2.0:1746066819.655198:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec8700 x1830882985623680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.655208:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8700 with x1830882985623680 ext(3145728->4194303) 00002000:00010000:2.0:1746066819.655213:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8700 00000100:00100000:2.0:1746066819.655244:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7912 00000100:00100000:2.0:1746066819.655250:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985623680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066819.662078:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985623680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6819us (7043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.662091:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7912 00002000:00100000:2.0:1746066819.662101:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec8700 x1830882985623680/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.662111:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8700 with x1830882985623680 ext(3145728->4194303) 00002000:00010000:2.0:1746066819.662117:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8700 00000100:00100000:3.0:1746066819.662579:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985623424:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9865us (10888us total) trans 21474842806 rc 0/0 00000100:00100000:3.0:1746066819.662675:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2263 00002000:00100000:3.0:1746066819.662688:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->3059711) req@ffff880096ec9500 x1830882985623424/t21474842806(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.662696:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882985623424 ext(2514944->3059711) 00010000:00010000:3.0:1746066819.662707:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.662720:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.662726:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec9500 00000100:00100000:0.0:1746066819.665458:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.666584:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623808 00000100:00100000:2.0:1746066819.666594:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623808 00010000:00010000:2.0:1746066819.666631:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.666695:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9596 00000100:00100000:2.0:1746066819.666703:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985623808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.666717:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.666738:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.666749:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.666773:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfb26ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3145727] (req 2514944->3059711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d813f expref: 26 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.666967:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.666970:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.666977:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.666986:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.667019:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.667032:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185664:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.667960:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066819.668621:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066819.668772:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.668904:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985623936 00000100:00100000:3.0:1746066819.668913:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985623936 00000100:00100000:3.0:1746066819.668965:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20845 00000100:00100000:3.0:1746066819.668971:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3641:x1830882985623936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.668984:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.668999:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d815b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.669018:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.669025:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066819.669026:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066819.669030:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.669048:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.669057:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 29 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.669066:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985185792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.669489:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.669815:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185664:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066819.669830:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.669859:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985623808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3156us (4410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.669867:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9596 00000100:00100000:3.0:1746066819.670136:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985185792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.670152:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.670165:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46400, rc 0) 00000100:00100000:3.0:1746066819.670195:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3641:x1830882985623936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1224us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.670201:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20845 00000100:00100000:0.0:1746066819.671355:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.671430:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985624064 00000100:00100000:3.0:1746066819.671435:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985624064 00002000:00100000:3.0:1746066819.671460:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3317759) req@ffff880096ecaa00 x1830882985624064/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.671466:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecaa00 with x1830882985624064 ext(3145728->3317759) 00010000:00010000:3.0:1746066819.671472:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.671479:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.671483:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ecaa00 00000100:00100000:3.0:1746066819.671503:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2264 00000100:00100000:3.0:1746066819.671508:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985624064:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066819.672567:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.672610:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985624320 00000100:00100000:3.0:1746066819.672614:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985624320 00002000:00100000:3.0:1746066819.672634:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880093c69500 x1830882985624320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.672642:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69500 with x1830882985624320 ext(2097152->3145727) 00002000:00010000:3.0:1746066819.672646:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c69500 00000100:00100000:3.0:1746066819.672672:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7913 00000100:00100000:3.0:1746066819.672678:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985624320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.676264:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985624064:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4746us (4906us total) trans 21474842807 rc 0/0 00000100:00100000:3.0:1746066819.676276:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2264 00002000:00100000:3.0:1746066819.676290:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3317759) req@ffff880096ecaa00 x1830882985624064/t21474842807(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/448 e 0 to 0 dl 1746066830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.676299:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecaa00 with x1830882985624064 ext(3145728->3317759) 00010000:00010000:3.0:1746066819.676317:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 34 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.676332:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 34 pid: 3528 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746066819.676338:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ecaa00 00000100:00100000:0.0:1746066819.679515:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.679595:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985624448 00000100:00100000:2.0:1746066819.679607:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985624448 00010000:00010000:2.0:1746066819.679646:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 33 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.679682:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985624320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7002us (7114us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.679693:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7913 00002000:00100000:3.0:1746066819.679702:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880093c69500 x1830882985624320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.679711:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69500 with x1830882985624320 ext(2097152->3145727) 00002000:00010000:3.0:1746066819.679715:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c69500 00000100:00100000:2.0:1746066819.679735:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9597 00000100:00100000:2.0:1746066819.679744:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882985624448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.679759:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.679780:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.679791:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.679816:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8131 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.679846:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.679849:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.679856:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.679864:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.679929:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.679946:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185920:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066819.680591:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.683534:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985185920:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066819.683557:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.683611:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985624448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3867us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.683622:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9597 00000100:00100000:0.0:1746066819.684075:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.684304:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985624704 00000100:00100000:3.0:1746066819.684322:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985624704 00000100:00100000:3.0:1746066819.684358:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20846 00000100:00100000:3.0:1746066819.684366:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:3647:x1830882985624704:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066819.684486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066819.684498:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.684516:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8162 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.684601:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.684603:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.684611:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 54 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.684625:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 54 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.684635:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:2.0:1746066819.684710:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985624832 00000100:00100000:2.0:1746066819.684714:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985624832 00002000:00100000:2.0:1746066819.684742:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011f710700 x1830882985624832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.684750:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710700 with x1830882985624832 ext(3145728->4194303) 00002000:00010000:2.0:1746066819.684755:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f710700 00000100:00100000:2.0:1746066819.684771:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7914 00000100:00100000:2.0:1746066819.684776:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985624832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066819.685503:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+54:3647:x1830882985624704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1136us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.685510:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20846 00000100:00100000:2.0:1746066819.691351:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985624832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6557us (6849us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066819.691364:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7914 00002000:00100000:2.0:1746066819.691375:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011f710700 x1830882985624832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.691384:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710700 with x1830882985624832 ext(3145728->4194303) 00002000:00010000:2.0:1746066819.691390:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f710700 00000100:00100000:0.0:1746066819.692318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.692472:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985625088 00000100:00100000:2.0:1746066819.692479:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985625088 00002000:00100000:2.0:1746066819.692514:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec9c00 x1830882985625088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066819.692526:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882985625088 ext(3145728->4194303) 00002000:00010000:2.0:1746066819.692530:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9c00 00000100:00100000:2.0:1746066819.692559:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7915 00000100:00100000:2.0:1746066819.692567:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985625088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066819.696973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.697054:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985625344 00000100:00100000:3.0:1746066819.697063:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985625344 00002000:00100000:3.0:1746066819.697108:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880096ec9180 x1830882985625344/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.697118:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882985625344 ext(4194304->4861951) 00002000:00010000:3.0:1746066819.697124:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00000100:00100000:3.0:1746066819.697155:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7916 00000100:00100000:3.0:1746066819.697163:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985625344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.698299:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985625088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5731us (5990us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.698323:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7915 00002000:00100000:3.0:1746066819.698330:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec9c00 x1830882985625088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.698338:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882985625088 ext(3145728->4194303) 00002000:00010000:3.0:1746066819.698342:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9c00 00000100:00100000:3.0:1746066819.706764:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985625344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9590us (9791us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066819.706777:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7916 00002000:00100000:3.0:1746066819.706787:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880096ec9180 x1830882985625344/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.706797:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882985625344 ext(4194304->4861951) 00002000:00010000:3.0:1746066819.706802:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00000100:00100000:1.0:1746066819.707368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.707678:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985625472 00000100:00100000:3.0:1746066819.707685:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985625472 00000100:00100000:3.0:1746066819.707733:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20847 00000100:00100000:3.0:1746066819.707795:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:3647:x1830882985625472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066819.707833:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.707854:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8169 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.707879:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.707898:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.707906:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.707926:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.707937:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3a00, rc 0) 00000100:00100000:3.0:1746066819.707969:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:3647:x1830882985625472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 229us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.707974:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20847 00000100:00100000:0.0:1746066819.712733:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.712852:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985625728 00000100:00100000:3.0:1746066819.712862:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985625728 00002000:00100000:3.0:1746066819.713012:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880096ec9f80 x1830882985625728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.713022:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9f80 with x1830882985625728 ext(3145728->4194303) 00002000:00010000:3.0:1746066819.713027:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9f80 00000100:00100000:3.0:1746066819.713049:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7917 00000100:00100000:3.0:1746066819.713058:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985625728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.720362:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985625728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7290us (7623us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066819.720374:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7917 00002000:00100000:3.0:1746066819.720385:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880096ec9f80 x1830882985625728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.720394:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9f80 with x1830882985625728 ext(3145728->4194303) 00002000:00010000:3.0:1746066819.720400:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9f80 00000100:00100000:0.0:1746066819.725621:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.725757:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985625984 00000100:00100000:3.0:1746066819.725767:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985625984 00002000:00100000:3.0:1746066819.725816:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880096ec8a80 x1830882985625984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/0 e 0 to 0 dl 1746066830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.725825:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8a80 with x1830882985625984 ext(4194304->4861951) 00002000:00010000:3.0:1746066819.725831:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8a80 00000100:00100000:3.0:1746066819.726211:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7918 00000100:00100000:3.0:1746066819.726220:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985625984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066819.734640:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985625984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8408us (9018us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746066819.734653:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7918 00002000:00100000:3.0:1746066819.734665:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880096ec8a80 x1830882985625984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:225/0 lens 488/440 e 0 to 0 dl 1746066830 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066819.734674:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8a80 with x1830882985625984 ext(4194304->4861951) 00002000:00010000:3.0:1746066819.734679:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8a80 00000100:00100000:0.0:1746066819.751363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.751448:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985626112 00000100:00100000:3.0:1746066819.751460:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985626112 00000100:00100000:3.0:1746066819.751762:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17344 00000100:00100000:3.0:1746066819.751772:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985626112:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.751797:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.751817:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46e00/0xf1867c21abfb26fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8170 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.751878:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.751929:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.751942:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.751955:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.752136:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.752142:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.752210:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.752220:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.752227:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.752233:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.752266:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.752278:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 20 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.752290:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.752579:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.752588:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 39 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.752595:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186176:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.752612:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.755709:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.755815:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.755873:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985626368 00000100:00100000:2.0:1746066819.755879:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985626368 00000100:00100000:2.0:1746066819.756364:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6556 00000100:00100000:2.0:1746066819.756372:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:16320:x1830882985626368:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066819.757899:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:16320:x1830882985626368:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 1506us (2175us total) trans 8589937849 rc 0/0 00000100:00100000:2.0:1746066819.757911:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6556 00000100:00100000:3.0:1746066819.758228:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.758251:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985626624 00000100:00100000:3.0:1746066819.758256:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985626624 00000100:00100000:3.0:1746066819.758284:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6557 00000100:00100000:3.0:1746066819.758289:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:8546:x1830882985626624:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066819.758331:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985186304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746066819.758370:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186048:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.758385:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066819.758396:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066819.758403:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:8546:x1830882985626624:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 112us (177us total) trans 8589937850 rc 0/0 00000100:00100000:3.0:1746066819.758409:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6557 00000100:00100000:1.0:1746066819.758423:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985186304 00000100:00100000:1.0:1746066819.758428:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985186304 00000100:00100000:1.0:1746066819.759178:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1746066819.759184:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985186304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746066819.759202:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1303461184 pending 11669504 free 3906400256 avail 3674877952 00000100:00100000:1.0:1746066819.759230:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985186304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.759235:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:1.0:1746066819.759248:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066819.759266:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985186304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746066819.759521:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.759577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.759728:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985626752 00000100:00100000:0.0:1746066819.759732:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985626752 00010000:00010000:0.0:1746066819.759752:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.759778:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985626880 00000100:00100000:0.0:1746066819.759780:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985626880 00010000:00010000:0.0:1746066819.759790:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 22 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.759803:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9598 00000100:00100000:0.0:1746066819.759809:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985626752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.759817:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.759821:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.759829:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.759846:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfb265a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80e4 expref: 41 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.759862:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066819.759866:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.759873:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.759877:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.759910:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.759940:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985626752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.759945:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9599 00000100:00100000:2.0:1746066819.759953:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985626880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.759960:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.759964:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 22 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.759974:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 22 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.759986:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2692 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d810e expref: 22 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.759994:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.759998:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.760003:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.760009:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.760025:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.760041:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985626880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.760106:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9598 00010000:00010000:0.0:1746066819.760129:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760136:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066819.760234:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:0.0:1746066819.760238:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066819.760255:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760263:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760272:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760277:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760282:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760288:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760292:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941a0c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066819.760295:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760301:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760315:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066819.760318:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066819.760320:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760447:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941a0c00/0xf1867c21abfb2702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760459:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760464:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760469:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760472:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c185600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066819.760474:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760479:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760485:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfdf00) 00010000:00010000:0.0:1746066819.760486:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066819.760488:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.760492:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c185600/0xf1867c21abfb2709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066819.760522:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9599 00010000:00010000:0.0:1746066819.760547:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46e00/0xf1867c21abfb26fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.760557:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.760563:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066819.760565:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066819.760567:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c184800, rc 0) 00000100:00100000:0.0:1746066819.761016:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985626112:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9245us (9659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.761023:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17344 00000100:00100000:0.0:1746066819.763345:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.763369:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.763404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.763471:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627136 00000100:00100000:1.0:1746066819.763478:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627136 00000100:00100000:1.0:1746066819.763506:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627392 00000100:00100000:1.0:1746066819.763508:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627392 00000100:00100000:1.0:1746066819.763518:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627008 00000100:00100000:1.0:1746066819.763519:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627008 00000100:00100000:1.0:1746066819.763531:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20848 00000100:00100000:1.0:1746066819.763536:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985627136:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.763551:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.763563:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d817e expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.763580:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763582:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763588:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763600:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763608:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c400, rc 0) 00000100:00100000:1.0:1746066819.763640:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985627136:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.763645:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20848 00000100:00100000:1.0:1746066819.763658:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20849 00000100:00100000:1.0:1746066819.763662:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985627392:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.763668:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.763676:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d818c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.763685:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763686:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763690:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763704:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763710:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:1.0:1746066819.763721:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985627392:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 58us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.763725:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20849 00000100:00100000:1.0:1746066819.763731:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20850 00000100:00100000:1.0:1746066819.763735:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985627008:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.763740:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.763745:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8177 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.763753:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763755:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.763759:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763767:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.763773:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f77e00, rc 0) 00000100:00100000:1.0:1746066819.763784:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985627008:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.763788:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20850 00000100:00100000:0.0:1746066819.765444:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.765489:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.765513:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627264 00000100:00100000:2.0:1746066819.765521:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627264 00000100:00100000:3.0:1746066819.765543:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627520 00000100:00100000:3.0:1746066819.765547:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627520 00000100:00100000:2.0:1746066819.765562:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20851 00000100:00100000:2.0:1746066819.765568:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985627264:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066819.765578:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066819.765580:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20852 00000100:00100000:3.0:1746066819.765586:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985627520:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066819.765587:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8185 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.765593:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.765601:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8193 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.765602:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.765603:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.765609:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.765620:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 12 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.765628:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6200, rc 0) 00000100:00100000:2.0:1746066819.765659:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985627264:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.765664:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20851 00010000:00010000:3.0:1746066819.765674:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.765675:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.765681:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.765691:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.765698:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4000, rc 0) 00000100:00100000:3.0:1746066819.765714:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985627520:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 129us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.765720:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20852 00000100:00100000:0.0:1746066819.771391:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.771563:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627776 00000100:00100000:2.0:1746066819.771573:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627776 00000100:00100000:2.0:1746066819.771649:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17345 00000100:00100000:2.0:1746066819.771656:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985627776:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066819.771676:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066819.771693:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6600/0xf1867c21abfb273a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d819a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.771785:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.772267:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.772275:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.772305:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.772325:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 10 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.772335:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.772805:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066819.774388:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985186432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.774410:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066819.774858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.774917:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985627904 00000100:00100000:2.0:1746066819.774922:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985627904 00010000:00010000:2.0:1746066819.774946:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 11 pid: 10125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.774970:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9600 00000100:00100000:2.0:1746066819.774976:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985627904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.774988:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.774993:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 11 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.775003:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 11 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.775022:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2710 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8170 expref: 11 pid: 10125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.775047:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066819.775054:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.775063:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.775068:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066819.775095:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.775134:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985627904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.775141:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9600 00010000:00010000:3.0:1746066819.775261:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.775268:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.775286:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.775411:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6600/0xf1867c21abfb273a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d819a expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.775532:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d819a expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.775538:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.775540:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066819.775543:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6e00, rc 0) 00000100:00100000:3.0:1746066819.775576:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3652:x1830882985627776:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3921us (4194us total) trans 8589937851 rc 0/0 00000100:00100000:3.0:1746066819.775582:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17345 00000100:00100000:0.0:1746066819.780507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.780584:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628160 00000100:00100000:3.0:1746066819.780592:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628160 00000100:00100000:3.0:1746066819.780645:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17346 00000100:00100000:3.0:1746066819.780653:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3652:x1830882985628160:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.780675:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.780679:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066819.780704:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6e00/0xf1867c21abfb2741 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d819a expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.780729:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.780734:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.780744:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb274f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81a1 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.780833:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2756 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.780844:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2756 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.780853:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2756 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.780862:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066819.780965:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb274f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a1 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.780981:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2756 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a1 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.780987:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.780989:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066819.780991:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5400, rc 0) 00000100:00100000:3.0:1746066819.781030:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+11:3652:x1830882985628160:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 378us (535us total) trans 8589937852 rc 0/0 00000100:00100000:3.0:1746066819.781036:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17346 00000100:00100000:0.0:1746066819.782343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.782417:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628288 00000100:00100000:1.0:1746066819.782422:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628288 00000100:00100000:1.0:1746066819.782467:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17347 00000100:00100000:1.0:1746066819.782472:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+11:3652:x1830882985628288:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.782489:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.782500:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2764 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81a8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.782532:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2764 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a8 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.782540:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2764 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a8 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.782555:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066819.782557:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066819.782559:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c184800, rc 0) 00000100:00100000:1.0:1746066819.782584:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+12:3652:x1830882985628288:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.782589:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17347 00000100:00100000:0.0:1746066819.783824:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.783858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.784113:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628416 00000100:00100000:2.0:1746066819.784113:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628672 00000100:00100000:2.0:1746066819.784118:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628672 00000100:00100000:3.0:1746066819.784119:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628416 00000100:00100000:2.0:1746066819.784148:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20853 00000100:00100000:2.0:1746066819.784154:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985628672:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066819.784183:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.784190:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20854 00000100:00100000:3.0:1746066819.784196:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985628416:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066819.784200:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.784207:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.784214:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.784217:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.784220:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.784222:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.784225:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.784233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066819.784234:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.784242:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066819.784248:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628928 00010000:00010000:3.0:1746066819.784249:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 53 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066819.784251:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628928 00010000:00010000:2.0:1746066819.784254:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.784255:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.784256:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.784258:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.784266:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 25 pid: 3528 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.784272:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20855 00010000:00010000:3.0:1746066819.784275:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 53 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066819.784277:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985628928:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746066819.784279:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985186560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.784283:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 53 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746066819.784292:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985186688:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.784292:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784302:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784321:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.784335:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 53 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784341:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784347:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 53 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784352:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066819.784354:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066819.784356:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784370:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 53 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.784371:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.784378:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 14 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.784378:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.784378:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 53 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.784385:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985186944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.784385:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985186816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.784386:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 11 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.784395:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985187072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.784503:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.784510:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 30 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.784517:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985187200:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.784602:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784604:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.784609:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.784611:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.784616:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985187456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.784624:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187328:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.784627:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066819.784645:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 53 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784652:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 53 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.784659:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187584:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.784680:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066819.784682:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066819.784687:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 14 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.784694:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187712:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.784706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066819.784710:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.784717:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.784724:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187840:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.784735:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066819.784794:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628544 00000100:00100000:1.0:1746066819.784797:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628544 00000100:00100000:3.0:1746066819.784821:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.785040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.785054:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985628800 00000100:00100000:1.0:1746066819.785057:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985628800 00000100:00100000:1.0:1746066819.785076:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20856 00000100:00100000:1.0:1746066819.785081:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985628544:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066819.785097:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.785112:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.785118:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 12 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.785124:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.785129:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.785131:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.785133:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.785149:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066819.785226:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629056 00000100:00100000:2.0:1746066819.785229:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629056 00000100:00100000:2.0:1746066819.785249:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20857 00000100:00100000:2.0:1746066819.785254:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985628800:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066819.785270:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.785274:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20858 00000100:00100000:0.0:1746066819.785279:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985629056:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066819.785280:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.785287:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.785292:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.785294:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 53 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.785299:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.785300:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.785302:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.785331:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 53 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.785339:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 53 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.785347:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188096:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.785424:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785433:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 13 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.785439:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785444:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785449:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066819.785450:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066819.785452:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 7/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785467:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785474:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 31 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.785475:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.785482:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 30 pid: 12255 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.785487:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.785489:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.785507:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.785507:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.785514:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 15 pid: 20361 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.785514:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 31 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.785521:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188608:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.785521:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.785532:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00010000:00010000:0.0:1746066819.785536:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 13 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.785542:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 13 pid: 13363 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.785549:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188736:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.785569:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.785576:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 25 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.785582:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188864:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.785594:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746066819.785631:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.785641:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985187968:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.785669:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.785677:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 13 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.785689:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985188992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.785710:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.785716:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.785723:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985189120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.785736:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db5300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066819.787071:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985186688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.787237:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985186560:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.788090:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985186944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.788246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.788573:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629184 00000100:00100000:2.0:1746066819.788579:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629184 00010000:00010000:2.0:1746066819.788609:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 16 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.788643:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9601 00000100:00100000:2.0:1746066819.788649:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2013:x1830882985629184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066819.788661:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.788681:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 16 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.788691:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 16 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.788710:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfb2725 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8177 expref: 16 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.788741:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.788784:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2013:x1830882985629184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.788790:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9601 00000100:00100000:1.0:1746066819.795235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.795250:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.795261:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.795283:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629440 00000100:00100000:1.0:1746066819.795290:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629440 00010000:00010000:1.0:1746066819.795337:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.795361:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629312 00000100:00100000:1.0:1746066819.795364:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629312 00010000:00010000:1.0:1746066819.795378:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 14 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.795388:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629952 00000100:00100000:1.0:1746066819.795390:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629952 00010000:00010000:1.0:1746066819.795399:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 32 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.795416:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9602 00000100:00100000:1.0:1746066819.795423:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985629440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.795436:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.795455:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795466:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795494:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.795534:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985629440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.795540:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9602 00000100:00100000:1.0:1746066819.795555:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9603 00000100:00100000:1.0:1746066819.795560:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985629312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.795567:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.795579:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 14 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.795587:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 14 pid: 1893 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.795600:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.795613:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985629312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.795619:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9603 00000100:00100000:1.0:1746066819.795629:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9604 00000100:00100000:1.0:1746066819.795633:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882985629952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.795638:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.795644:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 32 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795652:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 32 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795660:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.795672:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882985629952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 39us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.795676:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9604 00000100:00100000:1.0:1746066819.795738:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.795783:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.795795:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630080 00000100:00100000:1.0:1746066819.795798:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630080 00010000:00010000:1.0:1746066819.795807:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746066819.795820:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9605 00000100:00100000:1.0:1746066819.795825:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985630080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.795830:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.795838:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795845:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 31 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.795854:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066819.795866:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985630080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 41us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.795871:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9605 00000100:00100000:1.0:1746066819.795931:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.795942:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629568 00000100:00100000:1.0:1746066819.795944:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629568 00010000:00010000:1.0:1746066819.795955:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 26 pid: 3528 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.795969:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9606 00000100:00100000:1.0:1746066819.795973:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985629568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.795978:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.795985:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 26 pid: 3528 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.795994:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 26 pid: 3528 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.796005:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfb2676 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f9 expref: 26 pid: 3528 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.796456:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6200/0xf1867c21abfb272c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8185 expref: 13 pid: 1893 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746066819.796473:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985187072:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.796482:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5fc00/0xf1867c21abfb261b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c8 expref: 31 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746066819.796490:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985187456:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.796515:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.796881:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985186816:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.796905:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb26a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8115 expref: 30 pid: 1893 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.796915:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.796922:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187584:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.796928:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f761c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.796932:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f761880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985187840:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066819.796953:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797004:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.797018:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629824 00000100:00100000:0.0:1746066819.797021:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629824 00010000:00010000:0.0:1746066819.797036:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 15 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.797056:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.797058:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066819.797062:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9607 00010000:00010000:1.0:1746066819.797065:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797067:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985629824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.797073:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797075:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.797085:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 15 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.797093:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 15 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.797100:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066819.797105:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb271e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d818c expref: 15 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.797115:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.797134:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985629824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.797139:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9607 00010000:00010000:2.0:1746066819.797153:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.797155:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985629568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1176us (1219us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066819.797162:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.797164:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9606 00000100:00100000:0.0:1746066819.797172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066819.797179:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797182:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630464 00000100:00100000:0.0:1746066819.797185:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630464 00010000:00010000:2.0:1746066819.797186:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.797193:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797193:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.797200:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f6000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066819.797204:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797206:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9608 00010000:00010000:2.0:1746066819.797211:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797211:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985630464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.797217:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.797221:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797222:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746066819.797227:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb276b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797228:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.797238:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb26d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d814d expref: 30 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.797251:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.797270:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882985630464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.797276:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9608 00000100:00100000:1.0:1746066819.797294:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.797328:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985629696 00000100:00100000:0.0:1746066819.797331:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985629696 00000100:00100000:1.0:1746066819.797335:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066819.797344:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 54 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.797350:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630208 00000100:00100000:1.0:1746066819.797356:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630208 00000100:00100000:0.0:1746066819.797358:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9609 00000100:00100000:0.0:1746066819.797363:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985629696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.797368:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.797375:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 55 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.797376:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 55 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.797382:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 55 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.797392:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9000/0xf1867c21abfb26a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d811c expref: 55 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.797395:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9610 00000100:00100000:1.0:1746066819.797401:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985630208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.797401:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.797403:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.797406:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.797411:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.797417:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.797426:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 54 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.797428:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066819.797436:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 54 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.797444:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985629696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.797449:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9609 00010000:00010000:1.0:1746066819.797452:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47a00/0xf1867c21abfb26ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8162 expref: 54 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.797461:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.797470:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985628672:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13315us (13610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.797479:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20853 00000100:00100000:1.0:1746066819.797479:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985630208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.797482:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.797485:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9610 00000100:00100000:0.0:1746066819.797494:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630336 00000100:00100000:0.0:1746066819.797497:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630336 00010000:00010000:0.0:1746066819.797507:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 52 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.797531:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9611 00000100:00100000:0.0:1746066819.797536:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882985630336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.797543:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.797551:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 52 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.797553:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066819.797560:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 52 pid: 9591 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.797562:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630592 00000100:00100000:1.0:1746066819.797564:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630592 00010000:00010000:0.0:1746066819.797570:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943ea200/0xf1867c21abfb2389 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f47 expref: 53 pid: 9591 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.797575:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 53 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.797579:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.797596:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882985630336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.797600:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9612 00000100:00100000:0.0:1746066819.797605:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9611 00000100:00100000:1.0:1746066819.797606:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882985630592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.797613:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.797619:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 51 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.797627:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 51 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.797632:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188224:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.797638:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d30c00/0xf1867c21abfb26d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8146 expref: 51 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.797645:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb267d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8100 expref: 28 pid: 1893 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746066819.797646:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.797648:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.797650:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.797656:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.797660:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985187200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.797679:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.797679:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066819.797686:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797687:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797693:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797693:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.797697:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882985630592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.797702:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9612 00010000:00010000:3.0:1746066819.797706:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797706:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797712:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797712:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797718:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797718:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797723:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097bc9800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066819.797726:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797728:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea4200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066819.797731:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797732:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.797735:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188352:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.797737:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797741:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.797747:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfb2779 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797748:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.797754:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb2772 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066819.797784:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985628928:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13506us (13551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.797790:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20855 00000100:00100000:3.0:1746066819.797791:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985628416:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13594us (13967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.797798:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20854 00000100:00100000:1.0:1746066819.797802:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985188608:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.797815:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188480:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066819.797823:0:13726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.797930:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066819.798003:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985188864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066819.798024:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.798030:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985187968:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.798031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.798039:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985188992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.798052:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631232 00000100:00100000:1.0:1746066819.798054:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631232 00010000:00010000:1.0:1746066819.798066:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 12 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.798070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066819.798075:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985189120:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.798095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066819.798098:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066819.798101:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631360 00000100:00100000:1.0:1746066819.798103:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631360 00000100:00100000:3.0:1746066819.798104:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630720 00000100:00100000:3.0:1746066819.798108:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630720 00000100:00100000:0.0:1746066819.798109:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9613 00010000:00010000:1.0:1746066819.798113:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798119:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.798121:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985631232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.798131:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066819.798137:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9614 00010000:00010000:0.0:1746066819.798141:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 12 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746066819.798143:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9615 00000100:00100000:1.0:1746066819.798143:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882985631360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066819.798147:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985630720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.798149:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.798153:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.798160:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798161:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.798162:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 12 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.798169:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.798175:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155c400/0xf1867c21abfb2717 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d817e expref: 12 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.798180:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746066819.798183:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066819.798193:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb26f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8169 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798198:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb26df lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8154 expref: 32 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746066819.798202:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985631232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066819.798203:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.798207:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9613 00010000:00010000:3.0:1746066819.798208:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.798221:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.798221:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985631360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.798227:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9614 00000100:00100000:3.0:1746066819.798228:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985630720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.798235:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9615 00000100:00100000:0.0:1746066819.798237:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630976 00000100:00100000:0.0:1746066819.798241:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630976 00000100:00100000:2.0:1746066819.798244:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066819.798251:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 12 pid: 20361 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746066819.798256:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631488 00000100:00100000:2.0:1746066819.798259:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.798259:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631488 00010000:00010000:1.0:1746066819.798268:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.798271:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985630848 00000100:00100000:0.0:1746066819.798274:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985630848 00000100:00100000:3.0:1746066819.798276:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9616 00010000:00010000:0.0:1746066819.798282:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 28 pid: 12255 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746066819.798283:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985630976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066819.798283:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9617 00000100:00100000:2.0:1746066819.798288:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985631488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.798289:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.798294:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.798297:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 12 pid: 20361 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.798298:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9618 00010000:00010000:2.0:1746066819.798302:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746066819.798302:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985630848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.798305:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 12 pid: 20361 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.798320:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066819.798322:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.798329:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c400/0xf1867c21abfb22d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f08 expref: 12 pid: 20361 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.798330:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 28 pid: 12255 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.798334:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ea00/0xf1867c21abfb2668 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80f2 expref: 25 pid: 13726 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.798338:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 28 pid: 12255 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746066819.798343:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.798344:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066819.798348:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44200/0xf1867c21abfb2454 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7fbe expref: 28 pid: 12255 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746066819.798356:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066819.798357:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985631488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066819.798357:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.798360:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.798361:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985630976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.798363:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9617 00000100:00100000:3.0:1746066819.798370:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9616 00010000:00010000:0.0:1746066819.798370:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.798382:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066819.798391:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066819.798393:0:13726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.798400:0:13726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.798403:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631104 00000100:00100000:3.0:1746066819.798406:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631104 00010000:00010000:3.0:1746066819.798416:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.798416:0:13726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.798422:0:13726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.798428:0:13726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066819.798434:0:13726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1e00 already unused, calling callback (ffffffffa0898d70) 00000100:00100000:3.0:1746066819.798436:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9619 00010000:00010000:1.0:1746066819.798437:0:13726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.798441:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985631104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066819.798443:0:13726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.798448:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.798452:0:13726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.798454:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746066819.798457:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfb2787 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.798462:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.798472:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb2733 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8193 expref: 11 pid: 13363 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746066819.798480:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066819.798499:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985630848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 195us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.798504:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9618 00000100:00100000:1.0:1746066819.798508:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985628800:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13253us (13686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.798511:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985631104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.798515:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20857 00000100:00100000:3.0:1746066819.798517:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9619 00000100:00100000:2.0:1746066819.798538:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.798571:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631616 00000100:00100000:3.0:1746066819.798574:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631616 00010000:00010000:3.0:1746066819.798584:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 29 pid: 13726 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.798602:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9620 00000100:00100000:3.0:1746066819.798606:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882985631616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.798611:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.798617:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 29 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798623:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 29 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798633:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfb2614 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d80c1 expref: 29 pid: 13726 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.798641:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.798642:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.798645:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.798650:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.798661:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066819.798668:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798680:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066819.798686:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882985631616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.798691:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9620 00010000:00010000:2.0:1746066819.798692:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798698:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798704:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798710:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066819.798712:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798719:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798728:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.798734:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb2780 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.798768:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985628544:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13686us (14060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.798774:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20856 00000100:00100000:2.0:1746066819.799252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.799337:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985631744 00000100:00100000:3.0:1746066819.799342:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985631744 00010000:00010000:3.0:1746066819.799355:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 24 pid: 3528 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746066819.799377:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9621 00000100:00100000:3.0:1746066819.799382:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985631744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.799390:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.799397:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 24 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.799406:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 24 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.799417:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfb26e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d815b expref: 24 pid: 3528 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746066819.799425:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.799426:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.799428:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.799485:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.799509:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.799536:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985631744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.799542:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9621 00010000:00010000:2.0:1746066819.799621:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799630:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799644:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799649:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799655:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799660:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b33800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066819.799663:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799668:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799678:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.799689:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfb278e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066819.799746:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985629056:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 14466us (14706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066819.799754:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20858 00000100:00100000:0.0:1746066819.801257:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.801318:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632000 00000100:00100000:3.0:1746066819.801324:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632000 00000100:00100000:3.0:1746066819.801413:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17348 00000100:00100000:3.0:1746066819.801420:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3652:x1830882985632000:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:3.0:1746066819.801463:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.801487:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c184800/0xf1867c21abfb2764 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a8 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801502:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.801506:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.801528:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.801538:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801546:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801552:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 39 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801558:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801564:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.801585:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801597:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 20 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746066819.801607:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189248:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.801677:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 39 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801730:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 39 pid: 7244 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746066819.801739:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189376:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.801777:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801784:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 20 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746066819.801790:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189504:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.801811:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.801819:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746066819.801825:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189632:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.802065:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066819.803405:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.803429:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189248:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066819.803433:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.803436:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189376:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066819.803441:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066819.803476:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632128 00000100:00100000:1.0:1746066819.803482:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632128 00000100:00100000:0.0:1746066819.803491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066819.803505:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 40 pid: 7244 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746066819.803524:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632256 00000100:00100000:1.0:1746066819.803526:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632256 00010000:00010000:1.0:1746066819.803535:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 21 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746066819.803537:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632384 00000100:00100000:0.0:1746066819.803541:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632384 00000100:00100000:1.0:1746066819.803549:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9622 00000100:00100000:1.0:1746066819.803555:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985632128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.803555:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 22 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746066819.803563:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066819.803568:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 40 pid: 7244 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746066819.803572:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9623 00010000:00010000:1.0:1746066819.803576:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 40 pid: 7244 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746066819.803577:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985632256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.803583:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066819.803587:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 22 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746066819.803592:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfb24ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8020 expref: 40 pid: 7244 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746066819.803595:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 22 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746066819.803608:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb25ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8082 expref: 22 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746066819.803647:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066819.803652:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066819.803653:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9624 00010000:00010000:1.0:1746066819.803659:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.803660:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985632384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066819.803660:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066819.803663:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.803667:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.803670:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 21 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746066819.803670:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066819.803677:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 21 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746066819.803687:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb23eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f78 expref: 21 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746066819.803689:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985632128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.803692:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985632256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.803695:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9622 00010000:00010000:3.0:1746066819.803696:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.803699:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066819.803700:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9623 00010000:00010000:3.0:1746066819.803703:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.803716:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985632384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.803722:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9624 00000100:00100000:3.0:1746066819.804222:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985189632:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066819.804244:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066819.805129:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.805209:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632512 00000100:00100000:3.0:1746066819.805214:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632512 00010000:00010000:3.0:1746066819.805236:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746066819.805262:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9625 00000100:00100000:3.0:1746066819.805268:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985632512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066819.805275:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066819.805279:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746066819.805287:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746066819.805303:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb23dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d7f6a expref: 39 pid: 10125 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746066819.805324:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.805328:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.805336:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.805341:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.805367:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066819.805402:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985632512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.805408:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9625 00010000:00010000:0.0:1746066819.805518:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066819.805523:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000040:00080000:0.0:1746066819.805768:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1266, 88 off119000 00000004:00080000:0.0:1746066819.805775:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788016891530ns, next at 733263941116ns, rc = 0 00000040:00080000:0.0:1746066819.805823:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1268, 88 off119088 00000004:00080000:0.0:1746066819.805828:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788016944642ns, next at 733263917711ns, rc = 0 00000040:00080000:0.0:1746066819.805852:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1269, 88 off119176 00000004:00080000:0.0:1746066819.805855:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788016972055ns, next at 733263917711ns, rc = 0 00000040:00080000:0.0:1746066819.805864:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1267, 88 off119088 00000004:00080000:0.0:1746066819.805867:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788016983470ns, next at 733263941116ns, rc = 0 00000040:00080000:0.0:1746066819.805873:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1268, 88 off119176 00000004:00080000:0.0:1746066819.805876:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788016992530ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.805924:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1270, 88 off119264 00000004:00080000:1.0:1746066819.805929:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017045328ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066819.805942:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1271, 88 off119352 00000004:00080000:1.0:1746066819.805944:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017060610ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066819.805949:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1272, 88 off119440 00000004:00080000:1.0:1746066819.805951:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017067450ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066819.805957:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1269, 88 off119264 00000004:00080000:1.0:1746066819.805959:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017075610ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.805963:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1273, 88 off119528 00000004:00080000:1.0:1746066819.805985:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017102015ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066819.805992:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1270, 88 off119352 00000004:00080000:1.0:1746066819.805994:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017110680ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.805998:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1274, 88 off119616 00000004:00080000:1.0:1746066819.806000:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017117230ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066819.806005:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1271, 88 off119440 00000004:00080000:1.0:1746066819.806007:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017124067ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.806012:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1272, 88 off119528 00000004:00080000:1.0:1746066819.806013:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017130142ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.806017:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1273, 88 off119616 00000004:00080000:1.0:1746066819.806019:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017135795ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.806023:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1274, 88 off119704 00000004:00080000:1.0:1746066819.806024:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788017140900ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066819.806028:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1275, 88 off119704 00000004:00080000:1.0:1746066819.806029:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788017146195ns, next at 733263917711ns, rc = 0 00000001:00080000:3.0:1746066819.807510:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937853 is committed 00000004:00080000:3.0:1746066819.807521:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1249 committed 00000004:00080000:3.0:1746066819.807533:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1250 committed 00000004:00080000:3.0:1746066819.807636:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1249 committed 00000004:00080000:3.0:1746066819.807639:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1248 committed 00000004:00080000:3.0:1746066819.807640:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1247 committed 00000004:00080000:3.0:1746066819.807641:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1248 committed 00000004:00080000:3.0:1746066819.807643:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1246 committed 00000100:00100000:2.0:1746066819.807673:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985189760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066819.807723:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.807723:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985190016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066819.807756:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066819.807762:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066819.807770:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985190528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.807771:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985189760 00000100:00100000:0.0:1746066819.807776:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985189760 00000100:00100000:2.0:1746066819.807777:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.807788:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985190144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066819.807794:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066819.807796:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190016 00000100:00100000:0.0:1746066819.807797:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190016 00000100:00100000:2.0:1746066819.807798:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985189888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066819.807802:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.807808:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190272 00000100:00100000:0.0:1746066819.807810:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190272 00000100:00100000:2.0:1746066819.807813:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.807815:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985190656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.807819:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190144 00000100:00100000:0.0:1746066819.807820:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190144 00000100:00100000:2.0:1746066819.807825:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.807826:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985189888 00000100:00100000:0.0:1746066819.807827:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985189888 00000100:00100000:1.0:1746066819.807828:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.807836:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190656 00000100:00100000:0.0:1746066819.807837:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190656 00000100:00100000:2.0:1746066819.807839:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.807842:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190400 00000100:00100000:0.0:1746066819.807844:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190400 00000100:00100000:0.0:1746066819.807849:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20859 00000100:00100000:0.0:1746066819.807853:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985189760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066819.807855:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20860 00000100:00100000:2.0:1746066819.807860:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20861 00000100:00100000:1.0:1746066819.807861:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882985190016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066819.807866:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985190272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066819.807943:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20862 00000100:00100000:1.0:1746066819.807947:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985190144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.807973:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985189760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (251us total) trans 21474842808 rc 0/0 00000100:00100000:0.0:1746066819.807977:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20859 00000100:00100000:0.0:1746066819.807986:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20863 00000100:00100000:0.0:1746066819.807989:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985189888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066819.807991:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808006:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985190144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (202us total) trans 21474842811 rc 0/0 00000100:00100000:2.0:1746066819.808012:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.808012:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20862 00000100:00100000:2.0:1746066819.808022:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985191296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808022:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190784 00000100:00100000:1.0:1746066819.808025:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190784 00000100:00100000:1.0:1746066819.808036:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20864 00000100:00100000:2.0:1746066819.808039:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.808041:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985190656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808041:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985189888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (227us total) trans 21474842812 rc 0/0 00000100:00100000:0.0:1746066819.808046:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20863 00000100:00100000:0.0:1746066819.808055:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191296 00000100:00100000:0.0:1746066819.808058:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191296 00000004:00080000:2.0:1746066819.808059:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b166680/2, rc 0, transno 21474842812 00000100:00100000:2.0:1746066819.808064:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985189888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808067:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20865 00000100:00100000:0.0:1746066819.808071:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985190400:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066819.808078:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165c00/2, rc 0, transno 21474842808 00000100:00100000:2.0:1746066819.808080:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985189760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066819.808086:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066819.808090:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808092:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882985190656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (263us total) trans 21474842813 rc 0/0 00000100:00100000:1.0:1746066819.808097:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20864 00000100:00100000:2.0:1746066819.808105:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.808106:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20866 00000100:00100000:1.0:1746066819.808109:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3776:x1830882985190784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066819.808114:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985191424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066819.808122:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985190400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (282us total) trans 21474842814 rc 0/0 00000100:00100000:0.0:1746066819.808127:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20865 00000100:00100000:2.0:1746066819.808129:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.808136:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190912 00000100:00100000:0.0:1746066819.808138:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190912 00000004:00080000:2.0:1746066819.808140:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f762300/2, rc 0, transno 21474842814 00000100:00100000:2.0:1746066819.808143:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808146:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191424 00000100:00100000:0.0:1746066819.808148:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191424 00000100:00100000:0.0:1746066819.808156:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20867 00000100:00100000:2.0:1746066819.808161:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20868 00000100:00100000:0.0:1746066819.808161:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985191296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066819.808166:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985190912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808182:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985190784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (168us total) trans 17179875466 rc 0/0 00000100:00100000:1.0:1746066819.808187:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20866 00000100:00100000:1.0:1746066819.808198:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20869 00000100:00100000:1.0:1746066819.808202:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985191424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066819.808208:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066819.808211:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066819.808213:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066819.808215:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066819.808217:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000004:00080000:2.0:1746066819.808220:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d803800/2, rc 0, transno 17179875466 00000100:00100000:2.0:1746066819.808227:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066819.808235:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306a00/2, rc 0, transno 17179875467 00000100:00100000:0.0:1746066819.808236:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882985191296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (196us total) trans 17179875467 rc 0/0 00000100:00100000:2.0:1746066819.808237:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985191296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066819.808242:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20867 00000100:00100000:1.0:1746066819.808262:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882985191424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (131us total) trans 17179875469 rc 0/0 00000100:00100000:1.0:1746066819.808267:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20869 00000100:00100000:1.0:1746066819.808285:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066819.808286:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1247 committed 00000004:00080000:3.0:1746066819.808289:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1245 committed 00000004:00080000:3.0:1746066819.808290:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1246 committed 00000004:00080000:3.0:1746066819.808292:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1245 committed 00000004:00080000:3.0:1746066819.808293:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1244 committed 00000004:00080000:3.0:1746066819.808294:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1244 committed 00000004:00080000:3.0:1746066819.808296:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1243 committed 00000004:00080000:3.0:1746066819.808298:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1243 committed 00000004:00080000:3.0:1746066819.808299:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1242 committed 00000100:00100000:1.0:1746066819.808302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066819.808303:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1242 committed 00000001:00080000:3.0:1746066819.808324:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937850 is committed 00000001:00080000:3.0:1746066819.808327:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937849 is committed 00000100:00100000:1.0:1746066819.808330:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808344:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.808358:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191168 00000004:00080000:1.0:1746066819.808360:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165f80/2, rc 0, transno 21474842811 00000100:00100000:0.0:1746066819.808361:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191168 00000100:00100000:1.0:1746066819.808363:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985190144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066819.808369:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f760700/2, rc 0, transno 21474842813 00000100:00100000:3.0:1746066819.808372:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746066819.808372:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985190656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808372:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191680 00000100:00100000:0.0:1746066819.808374:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191680 00000100:00100000:1.0:1746066819.808378:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066819.808379:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985191808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808383:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066819.808383:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20870 00000100:00100000:0.0:1746066819.808386:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882985191168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808399:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066819.808413:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066819.808416:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191040 00000100:00100000:3.0:1746066819.808419:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191040 00000100:00100000:1.0:1746066819.808425:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066819.808436:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191552 00000100:00100000:3.0:1746066819.808438:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191552 00000100:00100000:1.0:1746066819.808442:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20871 00000100:00100000:0.0:1746066819.808446:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985191168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (142us total) trans 17179875470 rc 0/0 00000100:00100000:1.0:1746066819.808447:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985191680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066819.808448:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20872 00000100:00100000:0.0:1746066819.808452:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20870 00000100:00100000:3.0:1746066819.808453:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985191040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066819.808460:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20873 00000100:00100000:0.0:1746066819.808465:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3775:x1830882985191552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066819.808490:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066819.808492:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066819.808494:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066819.808496:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066819.808498:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:3.0:1746066819.808523:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985191040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (122us total) trans 17179875472 rc 0/0 00000100:00100000:1.0:1746066819.808523:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985191680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (178us total) trans 17179875471 rc 0/0 00000100:00100000:0.0:1746066819.808525:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985191552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (97us total) trans 17179875473 rc 0/0 00000100:00100000:3.0:1746066819.808529:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20872 00000100:00100000:1.0:1746066819.808532:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20871 00000100:00100000:0.0:1746066819.808535:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20873 00000100:00100000:3.0:1746066819.808545:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.808553:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985191808 00000100:00100000:0.0:1746066819.808555:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985191808 00000100:00100000:1.0:1746066819.808571:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985190016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 711us (814us total) trans 21474842809 rc 0/0 00000100:00100000:0.0:1746066819.808576:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20874 00000100:00100000:0.0:1746066819.808581:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882985191808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066819.808589:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20860 00000100:00100000:1.0:1746066819.808625:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882985190272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 760us (847us total) trans 21474842810 rc 0/0 00000100:00100000:1.0:1746066819.808629:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20861 00000100:00100000:0.0:1746066819.808637:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3777:x1830882985191808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (91us total) trans 17179875474 rc 0/0 00000100:00100000:1.0:1746066819.808641:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066819.808641:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20874 00000100:00100000:0.0:1746066819.808649:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985190528 00000100:00100000:0.0:1746066819.808651:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985190528 00000004:00080000:1.0:1746066819.808658:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164380/2, rc 0, transno 21474842809 00000100:00100000:0.0:1746066819.808660:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20875 00000100:00100000:1.0:1746066819.808661:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985190016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808664:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882985190528:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066819.808676:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd6a00/2, rc 0, transno 17179875472 00000100:00100000:1.0:1746066819.808679:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066819.808685:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306d80/2, rc 0, transno 17179875473 00000100:00100000:1.0:1746066819.808687:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066819.808692:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304380/2, rc 0, transno 17179875470 00000100:00100000:1.0:1746066819.808695:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191168:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746066819.808698:0:10125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b167b80 reply state ffff88012de2f800 transno 8589937853 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00080000:1.0:1746066819.808700:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304a80/2, rc 0, transno 17179875471 00000100:00100000:1.0:1746066819.808702:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985191680:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066819.808715:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00000004:00080000:1.0:1746066819.808716:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f760000/2, rc 0, transno 21474842815 00000100:00100000:0.0:1746066819.808716:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985190528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (73us total) trans 21474842815 rc 0/0 00000100:00100000:1.0:1746066819.808719:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985190528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066819.808721:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20875 00010000:00010000:3.0:1746066819.808723:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.808725:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066819.808729:0:10125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1746066819.808759:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098926300/2, rc 0, transno 17179875474 00000100:00100000:3.0:1746066819.808762:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985191808:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746066819.808823:0:10125:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066819.808848:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985632000:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 7426us (7593us total) trans 8589937853 rc 0/0 00000100:00100000:3.0:1746066819.808854:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17348 00010000:00010000:1.0:1746066819.808917:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808928:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808935:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808941:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5729000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066819.808944:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808951:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808960:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066819.808962:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066819.808964:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066819.808969:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729000/0xf1867c21abfb2795 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000004:00080000:2.0:1746066819.809036:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094307b80/2, rc 0, transno 17179875469 00000100:00100000:2.0:1746066819.809040:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985191424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066819.809253:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f762d80/2, rc 0, transno 21474842810 00000100:00100000:2.0:1746066819.809257:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066819.809629:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882985190912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1462us (1521us total) trans 17179875468 rc 0/0 00000100:00100000:3.0:1746066819.809635:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20868 00000004:00080000:2.0:1746066819.809845:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d801500/2, rc 0, transno 17179875468 00000100:00100000:2.0:1746066819.809849:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985190912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066819.810461:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.810512:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632640 00000100:00100000:3.0:1746066819.810516:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632640 00000100:00100000:3.0:1746066819.810554:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17349 00000100:00100000:3.0:1746066819.810560:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3652:x1830882985632640:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.810579:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.810594:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81af expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.810637:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.810647:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.810662:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.810865:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066819.810869:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728e00, rc 0) 00000100:00100000:3.0:1746066819.810923:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985632640:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 362us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.810928:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17349 00000100:00100000:0.0:1746066819.813235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066819.813497:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632768 00000100:00100000:3.0:1746066819.813505:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632768 00000100:00100000:3.0:1746066819.813558:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17350 00000100:00100000:3.0:1746066819.813566:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985632768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066819.813583:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.813604:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb27a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81b6 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.813687:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.813700:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.813710:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066819.813742:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00000004:00200000:3.0:1746066819.813746:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066819.813762:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066819.813784:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb27a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.813798:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066819.813807:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066819.813809:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066819.813812:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729e00, rc 0) 00000100:00100000:3.0:1746066819.813860:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985632768:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 295us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.813866:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17350 00000100:00100000:0.0:1746066819.815616:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.815653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.815678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.815690:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.815716:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066819.815734:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985632896 00000100:00100000:0.0:1746066819.815739:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985632896 00000100:00100000:0.0:1746066819.815767:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633152 00000100:00100000:0.0:1746066819.815769:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633152 00000100:00100000:0.0:1746066819.815781:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633408 00000100:00100000:0.0:1746066819.815783:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633408 00000100:00100000:0.0:1746066819.815791:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633024 00000100:00100000:0.0:1746066819.815793:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633024 00000100:00100000:0.0:1746066819.815802:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633280 00000100:00100000:0.0:1746066819.815804:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633280 00000100:00100000:0.0:1746066819.815821:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20876 00000100:00100000:3.0:1746066819.815828:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20877 00000100:00100000:0.0:1746066819.815828:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985632896:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746066819.815836:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985633152:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066819.815836:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20878 00010000:00010000:0.0:1746066819.815840:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.815844:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066819.815845:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985633408:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066819.815852:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066819.815855:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81cb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066819.815855:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81bd expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066819.815862:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81d9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066819.815874:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x800 00002000:00010000:2.0:1746066819.815875:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 4860352, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x1518 00002000:00010000:3.0:1746066819.815902:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x800 00010000:00010000:2.0:1746066819.815906:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.815906:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.815908:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.815908:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.815913:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066819.815915:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066819.815917:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.815917:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.815920:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066819.815929:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.815929:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.815931:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066819.815939:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728800, rc 0) 00010000:00010000:2.0:1746066819.815939:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00010000:00010000:0.0:1746066819.815939:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3200, rc 0) 00000100:00100000:1.0:1746066819.816014:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20879 00000100:00100000:1.0:1746066819.816021:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985633024:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.816028:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.816037:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81c4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066819.816049:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x808 00010000:00010000:1.0:1746066819.816057:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.816059:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066819.816087:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985632896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 259us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.816092:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20876 00000100:00100000:0.0:1746066819.816111:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20880 00000100:00100000:0.0:1746066819.816115:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985633280:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066819.816121:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066819.816128:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81d2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066819.816142:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd83, atime: 0x6812dd83, ctime: 0x6812dd83, blocks: 0x800 00010000:00010000:0.0:1746066819.816149:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066819.816150:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.816166:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.816183:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.816193:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066819.816204:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00000100:00100000:3.0:1746066819.816216:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985633152:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 381us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066819.816222:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20877 00000100:00100000:0.0:1746066819.816222:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985633280:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 106us (505us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066819.816224:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066819.816227:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985633408:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 379us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066819.816227:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20880 00000100:00100000:2.0:1746066819.816236:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20878 00010000:00010000:1.0:1746066819.816242:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718d400, rc 0) 00000100:00100000:1.0:1746066819.816269:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985633024:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 250us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.816274:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20879 00000100:00100000:0.0:1746066819.816287:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066819.816321:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633536 00000100:00100000:1.0:1746066819.816327:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633536 00000100:00100000:1.0:1746066819.816353:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20881 00000100:00100000:1.0:1746066819.816358:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985633536:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066819.816370:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066819.816383:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81e0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066819.816400:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x1000 00010000:00010000:1.0:1746066819.816413:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.816414:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066819.816421:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.816432:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066819.816438:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d2000, rc 0) 00000100:00100000:1.0:1746066819.816467:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985633536:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066819.816472:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20881 00010000:00010000:3.0:1746066820.670268:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066820.823420:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.823478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.823531:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633664 00000100:00100000:1.0:1746066820.823543:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633664 00000100:00100000:1.0:1746066820.823621:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633792 00000100:00100000:1.0:1746066820.823624:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633792 00000100:00100000:2.0:1746066820.823633:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20882 00000100:00100000:2.0:1746066820.823648:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985633664:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:1.0:1746066820.823658:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20883 00000100:00100000:1.0:1746066820.823703:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985633792:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:2.0:1746066820.823769:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985633664:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066820.823777:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20882 00000100:00100000:1.0:1746066820.823793:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985633792:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 128us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.823799:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20883 00000100:00080000:0.0:1746066820.824238:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066820.824517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066820.824559:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.824616:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985633920 00000100:00100000:3.0:1746066820.824620:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985633920 00000100:00100000:1.0:1746066820.824635:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634176 00000100:00100000:3.0:1746066820.824637:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20884 00000100:00100000:1.0:1746066820.824638:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634176 00000100:00100000:3.0:1746066820.824641:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985633920:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:1.0:1746066820.824661:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20885 00000100:00100000:1.0:1746066820.824666:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985634176:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:3.0:1746066820.824700:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985633920:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.824702:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985634176:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.824706:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20884 00000100:00100000:1.0:1746066820.824709:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20885 00000100:00100000:0.0:1746066820.825646:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.825680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.825722:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634048 00000100:00100000:2.0:1746066820.825723:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634304 00000100:00100000:1.0:1746066820.825725:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634048 00000100:00100000:2.0:1746066820.825727:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634304 00000100:00100000:2.0:1746066820.825758:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20886 00000100:00100000:2.0:1746066820.825763:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985634304:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:1.0:1746066820.825763:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20887 00000100:00100000:1.0:1746066820.825769:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985634048:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:2.0:1746066820.825817:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985634304:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066820.825822:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20886 00000100:00100000:1.0:1746066820.825845:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985634048:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.825851:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20887 00000100:00100000:0.0:1746066820.834551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.834589:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.834620:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.834661:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.834697:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634432 00000100:00100000:0.0:1746066820.834705:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634432 00000100:00100000:0.0:1746066820.834738:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634560 00000100:00100000:0.0:1746066820.834741:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634560 00000100:00100000:0.0:1746066820.834752:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634688 00000100:00100000:0.0:1746066820.834753:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634688 00000100:00100000:0.0:1746066820.834761:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634816 00000100:00100000:0.0:1746066820.834762:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634816 00000100:00100000:0.0:1746066820.834773:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20888 00000100:00100000:0.0:1746066820.834779:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985634432:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066820.834870:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985634432:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066820.834876:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20888 00000100:00100000:0.0:1746066820.834911:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20889 00000100:00100000:0.0:1746066820.834915:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985634560:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066820.834952:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985634560:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 37us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066820.834957:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20889 00000100:00100000:0.0:1746066820.834964:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20890 00000100:00100000:0.0:1746066820.834967:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985634688:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066820.834986:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985634688:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 19us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066820.834990:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20890 00000100:00100000:0.0:1746066820.834995:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20891 00000100:00100000:0.0:1746066820.834998:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985634816:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:0.0:1746066820.835017:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985634816:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 18us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066820.835020:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20891 00000100:00100000:0.0:1746066820.835923:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.835958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.836715:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985634944 00000100:00100000:1.0:1746066820.836721:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985634944 00000100:00100000:1.0:1746066820.837117:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985635072 00000100:00100000:1.0:1746066820.837120:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985635072 00000100:00100000:3.0:1746066820.837193:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20892 00000100:00100000:3.0:1746066820.837201:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985634944:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:3.0:1746066820.837296:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985634944:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 86us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.837302:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20892 00000100:00100000:3.0:1746066820.837316:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20893 00000100:00100000:3.0:1746066820.837320:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985635072:12345-192.168.204.16@tcp:23:mirror_io.0 00000100:00100000:3.0:1746066820.837351:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985635072:12345-192.168.204.16@tcp:23:mirror_io.0 Request processed in 31us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.837357:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20893 00000100:00100000:0.0:1746066820.846992:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.847250:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985635328 00000100:00100000:3.0:1746066820.847260:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985635328 00000100:00100000:3.0:1746066820.847330:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7919 00000100:00100000:3.0:1746066820.847339:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2014:x1830882985635328:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:3.0:1746066820.847369:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.847382:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.847383:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.847387:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.847400:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066820.852434:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.852473:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.852499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.852539:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.852584:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985635584 00000100:00100000:0.0:1746066820.852592:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985635584 00000100:00100000:0.0:1746066820.852630:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985635840 00000100:00100000:0.0:1746066820.852632:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985635840 00000100:00100000:0.0:1746066820.852640:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985636096 00000100:00100000:0.0:1746066820.852641:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985636096 00000100:00100000:0.0:1746066820.852652:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985636352 00000100:00100000:0.0:1746066820.852653:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985636352 00000100:00100000:0.0:1746066820.852664:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7920 00000100:00100000:0.0:1746066820.852670:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985635584:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066820.852695:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.852706:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.852707:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.852711:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.852722:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066820.853341:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7921 00000100:00100000:0.0:1746066820.853347:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985635840:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066820.853364:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.853370:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.853372:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.853374:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.853381:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.853861:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7922 00000100:00100000:2.0:1746066820.853869:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+16:2013:x1830882985636096:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:2.0:1746066820.853909:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.853916:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066820.853918:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066820.853920:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.853928:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066820.853929:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7923 00000100:00100000:1.0:1746066820.853937:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+16:2014:x1830882985636352:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066820.853952:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.853959:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.853961:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.853963:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.853971:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066820.858738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.858756:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.858805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.858837:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985636608 00000100:00100000:0.0:1746066820.858844:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985636608 00000100:00100000:0.0:1746066820.858902:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985636864 00000100:00100000:0.0:1746066820.858905:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985636864 00000100:00100000:0.0:1746066820.858934:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985637120 00000100:00100000:0.0:1746066820.858936:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985637120 00000100:00100000:0.0:1746066820.858951:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7924 00000100:00100000:0.0:1746066820.858957:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2013:x1830882985636608:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066820.858986:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.858998:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.859000:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.859003:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.859018:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066820.859435:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7925 00000100:00100000:1.0:1746066820.859443:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+19:2013:x1830882985636864:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066820.859460:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.859467:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.859469:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.859472:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.859481:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066820.859611:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7926 00000100:00100000:0.0:1746066820.859617:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:31c94c27-8194-4112-9e80-db222abc766f+17:2013:x1830882985637120:12345-192.168.204.16@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066820.859631:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.859638:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.859639:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066820.859641:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.859649:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867829:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867844:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867852:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867858:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066820.867861:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867872:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867902:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.867909:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728000/0xf1867c21abfb27db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066820.868988:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+19:2014:x1830882985635328:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 21639us (21992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066820.869001:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7919 00010000:00010000:0.0:1746066820.872279:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872304:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872312:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872318:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066820.872322:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872330:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872345:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066820.872350:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfb27e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066820.872427:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+17:2013:x1830882985635584:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 19753us (19996us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066820.872436:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7920 00010000:00010000:2.0:1746066820.877608:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877621:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877628:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877639:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012155d200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066820.877642:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877650:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877676:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.877683:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb27f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.877769:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+17:2013:x1830882985636096:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 23897us (25265us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066820.877783:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7922 00010000:00010000:1.0:1746066820.884178:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884192:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884199:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884204:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800979a7e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066820.884208:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884215:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884232:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.884238:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a7e00/0xf1867c21abfb27f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066820.884336:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+15:2014:x1830882985636352:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 30396us (31792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066820.884347:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7923 00010000:00010000:2.0:1746066820.886851:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886866:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886873:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886879:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe2200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066820.886905:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886914:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886928:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.886933:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfb27e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.887003:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+15:2013:x1830882985635840:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 33652us (34526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066820.887010:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7921 00010000:00010000:2.0:1746066820.889134:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889147:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889153:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889159:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa47200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066820.889162:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889169:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889184:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.889190:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfb27fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.889257:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985636608:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 30296us (30522us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066820.889266:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7924 00010000:00010000:1.0:1746066820.892474:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892489:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892495:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892500:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629aa00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066820.892503:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892509:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892522:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.892527:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629aa00/0xf1867c21abfb2805 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066820.892593:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985636864:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 33149us (33833us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066820.892601:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7925 00010000:00010000:2.0:1746066820.898454:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898475:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898484:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898491:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066820.898496:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898505:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898525:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.898537:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46000/0xf1867c21abfb280c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.901471:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985637120:12345-192.168.204.16@tcp:3:mirror_io.0 Request processed in 41836us (42647us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066820.901485:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7926 00000100:00100000:0.0:1746066820.911698:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.911801:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985637248 00000100:00100000:3.0:1746066820.911810:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985637248 00000100:00080000:0.0:1746066820.911838:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066820.911946:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 952 00000100:00100000:3.0:1746066820.911954:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985637248:12345-192.168.204.16@tcp:103:mirror_io.0 00010000:00010000:3.0:1746066820.911968:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066820.911997:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2756 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81a1 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.912030:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066820.912034:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066820.912077:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985637248:12345-192.168.204.16@tcp:103:mirror_io.0 Request processed in 123us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.912084:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 952 00000100:00100000:0.0:1746066820.913521:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.913607:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985637504 00000100:00100000:3.0:1746066820.913613:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985637504 00000100:00100000:3.0:1746066820.913787:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6558 00000100:00100000:3.0:1746066820.913795:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+8:3652:x1830882985637504:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066820.914024:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985637504:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 229us (506us total) trans 8589937854 rc 0/0 00000100:00100000:3.0:1746066820.914030:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6558 00000100:00100000:0.0:1746066820.915104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066820.915715:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985637760 00000100:00100000:2.0:1746066820.915722:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985637760 00000100:00100000:2.0:1746066820.915762:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6559 00000100:00100000:2.0:1746066820.915768:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3652:x1830882985637760:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066820.916408:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3652:x1830882985637760:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 639us (1305us total) trans 8589937855 rc 0/0 00000100:00100000:2.0:1746066820.916415:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6559 00000100:00100000:0.0:1746066820.927855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.930452:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638016 00000100:00100000:3.0:1746066820.930467:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638016 00000100:00100000:3.0:1746066820.930543:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17351 00000100:00100000:3.0:1746066820.930553:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:3660:x1830882985638016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066820.930579:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.930599:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb2813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81e7 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.930674:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930687:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930696:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930710:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930716:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930720:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930817:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930826:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930832:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066820.930841:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066820.930953:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930959:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930964:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930970:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930975:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f7800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066820.930978:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930985:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.930996:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066820.930998:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066820.931002:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931010:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb281a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931024:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931028:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931032:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931036:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f7200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066820.931038:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931042:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931047:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cd9700) 00010000:00010000:3.0:1746066820.931049:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066820.931051:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931055:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2821 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.931087:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb2813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.931098:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.931108:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066820.931110:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066820.931111:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6600, rc 0) 00000100:00100000:3.0:1746066820.931169:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3660:x1830882985638016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 618us (3324us total) trans 8589937856 rc 0/0 00000100:00100000:3.0:1746066820.931175:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17351 00000100:00100000:1.0:1746066820.936538:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066820.936613:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638272 00000100:00100000:2.0:1746066820.936623:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638272 00000100:00100000:2.0:1746066820.938116:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6560 00000100:00100000:2.0:1746066820.938127:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3660:x1830882985638272:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066820.938815:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3660:x1830882985638272:12345-192.168.204.16@tcp:35:cat.0 Request processed in 689us (2287us total) trans 8589937857 rc 0/0 00000100:00100000:2.0:1746066820.938822:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6560 00000100:00100000:3.0:1746066820.941112:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.941161:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638528 00000100:00100000:1.0:1746066820.941174:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638528 00000100:00100000:1.0:1746066820.941232:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17352 00000100:00100000:1.0:1746066820.941240:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3665:x1830882985638528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.941264:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.941284:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb2836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81ee expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.941372:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941386:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941397:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941410:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941416:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941421:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941523:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941532:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941538:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066820.941547:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066820.941612:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941622:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941628:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941635:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941640:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066820.941644:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941651:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941661:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066820.941664:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066820.941668:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941672:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfb283d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941700:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941705:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941709:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941714:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629b400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066820.941717:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941721:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941727:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476e00) 00010000:00010000:1.0:1746066820.941730:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066820.941732:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941736:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b400/0xf1867c21abfb2844 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066820.941769:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb2836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.941780:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.941786:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066820.941788:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066820.941790:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:1.0:1746066820.941844:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3665:x1830882985638528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 604us (743us total) trans 8589937858 rc 0/0 00000100:00100000:1.0:1746066820.941851:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17352 00000100:00100000:0.0:1746066820.942880:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.944227:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.944293:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638784 00000100:00100000:3.0:1746066820.944302:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638784 00000100:00100000:3.0:1746066820.944344:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20894 00000100:00100000:3.0:1746066820.944351:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985638784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066820.944369:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.944385:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81fc expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.944408:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.944410:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.944417:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066820.944431:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066820.944443:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7000, rc 0) 00000100:00100000:3.0:1746066820.944497:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985638784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.944506:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20894 00000100:00100000:1.0:1746066820.944552:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.944573:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639040 00000100:00100000:1.0:1746066820.944576:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639040 00000100:00100000:1.0:1746066820.944604:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20895 00000100:00100000:1.0:1746066820.944609:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985639040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.944617:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.944627:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d820a expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.944639:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944641:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944646:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.944656:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.944664:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a600, rc 0) 00000100:00100000:1.0:1746066820.944678:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985639040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.944684:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20895 00000100:00100000:1.0:1746066820.944729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.944738:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639296 00000100:00100000:1.0:1746066820.944740:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639296 00000100:00100000:1.0:1746066820.944767:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20896 00000100:00100000:1.0:1746066820.944772:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985639296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.944778:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.944786:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8218 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.944795:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944796:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066820.944797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066820.944800:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.944810:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066820.944813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066820.944816:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc000, rc 0) 00000100:00100000:2.0:1746066820.944822:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.944831:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985639296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.944835:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20896 00000100:00100000:1.0:1746066820.944844:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638656 00000100:00100000:1.0:1746066820.944846:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638656 00000100:00100000:2.0:1746066820.944850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.944857:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985638912 00000100:00100000:1.0:1746066820.944858:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985638912 00000100:00100000:2.0:1746066820.944866:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639808 00000100:00100000:1.0:1746066820.944868:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639168 00000100:00100000:2.0:1746066820.944869:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639808 00000100:00100000:1.0:1746066820.944870:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639168 00000100:00100000:1.0:1746066820.944880:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20897 00000100:00100000:1.0:1746066820.944900:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985638656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.944905:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066820.944909:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6561 00010000:00010000:1.0:1746066820.944912:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d81f5 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.944915:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3665:x1830882985639808:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:1.0:1746066820.944920:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944922:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944925:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 53 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.944934:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 53 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.944946:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:1.0:1746066820.944961:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985638656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 61us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.944965:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20897 00000100:00100000:1.0:1746066820.944974:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20898 00000100:00100000:1.0:1746066820.944978:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985638912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.944984:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.944990:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8203 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.944998:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.944999:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.945003:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.945011:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.945017:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cdc00, rc 0) 00000100:00100000:1.0:1746066820.945029:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985638912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 51us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.945034:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20898 00000100:00100000:1.0:1746066820.945042:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20899 00000100:00100000:1.0:1746066820.945046:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985639168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.945054:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.945060:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8211 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066820.945066:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3665:x1830882985639808:12345-192.168.204.16@tcp:35:cat.0 Request processed in 151us (215us total) trans 8589937859 rc 0/0 00010000:00010000:1.0:1746066820.945068:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.945069:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.945072:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066820.945073:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6561 00010000:00010000:1.0:1746066820.945080:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.945086:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cd200, rc 0) 00000100:00100000:1.0:1746066820.945099:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985639168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.945105:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20899 00000100:00100000:3.0:1746066820.945983:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639552 00000100:00100000:3.0:1746066820.945991:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639552 00000100:00100000:3.0:1746066820.946019:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17353 00000100:00100000:3.0:1746066820.946025:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3663:x1830882985639552:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066820.946036:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.946047:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb2883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d821f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.946122:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.946135:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.946141:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.946147:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.946152:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 6/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066820.946178:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.946189:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 10 pid: 7244 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066820.946207:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985191936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066820.947034:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.947042:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 31 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066820.947581:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985192064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066820.947803:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.947811:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066820.947818:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985192192:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066820.948441:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066820.948776:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.948821:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066820.948898:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985639936 00000100:00100000:2.0:1746066820.948904:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985639936 00000100:00100000:2.0:1746066820.948944:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640064 00000100:00100000:2.0:1746066820.948946:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640064 00000100:00100000:2.0:1746066820.949407:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20900 00000100:00100000:3.0:1746066820.949415:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20901 00000100:00100000:2.0:1746066820.949415:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985639936:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066820.949423:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985640064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066820.949428:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.949431:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.949442:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d822d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066820.949442:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8226 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.949460:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066820.949460:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.949462:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066820.949462:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066820.949469:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066820.949469:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066820.949482:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066820.949482:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066820.949491:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14600, rc 0) 00010000:00010000:2.0:1746066820.949491:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6600, rc 0) 00000100:00100000:3.0:1746066820.952073:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985640064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2635us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066820.952085:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20901 00000100:00080000:0.0:1746066820.952183:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066820.952189:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066820.952249:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985639936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2832us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066820.952258:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20900 00000100:00100000:0.0:1746066820.952600:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.952716:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640576 00000100:00100000:3.0:1746066820.952724:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640576 00000100:00100000:3.0:1746066820.952759:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17354 00000100:00100000:3.0:1746066820.952765:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3664:x1830882985640576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066820.952789:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066820.952807:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfb289f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8234 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.952880:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.952908:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.952918:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.952929:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.952934:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.952940:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953028:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953037:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953042:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066820.953051:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:3.0:1746066820.953124:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953130:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953136:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953142:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953148:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066820.953152:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953158:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953167:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066820.953170:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066820.953175:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953179:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfb28a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953195:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953200:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953204:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953208:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c15400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066820.953210:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953214:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953220:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cd9400) 00010000:00010000:3.0:1746066820.953222:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066820.953224:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953228:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15400/0xf1867c21abfb28ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066820.953264:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfb289f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.953273:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066820.953279:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066820.953281:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066820.953282:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14c00, rc 0) 00000100:00100000:3.0:1746066820.953340:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3664:x1830882985640576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 574us (741us total) trans 8589937860 rc 0/0 00000100:00100000:3.0:1746066820.953346:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17354 00000100:00100000:1.0:1746066820.953519:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.953536:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640192 00000100:00100000:1.0:1746066820.953539:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640192 00010000:00010000:1.0:1746066820.953558:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 13 pid: 7244 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066820.953587:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9626 00000100:00100000:1.0:1746066820.953593:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985640192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066820.953601:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066820.953605:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 13 pid: 7244 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.953619:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 13 pid: 7244 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.953630:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066820.953633:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.953640:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.953645:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066820.953664:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985640192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.953670:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9626 00000100:00100000:1.0:1746066820.953708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.953719:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640320 00000100:00100000:1.0:1746066820.953723:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640320 00010000:00010000:1.0:1746066820.953733:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 32 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066820.953747:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9627 00000100:00100000:1.0:1746066820.953752:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882985640320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066820.953758:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066820.953762:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 32 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.953769:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 32 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.953779:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066820.953782:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.953788:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.953793:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066820.953806:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882985640320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.953811:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9627 00010000:00010000:2.0:1746066820.954104:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfb284b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81ee expref: 12 pid: 7244 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066820.954116:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985191936:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066820.954126:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6600/0xf1867c21abfb2828 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e7 expref: 31 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066820.954135:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985192064:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066820.954821:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.954837:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.954852:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640704 00000100:00100000:1.0:1746066820.954854:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640704 00000100:00100000:1.0:1746066820.954872:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640832 00000100:00100000:1.0:1746066820.954874:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640832 00000100:00100000:1.0:1746066820.954909:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20902 00000100:00100000:1.0:1746066820.954914:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985640704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.954925:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.954937:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d823b expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.954952:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.954955:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.954962:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.954977:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.954986:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cde00, rc 0) 00000100:00100000:1.0:1746066820.955004:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985640704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.955008:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20902 00000100:00100000:1.0:1746066820.955018:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20903 00000100:00100000:1.0:1746066820.955023:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985640832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.955030:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.955038:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8242 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.955048:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955050:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955054:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 29 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955063:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 29 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955070:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cd000, rc 0) 00000100:00100000:1.0:1746066820.955083:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2013:x1830882985640832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.955088:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20903 00000100:00100000:1.0:1746066820.955115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.955128:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985640960 00000100:00100000:1.0:1746066820.955130:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985640960 00000100:00100000:1.0:1746066820.955143:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20904 00000100:00100000:1.0:1746066820.955147:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2013:x1830882985640960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.955152:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.955159:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8249 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.955168:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955169:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955173:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955181:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955187:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc400, rc 0) 00000100:00100000:1.0:1746066820.955201:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985640960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.955205:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20904 00000100:00100000:1.0:1746066820.955236:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.955246:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985641088 00000100:00100000:1.0:1746066820.955248:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985641088 00000100:00100000:1.0:1746066820.955261:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20905 00000100:00100000:1.0:1746066820.955265:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985641088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066820.955270:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066820.955276:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8250 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.955314:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955315:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066820.955320:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955329:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066820.955336:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a000, rc 0) 00000100:00100000:1.0:1746066820.955347:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985641088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.955352:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20905 00000100:00100000:1.0:1746066820.955407:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.955420:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985641216 00000100:00100000:1.0:1746066820.955423:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985641216 00010000:00010000:1.0:1746066820.955434:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 10 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066820.955449:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9628 00000100:00100000:1.0:1746066820.955453:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985641216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066820.955459:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066820.955463:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 10 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.955471:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 10 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066820.955482:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066820.955485:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.955491:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.955497:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.955511:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066820.955524:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985641216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066820.955528:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9628 00010000:00010000:1.0:1746066820.955613:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfb27aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81b6 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066820.955626:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985192192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066820.955647:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.955655:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066820.955659:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066820.955674:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9054656 00010000:00010000:1.0:1746066820.955766:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6200/0xf1867c21abfb2883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.955779:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066820.955784:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066820.955786:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066820.955788:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7200, rc 0) 00000100:00100000:1.0:1746066820.955806:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3663:x1830882985639552:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9781us (11583us total) trans 8589937861 rc 0/0 00000100:00100000:1.0:1746066820.955811:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17353 00000100:00100000:0.0:1746066820.956976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066820.957047:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985641472 00000100:00100000:2.0:1746066820.957053:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985641472 00002000:00100000:2.0:1746066820.957085:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5d80a80 x1830882985641472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066820.957094:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830882985641472 ext(0->1048575) 00002000:00010000:2.0:1746066820.957098:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80a80 00000100:00100000:2.0:1746066820.957112:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7927 00000100:00100000:2.0:1746066820.957118:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985641472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066820.964255:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.964313:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.964669:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066820.965502:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985641856 00000100:00100000:1.0:1746066820.965511:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985641856 00002000:00100000:1.0:1746066820.965551:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830882985641856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066820.965561:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830882985641856 ext(1048576->2097151) 00002000:00010000:1.0:1746066820.965566:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:1.0:1746066820.965581:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985641984 00000100:00100000:1.0:1746066820.965583:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985641984 00002000:00100000:1.0:1746066820.965593:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d80000 x1830882985641984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066820.965599:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80000 with x1830882985641984 ext(1048576->2097151) 00002000:00010000:1.0:1746066820.965601:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80000 00000100:00100000:1.0:1746066820.965609:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985642112 00000100:00100000:1.0:1746066820.965611:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985642112 00002000:00100000:1.0:1746066820.965617:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5d83800 x1830882985642112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066820.965627:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882985642112 ext(1048576->2097151) 00002000:00010000:1.0:1746066820.965630:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:1.0:1746066820.965639:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7928 00000100:00100000:1.0:1746066820.965645:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985641856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066820.966366:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7929 00000100:00100000:3.0:1746066820.966377:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985641984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066820.966447:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7930 00000100:00100000:2.0:1746066820.966456:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985642112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066820.966707:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.966723:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985642624 00000100:00100000:0.0:1746066820.966727:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985642624 00002000:00100000:0.0:1746066820.966751:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c4f480 x1830882985642624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066820.966760:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f480 with x1830882985642624 ext(0->1048575) 00002000:00010000:0.0:1746066820.966764:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f480 00000100:00100000:0.0:1746066820.966775:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7931 00000100:00100000:0.0:1746066820.966780:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985642624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066820.967427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.968725:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066820.969668:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985642752 00000100:00100000:3.0:1746066820.969677:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985642752 00002000:00100000:3.0:1746066820.969719:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c4ea00 x1830882985642752/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066820.969729:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ea00 with x1830882985642752 ext(1048576->2097151) 00002000:00010000:3.0:1746066820.969735:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ea00 00000100:00100000:3.0:1746066820.969755:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985643008 00000100:00100000:3.0:1746066820.969757:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985643008 00002000:00100000:3.0:1746066820.969767:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880093c4ca80 x1830882985643008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066820.969773:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ca80 with x1830882985643008 ext(1048576->2097151) 00002000:00010000:3.0:1746066820.969776:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ca80 00000100:00100000:3.0:1746066820.969788:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7932 00000100:00100000:3.0:1746066820.969795:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985642752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066820.970494:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7933 00000100:00100000:3.0:1746066820.970502:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985643008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066820.976004:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066820.978638:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985643264 00000100:00100000:0.0:1746066820.978652:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985643264 00002000:00100000:0.0:1746066820.978706:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a4d25f80 x1830882985643264/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/0 e 0 to 0 dl 1746066831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066820.978717:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25f80 with x1830882985643264 ext(1048576->2097151) 00002000:00010000:0.0:1746066820.978723:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25f80 00000100:00100000:0.0:1746066820.979237:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7934 00000100:00100000:0.0:1746066820.979246:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985643264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066820.985125:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+55:2016:x1830882985641472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27994us (28140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066820.985138:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7927 00002000:00100000:2.0:1746066820.985150:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5d80a80 x1830882985641472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066820.985160:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830882985641472 ext(0->1048575) 00002000:00010000:2.0:1746066820.985166:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80a80 00000100:00100000:3.0:1746066820.987443:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985641984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21059us (23120us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066820.987455:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7929 00002000:00100000:3.0:1746066820.987466:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d80000 x1830882985641984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066820.987476:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80000 with x1830882985641984 ext(1048576->2097151) 00002000:00010000:3.0:1746066820.987482:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80000 00000100:00100000:3.0:1746066820.996356:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985642112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29884us (31670us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066820.996588:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7930 00002000:00100000:3.0:1746066820.996605:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5d83800 x1830882985642112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066820.996615:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882985642112 ext(1048576->2097151) 00002000:00010000:3.0:1746066820.996622:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:2.0:1746066821.002996:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985642624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36198us (36273us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.003012:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7931 00002000:00100000:2.0:1746066821.003028:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c4f480 x1830882985642624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.003041:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f480 with x1830882985642624 ext(0->1048575) 00002000:00010000:2.0:1746066821.003048:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f480 00000100:00100000:0.0:1746066821.007163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.007253:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985643392 00000100:00100000:1.0:1746066821.007262:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985643392 00000100:00100000:1.0:1746066821.007342:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17355 00000100:00100000:1.0:1746066821.007350:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3660:x1830882985643392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.007374:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.007392:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541000/0xf1867c21abfb28e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8257 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.007450:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541000/0xf1867c21abfb28e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8257 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.007463:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541000/0xf1867c21abfb28e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8257 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.007479:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.007481:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066821.007485:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541000, rc 0) 00000100:00100000:1.0:1746066821.007526:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3660:x1830882985643392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.007531:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17355 00000100:00080000:0.0:1746066821.008435:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066821.015555:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985642752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 45746us (48115us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.015568:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7932 00002000:00100000:3.0:1746066821.015581:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880093c4ea00 x1830882985642752/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.015591:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ea00 with x1830882985642752 ext(1048576->2097151) 00002000:00010000:3.0:1746066821.015597:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ea00 00000100:00100000:1.0:1746066821.025699:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985641856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 60039us (61441us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066821.025712:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7928 00002000:00100000:1.0:1746066821.025724:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830882985641856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.025733:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830882985641856 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.025740:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:3.0:1746066821.032692:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985643008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 62178us (63957us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.032705:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7933 00002000:00100000:3.0:1746066821.032718:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880093c4ca80 x1830882985643008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.032727:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ca80 with x1830882985643008 ext(1048576->2097151) 00002000:00010000:3.0:1746066821.032733:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4ca80 00000100:00100000:2.0:1746066821.033938:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985643264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 54688us (57942us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.033946:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7934 00002000:00100000:2.0:1746066821.033954:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a4d25f80 x1830882985643264/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:226/0 lens 488/440 e 0 to 0 dl 1746066831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.033960:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25f80 with x1830882985643264 ext(1048576->2097151) 00002000:00010000:2.0:1746066821.033964:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25f80 00000100:00100000:0.0:1746066821.057577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.057630:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.057727:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985643648 00000100:00100000:3.0:1746066821.057736:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985643648 00002000:00100000:3.0:1746066821.057783:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880093c4f800 x1830882985643648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.057793:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f800 with x1830882985643648 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.057798:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f800 00000100:00100000:3.0:1746066821.057826:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985643904 00000100:00100000:3.0:1746066821.057828:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985643904 00002000:00100000:3.0:1746066821.057841:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4d180 x1830882985643904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.057848:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d180 with x1830882985643904 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.057850:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d180 00000100:00100000:3.0:1746066821.057865:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7935 00000100:00100000:3.0:1746066821.057872:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985643648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.057948:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7936 00000100:00100000:0.0:1746066821.057954:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985643904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.079036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.079074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.079231:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985643904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21276us (21598us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066821.079241:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7936 00002000:00100000:0.0:1746066821.079261:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4d180 x1830882985643904/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.079270:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d180 with x1830882985643904 ext(2097152->4194303) 00002000:00010000:0.0:1746066821.079275:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d180 00000100:00100000:0.0:1746066821.079306:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985644160 00000100:00100000:0.0:1746066821.079311:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985644160 00002000:00100000:0.0:1746066821.079346:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880093c4dc00 x1830882985644160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.079352:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4dc00 with x1830882985644160 ext(2097152->4194303) 00002000:00010000:0.0:1746066821.079355:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4dc00 00000100:00100000:0.0:1746066821.079375:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985644416 00000100:00100000:0.0:1746066821.079377:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985644416 00002000:00100000:0.0:1746066821.079387:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4d500 x1830882985644416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.079393:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d500 with x1830882985644416 ext(2097152->4194303) 00002000:00010000:0.0:1746066821.079395:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d500 00000100:00100000:0.0:1746066821.079403:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7937 00000100:00100000:0.0:1746066821.079409:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985644160:12345-192.168.204.16@tcp:3:cat.0 00000100:00080000:0.0:1746066821.080707:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066821.080713:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066821.081189:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7938 00000100:00100000:2.0:1746066821.081206:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985644416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.091162:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985643648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 33278us (33585us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066821.091175:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7935 00002000:00100000:3.0:1746066821.091187:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880093c4f800 x1830882985643648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.091203:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f800 with x1830882985643648 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.091208:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f800 00000100:00100000:2.0:1746066821.105858:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985644160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26436us (26820us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066821.105872:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7937 00002000:00100000:2.0:1746066821.105913:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880093c4dc00 x1830882985644160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.105924:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4dc00 with x1830882985644160 ext(2097152->4194303) 00002000:00010000:2.0:1746066821.105930:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4dc00 00000100:00100000:0.0:1746066821.114438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.116519:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985644672 00000100:00100000:2.0:1746066821.116533:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985644672 00002000:00100000:2.0:1746066821.116586:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4e680 x1830882985644672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.116597:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e680 with x1830882985644672 ext(4194304->4861951) 00002000:00010000:2.0:1746066821.116602:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4e680 00000100:00100000:2.0:1746066821.116646:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7939 00000100:00100000:2.0:1746066821.116654:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985644672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.117460:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985644416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36255us (38382us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066821.117467:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7938 00002000:00100000:3.0:1746066821.117474:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880093c4d500 x1830882985644416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.117480:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d500 with x1830882985644416 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.117484:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d500 00000100:00100000:2.0:1746066821.122413:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985644672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5748us (7974us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066821.122426:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7939 00002000:00100000:2.0:1746066821.122438:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff880093c4e680 x1830882985644672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.122447:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e680 with x1830882985644672 ext(4194304->4861951) 00002000:00010000:2.0:1746066821.122454:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4e680 00000100:00100000:0.0:1746066821.127043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.127329:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.127972:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985644928 00000100:00100000:2.0:1746066821.127982:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985644928 00000100:00100000:2.0:1746066821.128040:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645056 00000100:00100000:2.0:1746066821.128042:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645056 00000100:00100000:2.0:1746066821.128061:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17356 00000100:00100000:2.0:1746066821.128068:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:3663:x1830882985644928:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066821.128089:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.128094:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066821.128123:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541000/0xf1867c21abfb28e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8257 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.128156:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.128161:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066821.128172:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb28ec lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d825e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.128219:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.128236:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.128244:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.128249:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17357 00010000:00010000:2.0:1746066821.128250:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066821.128257:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:3660:x1830882985645056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.128265:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.128273:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8265 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.128294:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.128308:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 11 pid: 7244 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.128321:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192320:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066821.128469:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.128481:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.128493:0:13370:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.128504:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.128514:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066821.128517:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066821.128519:0:13370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.128524:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429c00, rc 0) 00000100:00100000:0.0:1746066821.128548:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:3660:x1830882985645056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 292us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.128557:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17357 00010000:00010000:2.0:1746066821.129523:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.129536:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.129545:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.129793:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.129816:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192320:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066821.130293:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.130782:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645184 00000100:00100000:3.0:1746066821.130788:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645184 00010000:00010000:3.0:1746066821.130836:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 12 pid: 7244 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.130868:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9629 00000100:00100000:3.0:1746066821.130875:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985645184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.130907:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.130913:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 12 pid: 7244 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.130923:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 12 pid: 7244 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.130941:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14c00/0xf1867c21abfb28b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8234 expref: 12 pid: 7244 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.130974:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.130978:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.130984:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.130989:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.131014:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985645184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.131020:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9629 00000100:00080000:0.0:1746066821.131074:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066821.143015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.143118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.143163:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645440 00000100:00100000:0.0:1746066821.143171:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645440 00010000:00010000:0.0:1746066821.143204:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746066821.143231:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9630 00000100:00100000:0.0:1746066821.143238:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985645440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.143251:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066821.143257:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.143270:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.143323:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066821.143328:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.143337:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.143344:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066821.143356:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 33 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.143373:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066821.143422:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985645440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 185us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.143428:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9630 00000100:00100000:2.0:1746066821.143548:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645312 00000100:00100000:2.0:1746066821.143552:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645312 00000100:00100000:2.0:1746066821.143576:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17358 00000100:00100000:2.0:1746066821.143580:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3665:x1830882985645312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.143598:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.143609:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d826c expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.143651:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.143661:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.143669:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.143671:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066821.143673:0:13370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 33 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.143678:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6800, rc 0) 00000100:00100000:2.0:1746066821.143697:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3665:x1830882985645312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.143701:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17358 00010000:00010000:3.0:1746066821.144375:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfb279c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81af expref: 8 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.144389:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192448:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.144407:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.144414:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.144419:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00000040:00080000:3.0:1746066821.144668:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1275, 88 off119792 00000004:00080000:3.0:1746066821.144676:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355792109ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144718:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1276, 88 off119792 00000004:00080000:3.0:1746066821.144722:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355838540ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144746:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1277, 88 off119880 00000004:00080000:3.0:1746066821.144750:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355866315ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144757:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1276, 88 off119880 00000004:00080000:3.0:1746066821.144760:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355876382ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144766:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1277, 88 off119968 00000004:00080000:3.0:1746066821.144769:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355886188ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144777:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1278, 88 off119968 00000004:00080000:3.0:1746066821.144779:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355896210ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144786:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1279, 88 off120056 00000004:00080000:3.0:1746066821.144788:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355904812ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144795:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1280, 88 off120144 00000004:00080000:3.0:1746066821.144797:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355914284ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144805:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1278, 88 off120056 00000004:00080000:3.0:1746066821.144808:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355924702ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144815:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1281, 88 off120232 00000004:00080000:3.0:1746066821.144817:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355934125ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144824:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1279, 88 off120144 00000004:00080000:3.0:1746066821.144827:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355943587ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144834:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1282, 88 off120320 00000004:00080000:3.0:1746066821.144836:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789355953340ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066821.144843:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1280, 88 off120232 00000004:00080000:3.0:1746066821.144846:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355962728ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144854:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1281, 88 off120320 00000004:00080000:3.0:1746066821.144856:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355973299ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144864:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1282, 88 off120408 00000004:00080000:3.0:1746066821.144866:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355982834ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144873:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1283, 88 off120496 00000004:00080000:3.0:1746066821.144875:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789355991508ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066821.144910:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1283, 88 off120408 00000004:00080000:3.0:1746066821.144914:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789356030482ns, next at 733263917711ns, rc = 0 00000001:00080000:3.0:1746066821.147251:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937862 is committed 00000004:00080000:3.0:1746066821.147263:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1257 committed 00000004:00080000:3.0:1746066821.147270:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1259 committed 00000004:00080000:3.0:1746066821.147280:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1258 committed 00000004:00080000:3.0:1746066821.147288:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1257 committed 00000004:00080000:3.0:1746066821.147290:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1256 committed 00000004:00080000:3.0:1746066821.147291:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1256 committed 00000004:00080000:3.0:1746066821.147292:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1255 committed 00000004:00080000:3.0:1746066821.147294:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1255 committed 00000004:00080000:3.0:1746066821.147295:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1254 committed 00000004:00080000:3.0:1746066821.147296:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1254 committed 00000004:00080000:3.0:1746066821.147297:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1253 committed 00000004:00080000:3.0:1746066821.147298:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1252 committed 00000004:00080000:3.0:1746066821.147300:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1253 committed 00000004:00080000:3.0:1746066821.147301:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1252 committed 00000004:00080000:3.0:1746066821.147303:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1251 committed 00000004:00080000:3.0:1746066821.147305:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1250 committed 00000004:00080000:3.0:1746066821.147306:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1251 committed 00000001:00080000:3.0:1746066821.147314:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937860 is committed 00000001:00080000:3.0:1746066821.147323:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937855 is committed 00010000:00010000:3.0:1746066821.147380:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 31 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147392:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.147394:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066821.147398:0:17253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147412:0:17253:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147417:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147422:0:17253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147428:0:17253:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147432:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.147465:0:17253:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.147476:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192576:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.147573:0:17253:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 31 pid: 13370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.147580:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192704:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.147597:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.147968:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066821.148005:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.148027:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066821.148042:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.148059:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066821.148063:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985192832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066821.148078:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.148089:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066821.148100:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.148122:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193216 00000100:00100000:2.0:1746066821.148128:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193216 00000100:00100000:2.0:1746066821.148168:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193728 00000100:00100000:2.0:1746066821.148170:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193728 00000100:00100000:2.0:1746066821.148180:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985192832 00000100:00100000:2.0:1746066821.148182:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985192832 00000100:00100000:2.0:1746066821.148189:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193344 00000100:00100000:2.0:1746066821.148191:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193344 00000100:00100000:2.0:1746066821.148202:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20906 00000100:00100000:2.0:1746066821.148209:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3776:x1830882985193216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066821.148351:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882985193216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (345us total) trans 17179875475 rc 0/0 00000100:00100000:2.0:1746066821.148357:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20906 00000100:00100000:2.0:1746066821.148369:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20907 00000100:00100000:2.0:1746066821.148373:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3776:x1830882985193728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066821.148416:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:2.0:1746066821.148419:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066821.148421:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066821.148423:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066821.148425:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:2.0:1746066821.148447:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882985193728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (398us total) trans 17179875476 rc 0/0 00000100:00100000:2.0:1746066821.148452:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20907 00000100:00100000:2.0:1746066821.148461:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20908 00000100:00100000:2.0:1746066821.148465:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3776:x1830882985192832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066821.148502:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066821.148504:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:2.0:1746066821.148506:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:2.0:1746066821.148508:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:2.0:1746066821.148509:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066821.148526:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882985192832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (447us total) trans 17179875477 rc 0/0 00000100:00100000:2.0:1746066821.148531:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20908 00000100:00100000:2.0:1746066821.148539:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20909 00000100:00100000:2.0:1746066821.148543:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3776:x1830882985193344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066821.148578:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066821.148580:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066821.148582:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066821.148584:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066821.148585:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00080000:0.0:1746066821.148828:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066821.149024:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985193856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.149029:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985192960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066821.152531:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.152535:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985193088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066821.152569:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.152573:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.152590:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.152590:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985193600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.152604:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.152611:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066821.152614:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985194112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.152616:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.152628:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.152642:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985194624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.152644:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193856 00000100:00100000:3.0:1746066821.152649:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193856 00000100:00100000:1.0:1746066821.152655:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.152680:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193088 00000100:00100000:1.0:1746066821.152683:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193088 00000100:00100000:3.0:1746066821.152903:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194368 00000100:00100000:3.0:1746066821.152907:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194368 00000100:00100000:3.0:1746066821.152985:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194112 00000100:00100000:1.0:1746066821.152985:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193600 00000100:00100000:3.0:1746066821.152988:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194112 00000100:00100000:1.0:1746066821.152988:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193600 00000100:00100000:3.0:1746066821.152998:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194624 00000100:00100000:3.0:1746066821.153000:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194624 00000100:00100000:1.0:1746066821.153003:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20910 00000100:00100000:1.0:1746066821.153009:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882985193856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.153010:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20911 00000100:00100000:3.0:1746066821.153016:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3775:x1830882985193088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066821.153136:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 4860352 00002000:00010000:1.0:1746066821.153136:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066821.153139:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066821.153139:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:3.0:1746066821.153141:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066821.153141:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:3.0:1746066821.153143:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066821.153143:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:3.0:1746066821.153145:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5400 00002000:00010000:1.0:1746066821.153146:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066821.153171:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3777:x1830882985193856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (648us total) trans 21474842816 rc 0/0 00000100:00100000:3.0:1746066821.153176:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882985193088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (602us total) trans 17179875479 rc 0/0 00000100:00100000:1.0:1746066821.153178:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20910 00000100:00100000:3.0:1746066821.153182:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20911 00000100:00100000:3.0:1746066821.153193:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20912 00000100:00100000:3.0:1746066821.153198:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882985194368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.153252:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20913 00000100:00100000:1.0:1746066821.153257:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882985194112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.153268:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3777:x1830882985194368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (676us total) trans 21474842817 rc 0/0 00000100:00100000:3.0:1746066821.153273:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20912 00000100:00100000:3.0:1746066821.153296:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20914 00000100:00100000:3.0:1746066821.153301:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3775:x1830882985193600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066821.153354:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882985193600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (749us total) trans 17179875480 rc 0/0 00000100:00100000:3.0:1746066821.153358:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20914 00000100:00100000:3.0:1746066821.153366:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20915 00000100:00100000:3.0:1746066821.153370:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882985194624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.153414:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3775:x1830882985194624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (756us total) trans 21474842819 rc 0/0 00000100:00100000:3.0:1746066821.153418:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20915 00000100:00080000:3.0:1746066821.153440:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746066821.153442:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066821.153445:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066821.153447:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00000100:00100000:3.0:1746066821.153448:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066821.153448:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066821.153450:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066821.153461:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.153468:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882985194112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (839us total) trans 21474842818 rc 0/0 00000100:00100000:1.0:1746066821.153473:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20913 00000100:00100000:3.0:1746066821.153477:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.153481:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194240 00000100:00100000:1.0:1746066821.153483:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194240 00000100:00100000:1.0:1746066821.153494:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194752 00000100:00100000:1.0:1746066821.153496:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194752 00000004:00080000:3.0:1746066821.153501:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5962d80/2, rc 0, transno 21474842816 00000100:00100000:1.0:1746066821.153503:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20916 00000100:00100000:3.0:1746066821.153506:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985193856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.153506:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3777:x1830882985194240:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066821.153512:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963800/2, rc 0, transno 21474842817 00000100:00100000:3.0:1746066821.153514:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.153527:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20917 00000100:00100000:3.0:1746066821.153531:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3777:x1830882985194752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.153561:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3777:x1830882985194240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (111us total) trans 21474842820 rc 0/0 00000100:00100000:1.0:1746066821.153566:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20916 00000004:00080000:1.0:1746066821.153591:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d857800/2, rc 0, transno 17179875479 00000100:00100000:3.0:1746066821.153592:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3777:x1830882985194752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (113us total) trans 21474842821 rc 0/0 00000100:00100000:3.0:1746066821.153597:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20917 00000100:00100000:1.0:1746066821.153599:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985193088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066821.153606:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d854380/2, rc 0, transno 17179875480 00000100:00100000:1.0:1746066821.153610:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985193600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066821.153614:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5961500/2, rc 0, transno 21474842820 00000100:00100000:3.0:1746066821.153616:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066821.153616:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963b80/2, rc 0, transno 21474842818 00000100:00100000:1.0:1746066821.153619:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985194112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066821.153623:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5960e00/2, rc 0, transno 21474842821 00000100:00100000:3.0:1746066821.153626:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985194752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066821.153626:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5962680/2, rc 0, transno 21474842819 00000100:00100000:1.0:1746066821.153629:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985194624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066821.153657:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d856d80/2, rc 0, transno 17179875477 00000100:00100000:3.0:1746066821.153660:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985192832:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066821.153668:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855500/2, rc 0, transno 17179875478 00000100:00100000:3.0:1746066821.153671:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153674:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066821.153679:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855180/2, rc 0, transno 17179875475 00000100:00100000:3.0:1746066821.153682:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153687:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985193472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066821.153688:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c6bb80/2, rc 0, transno 17179875476 00000100:00100000:3.0:1746066821.153691:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985193728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066821.153697:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066821.153701:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985194880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153702:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.153711:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985193984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066821.153718:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.153728:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985192960 00000100:00100000:1.0:1746066821.153731:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985192960 00000100:00100000:1.0:1746066821.153742:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193472 00000100:00100000:1.0:1746066821.153744:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193472 00000100:00100000:1.0:1746066821.153751:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194880 00000100:00100000:1.0:1746066821.153752:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194880 00000100:00100000:1.0:1746066821.153759:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20918 00000100:00100000:3.0:1746066821.153764:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20919 00000100:00100000:1.0:1746066821.153764:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985192960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066821.153769:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985193472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066821.153803:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066821.153805:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066821.153807:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066821.153809:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066819 -> 1746066819 00002000:00010000:1.0:1746066821.153811:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066821.153827:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3774:x1830882985192960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (153us total) trans 17179875481 rc 0/0 00000100:00100000:3.0:1746066821.153832:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3774:x1830882985193472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (128us total) trans 17179875482 rc 0/0 00000100:00100000:1.0:1746066821.153832:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20918 00000100:00100000:3.0:1746066821.153837:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20919 00000100:00100000:1.0:1746066821.153840:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20920 00000100:00100000:1.0:1746066821.153845:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985194880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153905:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882985194880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (186us total) trans 17179875483 rc 0/0 00000004:00080000:3.0:1746066821.153906:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958af100/2, rc 0, transno 17179875483 00000100:00100000:3.0:1746066821.153909:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985194880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153910:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20920 00000100:00100000:1.0:1746066821.153925:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.153935:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985194496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.153947:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066821.153961:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d857b80/2, rc 0, transno 17179875481 00000100:00100000:1.0:1746066821.153963:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985192960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066821.153966:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985193984 00000004:00080000:1.0:1746066821.153969:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d856300/2, rc 0, transno 17179875482 00000100:00100000:0.0:1746066821.153970:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985193984 00000100:00100000:1.0:1746066821.153972:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985193472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066821.153981:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985194496 00000100:00100000:1.0:1746066821.153983:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985194496 00000100:00100000:0.0:1746066821.153987:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20921 00000100:00100000:0.0:1746066821.153991:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882985193984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066821.154008:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20922 00000100:00100000:1.0:1746066821.154012:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882985194496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066821.154036:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066821.154039:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066821.154041:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066821.154042:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066821.154044:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066821.154061:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882985194496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (112us total) trans 21474842823 rc 0/0 00000100:00100000:1.0:1746066821.154065:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20922 00000100:00100000:0.0:1746066821.154065:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882985193984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (140us total) trans 21474842822 rc 0/0 00000100:00100000:0.0:1746066821.154071:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20921 00000004:00080000:1.0:1746066821.154082:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963480/2, rc 0, transno 21474842822 00000100:00100000:1.0:1746066821.154084:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985193984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066821.154089:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5963100/2, rc 0, transno 21474842823 00000100:00100000:1.0:1746066821.154092:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985194496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066821.154136:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985193344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5590us (6032us total) trans 17179875478 rc 0/0 00000100:00100000:2.0:1746066821.154147:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20909 00000100:00100000:0.0:1746066821.158009:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.158042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.158080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.158369:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645568 00000100:00100000:2.0:1746066821.158378:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645568 00000100:00100000:2.0:1746066821.158416:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645696 00000100:00100000:2.0:1746066821.158419:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645696 00000100:00100000:2.0:1746066821.158434:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6562 00000100:00100000:2.0:1746066821.158441:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3660:x1830882985645568:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746066821.158557:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:3660:x1830882985645568:12345-192.168.204.16@tcp:49:cat.0 Request processed in 116us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.158564:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6562 00000100:00100000:2.0:1746066821.158576:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6563 00000100:00100000:2.0:1746066821.158581:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3665:x1830882985645696:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:2.0:1746066821.158611:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3665:x1830882985645696:12345-192.168.204.16@tcp:49:cat.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.158616:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6563 00000100:00100000:3.0:1746066821.158870:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192576:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.158880:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985192704:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.158933:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6a00/0xf1867c21abfb28ec lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 31 pid: 17253 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066821.158955:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.158974:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7a00, rc 0) 00000100:00100000:3.0:1746066821.158994:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:3663:x1830882985644928:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 30927us (31963us total) trans 8589937862 rc 0/0 00000100:00100000:3.0:1746066821.159000:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17356 00000100:00100000:3.0:1746066821.159017:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645824 00000100:00100000:3.0:1746066821.159020:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645824 00000100:00100000:3.0:1746066821.159043:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17359 00000100:00100000:3.0:1746066821.159047:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3664:x1830882985645824:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.159055:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.159067:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb2908 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8273 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.159100:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb2908 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8273 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.159112:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb2908 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8273 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.159122:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.159125:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066821.159127:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14a00, rc 0) 00000100:00100000:3.0:1746066821.159142:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3664:x1830882985645824:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 94us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.159150:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17359 00000100:00100000:0.0:1746066821.164077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.164135:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985645952 00000100:00100000:2.0:1746066821.164145:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985645952 00000100:00100000:2.0:1746066821.164207:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 953 00000100:00100000:2.0:1746066821.164216:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985645952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.164232:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.164259:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfb2908 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8273 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.164300:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.164306:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.164354:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985645952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.164360:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 953 00000100:00100000:0.0:1746066821.171146:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.171695:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.171784:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646336 00000100:00100000:2.0:1746066821.171793:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646336 00002000:00100000:2.0:1746066821.171837:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff8800a5b01500 x1830882985646336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.171846:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01500 with x1830882985646336 ext(4857856->4861951) 00002000:00010000:2.0:1746066821.171851:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b01500 00000100:00100000:2.0:1746066821.171871:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7940 00000100:00100000:2.0:1746066821.171925:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985646336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.172077:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985646336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 199us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066821.172083:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7940 00002000:00100000:2.0:1746066821.172088:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->4861951) req@ffff8800a5b01500 x1830882985646336/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.172095:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01500 with x1830882985646336 ext(4857856->4861951) 00002000:00010000:2.0:1746066821.172098:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b01500 00000100:00100000:3.0:1746066821.173354:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646080 00000100:00100000:3.0:1746066821.173362:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646080 00000100:00100000:3.0:1746066821.173396:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20923 00000100:00100000:3.0:1746066821.173402:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3664:x1830882985646080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.173414:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.173432:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d827a expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.173457:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173776:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173786:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173793:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.173794:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.173798:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.173830:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173842:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 30 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.173854:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.173942:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173949:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 27 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.173956:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.173976:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.173983:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 10 pid: 11630 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.173989:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195264:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.174001:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.176088:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.176447:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.177187:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646592 00000100:00100000:2.0:1746066821.177198:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646592 00002000:00100000:2.0:1746066821.177243:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5b01c00 x1830882985646592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.177253:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01c00 with x1830882985646592 ext(4194304->4861951) 00002000:00010000:2.0:1746066821.177259:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b01c00 00000100:00100000:2.0:1746066821.177291:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7941 00000100:00100000:2.0:1746066821.177299:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985646592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.177724:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646720 00000100:00100000:3.0:1746066821.177729:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646720 00000100:00100000:0.0:1746066821.177952:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.178013:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20924 00000100:00100000:3.0:1746066821.178020:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3663:x1830882985646720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.178030:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.178046:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8281 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.178076:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178084:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178090:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178096:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.178098:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.178101:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.178131:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178142:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 32 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.178154:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.178224:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178232:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 27 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.178241:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.178268:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.178276:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.178298:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.178316:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.178355:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.178379:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646848 00000100:00100000:3.0:1746066821.178382:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646848 00010000:00010000:3.0:1746066821.178397:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 33 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.178415:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9631 00000100:00100000:3.0:1746066821.178420:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985646848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.178427:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.178444:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 33 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.178453:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 33 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.178474:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2867 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8218 expref: 33 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.178490:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.178509:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985646848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.178515:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9631 00000100:00100000:0.0:1746066821.179704:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.179737:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985646976 00000100:00100000:2.0:1746066821.179742:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985646976 00000100:00100000:0.0:1746066821.179743:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066821.179760:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 28 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.180977:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985647104 00000100:00100000:2.0:1746066821.180984:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985647104 00010000:00010000:2.0:1746066821.181013:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.181036:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9632 00000100:00100000:2.0:1746066821.181044:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985646976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.181055:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.181071:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 28 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.181083:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 28 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.181107:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066821.181125:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9633 00000100:00100000:1.0:1746066821.181134:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985647104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066821.181140:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985646976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (1440us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066821.181144:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066821.181146:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9632 00010000:00010000:1.0:1746066821.181154:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.181163:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 889 lvb_type: 1 00000100:00080000:2.0:1746066821.181165:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746066821.181175:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.181177:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.181222:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.181343:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfb28d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8250 expref: 27 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.181357:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195136:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.181369:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb27d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81e0 expref: 11 pid: 11630 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.181378:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985195264:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.181422:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.182059:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.182069:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14a00, rc 0) 00000100:00100000:3.0:1746066821.182102:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3664:x1830882985646080:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8700us (10967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.182108:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20923 00010000:00010000:1.0:1746066821.182110:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.182122:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985195776:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066821.182173:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7db53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.187004:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985646592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9693us (10914us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746066821.187017:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7941 00002000:00100000:2.0:1746066821.187030:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4861951) req@ffff8800a5b01c00 x1830882985646592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.187040:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b01c00 with x1830882985646592 ext(4194304->4861951) 00002000:00010000:2.0:1746066821.187045:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b01c00 00000100:00100000:2.0:1746066821.188764:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195392:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066821.188913:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.188995:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985647360 00000100:00100000:3.0:1746066821.189002:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985647360 00002000:00100000:3.0:1746066821.189040:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4120575) req@ffff8800a5b02d80 x1830882985647360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.189049:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b02d80 with x1830882985647360 ext(4116480->4120575) 00002000:00010000:3.0:1746066821.189054:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b02d80 00000100:00100000:3.0:1746066821.189067:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7942 00000100:00100000:3.0:1746066821.189074:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985647360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.189192:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985647360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 118us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066821.189198:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7942 00002000:00100000:3.0:1746066821.189202:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4120575) req@ffff8800a5b02d80 x1830882985647360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.189209:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b02d80 with x1830882985647360 ext(4116480->4120575) 00002000:00010000:3.0:1746066821.189211:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b02d80 00000100:00100000:2.0:1746066821.189314:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195520:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.189322:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985195648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066821.189339:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985195776:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066821.189349:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066821.189354:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.189370:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985647104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8238us (9627us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066821.189371:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67c00, rc 0) 00000100:00100000:1.0:1746066821.189378:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9633 00000100:00100000:2.0:1746066821.189387:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3663:x1830882985646720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11368us (12940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.189393:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20924 00000100:00100000:0.0:1746066821.189651:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.189678:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.189692:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985647488 00000100:00100000:0.0:1746066821.189695:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985647488 00010000:00010000:0.0:1746066821.189712:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 31 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746066821.189738:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985647744 00000100:00100000:0.0:1746066821.189741:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985647744 00010000:00010000:0.0:1746066821.189750:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746066821.189760:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9634 00000100:00100000:2.0:1746066821.189764:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9635 00000100:00100000:0.0:1746066821.189765:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985647488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066821.189769:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985647744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.189773:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.189775:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.189786:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.189786:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 31 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.189795:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 31 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.189803:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.189968:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066821.190152:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfb2859 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81fc expref: 31 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.190156:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718d400/0xf1867c21abfb27c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81c4 expref: 10 pid: 3528 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.190169:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066821.190172:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.190185:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985647744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 415us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.190185:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985647488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 419us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.190190:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9635 00000100:00100000:2.0:1746066821.190208:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985647616 00000100:00100000:2.0:1746066821.190210:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985647616 00010000:00010000:2.0:1746066821.190219:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 26 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746066821.190337:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9634 00000100:00100000:0.0:1746066821.190348:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9636 00000100:00100000:0.0:1746066821.190354:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985647616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.190361:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066821.190369:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 26 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.190377:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 26 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.190392:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb2898 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d822d expref: 26 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.190402:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.190404:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.190410:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.190417:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.190441:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.190452:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985195904:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066821.190529:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.193388:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985195904:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066821.193409:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066821.193448:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985647616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3093us (3479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.193459:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9636 00000100:00100000:0.0:1746066821.194359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.194398:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.194431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.194462:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648128 00000100:00100000:2.0:1746066821.194469:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648128 00000100:00100000:2.0:1746066821.194501:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648256 00000100:00100000:1.0:1746066821.194501:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648000 00000100:00100000:2.0:1746066821.194504:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648256 00000100:00100000:1.0:1746066821.194505:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648000 00000100:00100000:2.0:1746066821.194517:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20925 00000100:00100000:2.0:1746066821.194523:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985648128:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:1.0:1746066821.194534:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->1679359) req@ffff8800a5b00e00 x1830882985648000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066821.194535:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746066821.194543:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00e00 with x1830882985648000 ext(1675264->1679359) 00002000:00010000:1.0:1746066821.194547:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b00e00 00010000:00010000:2.0:1746066821.194550:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb291d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8288 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.194558:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7943 00000100:00100000:1.0:1746066821.194562:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985648000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.194596:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196032:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066821.194794:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20926 00000100:00100000:3.0:1746066821.194802:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3664:x1830882985648256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.194809:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.194824:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d828f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.194842:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.194850:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.194861:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 52 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.194866:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.194868:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.194871:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.194918:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 52 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.194929:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 52 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.194938:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196160:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.195099:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066821.195800:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985648000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1233us (1440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066821.195807:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7943 00010000:00010000:3.0:1746066821.195808:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746066821.195814:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->1679359) req@ffff8800a5b00e00 x1830882985648000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066821.195817:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 889 lvb_type: 1 00002000:00100000:1.0:1746066821.195822:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b00e00 with x1830882985648000 ext(1675264->1679359) 00000100:00100000:3.0:1746066821.195825:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196288:192.168.204.16@tcp:104: 00002000:00010000:1.0:1746066821.195825:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b00e00 00010000:00010000:3.0:1746066821.195850:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.195862:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 12 pid: 9592 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.195870:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.196172:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00002000:00010000:2.0:1746066821.196857:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066820 -> 1746066822 00002000:00010000:2.0:1746066821.196861:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066820 -> 1746066822 00002000:00010000:2.0:1746066821.196863:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066820 -> 1746066822 00000100:00100000:2.0:1746066821.196879:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196032:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.196921:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb291d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8288 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.196932:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb291d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8288 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.196944:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6600, rc 0) 00000100:00100000:2.0:1746066821.197200:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882985648128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2675us (2799us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066821.197207:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20925 00000100:00100000:3.0:1746066821.197764:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.197772:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.197778:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.197804:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.197817:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66200, rc 0) 00000100:00100000:3.0:1746066821.197849:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3664:x1830882985648256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3047us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.197855:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20926 00000100:00100000:0.0:1746066821.198615:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.198742:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648512 00000100:00100000:2.0:1746066821.198748:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648512 00010000:00010000:2.0:1746066821.198777:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 13 pid: 9592 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.198810:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9637 00000100:00100000:2.0:1746066821.198816:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985648512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.198826:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.198841:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 13 pid: 9592 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.198850:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 13 pid: 9592 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.198874:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfb27bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d9 expref: 13 pid: 9592 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.198908:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.198939:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985648512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.198944:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9637 00000100:00100000:0.0:1746066821.199159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.199207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.199239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.199341:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648384 00000100:00100000:3.0:1746066821.199345:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648384 00000100:00100000:1.0:1746066821.199346:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648640 00000100:00100000:1.0:1746066821.199350:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648640 00010000:00010000:3.0:1746066821.199364:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.199366:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.199390:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9638 00000100:00100000:3.0:1746066821.199395:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985648384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.199401:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066821.199406:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9639 00010000:00010000:3.0:1746066821.199409:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.199412:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985648640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.199417:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.199419:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.199629:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc400/0xf1867c21abfb28d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8249 expref: 31 pid: 11630 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.199632:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.199645:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.199657:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd200/0xf1867c21abfb287c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8211 expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.199673:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.199674:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.199681:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.199689:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.199696:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066821.199715:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.199717:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985648640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 305us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.199722:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9639 00000100:00100000:3.0:1746066821.199725:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985196544:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.199770:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.199785:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648768 00000100:00100000:3.0:1746066821.199787:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648768 00000100:00100000:3.0:1746066821.199983:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20927 00000100:00100000:3.0:1746066821.199989:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+52:3660:x1830882985648768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.200001:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.200011:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8296 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.200319:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.200325:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.200326:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.200329:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.200347:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.200357:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.200366:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.200420:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.202314:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.202593:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985648896 00000100:00100000:2.0:1746066821.202599:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985648896 00000100:00100000:2.0:1746066821.202650:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20928 00000100:00100000:2.0:1746066821.202656:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3663:x1830882985648896:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066821.202711:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985196544:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.202733:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.202777:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985648384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3379us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.202785:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9638 00000100:00100000:3.0:1746066821.202817:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985196672:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.202832:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4857856->5242879] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.202850:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67400, rc 0) 00000100:00100000:3.0:1746066821.202867:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+53:3660:x1830882985648768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2878us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.202872:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20927 00010000:00010000:2.0:1746066821.202953:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.202966:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d829d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.202986:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.202994:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.203001:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.203006:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.203008:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.203011:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1572863] (req 1048576->1572863) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.203038:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.203047:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.203056:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066821.203114:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.203122:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 24 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.203130:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f712d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066821.203150:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.203158:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 8 pid: 20361 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.203165:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.203178:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.208861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.209565:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.209576:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f712d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985196928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.209583:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066821.209611:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1572863] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.209630:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b400, rc 0) 00000100:00100000:2.0:1746066821.209878:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3663:x1830882985648896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7220us (7565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.209903:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20928 00000100:00100000:0.0:1746066821.210147:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.210360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.210401:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985649152 00000100:00100000:3.0:1746066821.210408:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985649152 00010000:00010000:3.0:1746066821.210437:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.210456:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985649024 00000100:00100000:3.0:1746066821.210458:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985649024 00010000:00010000:3.0:1746066821.210465:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.210482:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9640 00000100:00100000:3.0:1746066821.210488:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985649152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.210501:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.210522:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.210543:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9641 00000100:00100000:1.0:1746066821.210551:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985649024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066821.210557:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066821.210568:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.210578:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.210604:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfb2875 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8203 expref: 31 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746066821.210615:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985649280 00000100:00100000:0.0:1746066821.210618:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985649280 00010000:00010000:1.0:1746066821.210619:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066821.210632:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 9 pid: 20361 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.210645:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985649024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.210653:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9642 00000100:00100000:1.0:1746066821.210657:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9641 00000100:00100000:0.0:1746066821.210658:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985649280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.210665:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066821.210674:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 9 pid: 20361 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.210681:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 9 pid: 20361 timeout: 889 lvb_type: 1 00010000:00010000:0.0:1746066821.210693:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfb27b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81cb expref: 9 pid: 20361 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.210694:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066821.210704:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066821.210718:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985649280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.210723:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9642 00010000:00010000:3.0:1746066821.210772:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746066821.210772:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066821.210783:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cde00/0xf1867c21abfb28c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d823b expref: 25 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.210804:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.210806:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.210812:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.210820:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.210845:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985649664 00000100:00100000:1.0:1746066821.210848:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985649664 00000100:00100000:1.0:1746066821.210901:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6564 00010000:00010000:3.0:1746066821.210903:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.210906:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3664:x1830882985649664:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066821.210916:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985197184:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.211171:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8480 going to sleep for 11 seconds 00000001:00080000:1.0:1746066821.211205:0:7246:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589937863 00000100:00100000:1.0:1746066821.211253:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3664:x1830882985649664:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 347us (558us total) trans 8589937864 rc 0/0 00000100:00100000:1.0:1746066821.211258:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6564 00000020:00080000:1.0:1746066821.211261:0:7246:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1746066821.211275:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985649792 00000100:00100000:1.0:1746066821.211277:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985649792 00002000:00100000:1.0:1746066821.211309:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5073343) req@ffff88009666e300 x1830882985649792/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.211318:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666e300 with x1830882985649792 ext(4194304->5073343) 00010000:00010000:1.0:1746066821.211324:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.211334:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 30 pid: 12237 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.211339:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009666e300 00000100:00100000:1.0:1746066821.211384:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2265 00000100:00100000:1.0:1746066821.211390:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985649792:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066821.216174:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985197184:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.216198:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.216239:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985649152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5750us (7388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.216251:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9640 00000100:00100000:0.0:1746066821.223483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.224036:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650048 00000100:00100000:3.0:1746066821.224046:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650048 00002000:00100000:3.0:1746066821.224093:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1568768->1572863) req@ffff88009666ca80 x1830882985650048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.224104:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ca80 with x1830882985650048 ext(1568768->1572863) 00002000:00010000:3.0:1746066821.224110:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666ca80 00000100:00100000:3.0:1746066821.224440:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7944 00000100:00100000:3.0:1746066821.224449:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985650048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.224588:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985650048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 140us (1116us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066821.224594:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7944 00002000:00100000:3.0:1746066821.224599:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1568768->1572863) req@ffff88009666ca80 x1830882985650048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.224605:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ca80 with x1830882985650048 ext(1568768->1572863) 00002000:00010000:3.0:1746066821.224608:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666ca80 00000100:00100000:1.0:1746066821.228074:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985649792:12345-192.168.204.16@tcp:4:cat.0 Request processed in 16675us (17292us total) trans 17179875484 rc 0/0 00000100:00100000:1.0:1746066821.228085:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2265 00002000:00100000:1.0:1746066821.228096:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5073343) req@ffff88009666e300 x1830882985649792/t17179875484(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.228104:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666e300 with x1830882985649792 ext(4194304->5073343) 00010000:00010000:1.0:1746066821.228113:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.228127:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.228140:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009666e300 00000100:00100000:0.0:1746066821.231158:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.231853:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650176 00000100:00100000:3.0:1746066821.231862:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650176 00010000:00010000:3.0:1746066821.232015:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.232785:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9643 00000100:00100000:3.0:1746066821.232795:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985650176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.232810:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066821.232828:0:16766:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 4860352 -> 5073344 00002000:00010000:3.0:1746066821.232831:0:16766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066820 -> 1746066822 00002000:00010000:3.0:1746066821.232833:0:16766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066820 -> 1746066822 00002000:00010000:3.0:1746066821.232835:0:16766:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5400 -> 5816 00010000:00010000:3.0:1746066821.232841:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.232853:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.232904:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb2924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d828f expref: 32 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.232933:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.232935:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.232943:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 52 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.232950:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 52 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.232985:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 52 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.232997:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985197312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.233090:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.236792:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985197312:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.236817:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.236871:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985650176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4077us (5726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.236901:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9643 00000100:00100000:2.0:1746066821.236976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.237159:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650304 00000100:00100000:3.0:1746066821.237165:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650304 00000100:00100000:3.0:1746066821.237901:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20929 00000100:00100000:3.0:1746066821.237910:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985650304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.237932:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.237950:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfb2939 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82a4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.238006:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197440:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066821.238126:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.240762:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197440:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066821.240801:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfb2939 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82a4 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.240815:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfb2939 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82a4 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.240840:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67e00, rc 0) 00000100:00100000:3.0:1746066821.240905:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985650304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2996us (3928us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066821.240913:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20929 00000100:00100000:0.0:1746066821.242251:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.242297:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.242330:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.242574:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650432 00000100:00100000:1.0:1746066821.242585:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650432 00000100:00100000:2.0:1746066821.242760:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650688 00000100:00100000:2.0:1746066821.242766:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650688 00000100:00100000:0.0:1746066821.242911:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.242966:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 235 00000100:00100000:1.0:1746066821.242976:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985650432:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1746066821.243038:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985650432:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 64us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.243044:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 235 00000100:00100000:2.0:1746066821.243119:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650560 00000100:00100000:2.0:1746066821.243122:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650560 00000100:00100000:2.0:1746066821.243140:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985650816 00000100:00100000:2.0:1746066821.243142:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985650816 00000100:00100000:2.0:1746066821.243157:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1018 00000100:00100000:2.0:1746066821.243163:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985650688:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066821.243173:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1019 00000100:00100000:0.0:1746066821.243180:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985650560:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066821.243216:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985650688:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 53us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.243216:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985650560:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 37us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.243222:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1019 00000100:00100000:2.0:1746066821.243225:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1018 00000100:00100000:2.0:1746066821.243236:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1020 00000100:00100000:2.0:1746066821.243241:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985650816:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066821.243259:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985650816:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 19us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.243266:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1020 00000100:00080000:2.0:1746066821.243293:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746066821.244916:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.244972:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651072 00000100:00100000:1.0:1746066821.244979:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651072 00002000:00100000:1.0:1746066821.245010:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->5074943) req@ffff88011f712d80 x1830882985651072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.245019:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712d80 with x1830882985651072 ext(4857856->5074943) 00002000:00010000:1.0:1746066821.245024:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f712d80 00000100:00100000:1.0:1746066821.245038:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7945 00000100:00100000:1.0:1746066821.245043:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985651072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.248432:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985651072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3379us (3512us total) trans 0 rc 217088/217088 00000100:00100000:1.0:1746066821.248442:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7945 00002000:00100000:1.0:1746066821.248451:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4857856->5074943) req@ffff88011f712d80 x1830882985651072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 217088/217088 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.248464:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712d80 with x1830882985651072 ext(4857856->5074943) 00002000:00010000:1.0:1746066821.248469:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f712d80 00000100:00100000:0.0:1746066821.310747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.311830:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651328 00000100:00100000:1.0:1746066821.311841:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651328 00000100:00100000:1.0:1746066821.311946:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17360 00000100:00100000:1.0:1746066821.311959:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3672:x1830882985651328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.311986:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.312006:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb2940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82ab expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.312084:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312097:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312113:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312126:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312133:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312138:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312239:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312249:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312255:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.312265:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.312349:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312355:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312363:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312369:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312375:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d07c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.312379:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312385:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312397:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066821.312400:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.312404:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.312411:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07c00/0xf1867c21abfb2947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313189:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313195:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313199:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313203:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d06a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.313205:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313210:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313218:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476800) 00010000:00010000:1.0:1746066821.313220:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.313222:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313226:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfb294e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.313266:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06e00/0xf1867c21abfb2940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.313277:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.313297:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.313299:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066821.313301:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07800, rc 0) 00000100:00100000:1.0:1746066821.313420:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3672:x1830882985651328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1461us (2685us total) trans 8589937865 rc 0/0 00000100:00100000:1.0:1746066821.313427:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17360 00000100:00100000:0.0:1746066821.316144:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.316265:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651584 00000100:00100000:1.0:1746066821.316275:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651584 00000100:00100000:1.0:1746066821.316337:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6565 00000100:00100000:1.0:1746066821.316345:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3672:x1830882985651584:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066821.316552:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3672:x1830882985651584:12345-192.168.204.16@tcp:35:cat.0 Request processed in 207us (416us total) trans 8589937866 rc 0/0 00000100:00100000:1.0:1746066821.316559:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6565 00000100:00100000:0.0:1746066821.318995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.319549:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.319593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.319618:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651712 00000100:00100000:0.0:1746066821.319627:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651712 00000100:00100000:0.0:1746066821.319663:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651840 00000100:00100000:0.0:1746066821.319665:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651840 00000100:00100000:0.0:1746066821.319673:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985651968 00000100:00100000:0.0:1746066821.319675:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985651968 00000100:00100000:0.0:1746066821.319689:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20930 00000100:00100000:0.0:1746066821.319696:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985651712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.319715:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.319732:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfb2963 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82b2 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.319788:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985197568:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066821.319981:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20931 00000100:00100000:3.0:1746066821.319989:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985651840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.319996:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.320004:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfb296a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82b9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.320032:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197696:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066821.320198:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20932 00000100:00100000:1.0:1746066821.320206:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985651968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.320213:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.320223:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82c0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.320235:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.320237:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.320247:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.320262:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.320274:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07e00, rc 0) 00000100:00100000:1.0:1746066821.320311:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985651968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 106us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.320316:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20932 00000100:00100000:0.0:1746066821.320477:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137618d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.320641:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00002000:00010000:2.0:1746066821.322446:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066820 -> 1746066822 00002000:00010000:2.0:1746066821.322453:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066820 -> 1746066822 00002000:00010000:2.0:1746066821.322455:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066820 -> 1746066822 00000100:00100000:2.0:1746066821.322478:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985197568:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.322511:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfb2963 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82b2 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.322524:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfb2963 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82b2 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.322539:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418600, rc 0) 00000100:00100000:2.0:1746066821.322592:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985651712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2895us (3608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066821.322601:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20930 00002000:00010000:3.0:1746066821.322686:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066820 -> 1746066822 00002000:00010000:3.0:1746066821.322688:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066820 -> 1746066822 00002000:00010000:3.0:1746066821.322690:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066820 -> 1746066822 00000100:00100000:3.0:1746066821.322699:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197696:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066821.322717:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfb296a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82b9 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.322725:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfb296a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82b9 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.322736:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66e00, rc 0) 00000100:00100000:3.0:1746066821.322753:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985651840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2766us (3205us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066821.322758:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20931 00000100:00100000:0.0:1746066821.327451:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.328463:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652224 00000100:00100000:1.0:1746066821.328475:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652224 00002000:00100000:1.0:1746066821.328529:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095869500 x1830882985652224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.328538:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869500 with x1830882985652224 ext(0->1048575) 00002000:00010000:1.0:1746066821.328544:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869500 00000100:00100000:1.0:1746066821.328972:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7946 00000100:00100000:1.0:1746066821.328981:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985652224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.339727:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985652224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10735us (12274us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066821.339740:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7946 00002000:00100000:1.0:1746066821.339751:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880095869500 x1830882985652224/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.339761:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869500 with x1830882985652224 ext(0->1048575) 00002000:00010000:1.0:1746066821.339768:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869500 00000100:00100000:0.0:1746066821.346290:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.346396:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652352 00000100:00100000:3.0:1746066821.346405:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652352 00000100:00100000:3.0:1746066821.346460:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20933 00000100:00100000:3.0:1746066821.346467:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3672:x1830882985652352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.346486:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.346504:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82c7 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.346536:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.346543:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.346544:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.346549:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.346578:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.346589:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 29 pid: 9592 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.346602:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.346688:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.349949:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985197824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.349978:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.349995:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66a00, rc 0) 00000100:00100000:3.0:1746066821.350037:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3672:x1830882985652352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3569us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.350044:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20933 00000100:00100000:0.0:1746066821.351811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.351868:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652480 00000100:00100000:1.0:1746066821.351876:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652480 00002000:00100000:1.0:1746066821.351929:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->2097151) req@ffff88009586bb80 x1830882985652480/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.351939:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985652480 ext(1675264->2097151) 00010000:00010000:1.0:1746066821.351946:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 30 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.351958:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 30 pid: 9592 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.351965:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009586bb80 00000100:00100000:1.0:1746066821.351992:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2266 00000100:00100000:1.0:1746066821.351999:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985652480:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066821.357923:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985652480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5912us (6103us total) trans 21474842824 rc 0/0 00000100:00100000:1.0:1746066821.357938:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2266 00002000:00100000:1.0:1746066821.357950:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1675264->2097151) req@ffff88009586bb80 x1830882985652480/t21474842824(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.357960:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985652480 ext(1675264->2097151) 00010000:00010000:1.0:1746066821.357970:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 32 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.357986:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 32 pid: 9592 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.357993:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009586bb80 00000100:00100000:0.0:1746066821.360864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:2.0:1746066821.361013:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842824 is committed 00000001:00080000:2.0:1746066821.361024:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842823 is committed 00000001:00080000:2.0:1746066821.361058:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842806 is committed 00000001:00080000:2.0:1746066821.361093:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842791 is committed 00000100:00100000:3.0:1746066821.361195:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652608 00000100:00100000:3.0:1746066821.361204:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652608 00010000:00010000:3.0:1746066821.361238:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 18 pid: 9592 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.361264:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9644 00000100:00100000:3.0:1746066821.361270:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985652608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.361296:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.361317:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 18 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.361329:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 18 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.361351:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67c00/0xf1867c21abfb2916 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8281 expref: 18 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.361371:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.361373:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.361379:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.361388:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.361421:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 6 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.361434:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985197952:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.361513:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.365011:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.365167:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985197952:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.365194:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.365232:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+17:2013:x1830882985652608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3962us (4379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.365244:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9644 00000100:00100000:1.0:1746066821.365375:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652864 00000100:00100000:1.0:1746066821.365382:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652864 00002000:00100000:1.0:1746066821.365421:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095868380 x1830882985652864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.365430:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868380 with x1830882985652864 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.365434:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095868380 00000100:00100000:1.0:1746066821.365449:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7947 00000100:00100000:1.0:1746066821.365455:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2013:x1830882985652864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.374736:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2013:x1830882985652864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9268us (9722us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066821.374747:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7947 00002000:00100000:1.0:1746066821.374758:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095868380 x1830882985652864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.374766:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095868380 with x1830882985652864 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.374772:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095868380 00000100:00100000:0.0:1746066821.379712:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.379805:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985652992 00000100:00100000:2.0:1746066821.379814:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985652992 00000100:00100000:2.0:1746066821.380527:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20934 00000100:00100000:2.0:1746066821.380537:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:3672:x1830882985652992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.380556:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.380574:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82ce expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.380606:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.380612:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066821.380614:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066821.380618:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.380649:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.380661:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 16 pid: 9592 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.380673:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066821.381575:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.383086:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066821.383115:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 8 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.383133:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:2.0:1746066821.383185:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3672:x1830882985652992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2648us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.383194:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20934 00000100:00100000:0.0:1746066821.385861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.387287:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985653120 00000100:00100000:1.0:1746066821.387298:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985653120 00002000:00100000:1.0:1746066821.387346:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1572863) req@ffff880095869880 x1830882985653120/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.387355:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869880 with x1830882985653120 ext(1048576->1572863) 00010000:00010000:1.0:1746066821.387366:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 17 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.387379:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 17 pid: 9592 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.387390:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095869880 00000100:00100000:1.0:1746066821.387425:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2267 00000100:00100000:1.0:1746066821.387433:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+17:2016:x1830882985653120:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066821.394765:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985653120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7320us (8901us total) trans 21474842825 rc 0/0 00000100:00100000:1.0:1746066821.394778:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2267 00002000:00100000:1.0:1746066821.394791:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1572863) req@ffff880095869880 x1830882985653120/t21474842825(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.394800:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869880 with x1830882985653120 ext(1048576->1572863) 00010000:00010000:1.0:1746066821.394812:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746066821.394825:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746066821.394831:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095869880 00000100:00100000:0.0:1746066821.399602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.399701:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985653248 00000100:00100000:3.0:1746066821.399710:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985653248 00010000:00010000:3.0:1746066821.399748:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.399789:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9645 00000100:00100000:3.0:1746066821.399796:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882985653248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.399810:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.399829:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.399841:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.399863:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfb2932 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d829d expref: 19 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.399910:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.399912:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.399920:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 7 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.399927:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 7 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.399959:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 7 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.399972:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985198208:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.400704:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.403102:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985198208:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.403125:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.403244:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985653248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3447us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.403255:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9645 00000100:00100000:0.0:1746066821.407185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.407227:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.407411:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985653504 00000100:00100000:1.0:1746066821.407420:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985653504 00002000:00100000:1.0:1746066821.407463:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c5180 x1830882985653504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.407472:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5180 with x1830882985653504 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.407477:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5180 00000100:00100000:1.0:1746066821.407492:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985653760 00000100:00100000:1.0:1746066821.407495:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985653760 00002000:00100000:1.0:1746066821.407507:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a59c4380 x1830882985653760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.407514:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4380 with x1830882985653760 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.407516:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4380 00000100:00100000:1.0:1746066821.407529:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7948 00000100:00100000:1.0:1746066821.407535:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985653504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.408071:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7949 00000100:00100000:3.0:1746066821.408079:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985653760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.418757:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985653760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10666us (11515us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.418769:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7949 00002000:00100000:3.0:1746066821.418782:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a59c4380 x1830882985653760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.418791:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4380 with x1830882985653760 ext(1048576->2097151) 00002000:00010000:3.0:1746066821.418798:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4380 00000100:00100000:1.0:1746066821.419441:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985653504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11904us (12265us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066821.419449:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7948 00002000:00100000:1.0:1746066821.419453:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a59c5180 x1830882985653504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.419460:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5180 with x1830882985653504 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.419463:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5180 00000100:00100000:0.0:1746066821.441938:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.441985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.442057:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985654144 00000100:00100000:3.0:1746066821.442066:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985654144 00002000:00100000:3.0:1746066821.442114:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a59c4e00 x1830882985654144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.442125:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4e00 with x1830882985654144 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.442130:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4e00 00000100:00100000:3.0:1746066821.442161:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985654272 00000100:00100000:3.0:1746066821.442164:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985654272 00002000:00100000:3.0:1746066821.442178:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4116479) req@ffff8800a59c4700 x1830882985654272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.442185:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4700 with x1830882985654272 ext(2097152->4116479) 00002000:00010000:3.0:1746066821.442188:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c4700 00000100:00100000:3.0:1746066821.442202:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7950 00000100:00100000:3.0:1746066821.442209:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985654144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.443115:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7951 00000100:00100000:1.0:1746066821.443125:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985654272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.465209:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.465290:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985654528 00000100:00100000:1.0:1746066821.465299:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985654528 00000100:00100000:1.0:1746066821.465363:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17361 00000100:00100000:1.0:1746066821.465371:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3676:x1830882985654528:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066821.465400:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.465418:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82d5 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.465495:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465507:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465517:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465528:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465532:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465536:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465623:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465631:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465636:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.465643:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.465710:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465715:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465720:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465725:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465730:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.465734:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465739:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465749:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066821.465752:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.465755:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465759:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb298d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465787:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465791:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465795:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465799:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.465801:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465805:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465810:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476f00) 00010000:00010000:1.0:1746066821.465812:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.465814:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465818:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bce00/0xf1867c21abfb2994 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.465851:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.465859:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.465865:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.465866:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066821.465868:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bc400, rc 0) 00000100:00100000:1.0:1746066821.465953:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3676:x1830882985654528:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 583us (754us total) trans 8589937867 rc 0/0 00000100:00100000:1.0:1746066821.465958:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17361 00000100:00100000:3.0:1746066821.469918:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985654144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27670us (27954us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066821.469930:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7950 00002000:00100000:3.0:1746066821.469943:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a59c4e00 x1830882985654144/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.469952:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4e00 with x1830882985654144 ext(2097152->4194303) 00002000:00010000:3.0:1746066821.469959:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4e00 00000100:00100000:0.0:1746066821.473480:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.473937:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985654784 00000100:00100000:3.0:1746066821.473947:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985654784 00000100:00100000:3.0:1746066821.474006:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17362 00000100:00100000:3.0:1746066821.474014:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3674:x1830882985654784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.474040:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.474057:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfb29a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82dc expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.474136:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474152:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474162:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474177:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474182:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474186:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474297:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfb29be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474306:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfb29be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474312:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfb29be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066821.474320:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066821.474384:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474389:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474395:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474399:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474405:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f66400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066821.474409:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474414:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474422:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066821.474425:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066821.474428:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474432:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66400/0xf1867c21abfb29b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474460:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474465:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474469:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474472:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f67c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066821.474474:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474477:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474482:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9700) 00010000:00010000:3.0:1746066821.474483:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066821.474485:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474489:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67c00/0xf1867c21abfb29b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.474520:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfb29a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82dc expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.474529:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfb29be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82dc expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.474535:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.474536:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066821.474538:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66600, rc 0) 00000100:00100000:3.0:1746066821.474582:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3674:x1830882985654784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 569us (1114us total) trans 8589937868 rc 0/0 00000100:00100000:3.0:1746066821.474587:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17362 00000100:00100000:0.0:1746066821.479682:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.479728:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985654272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36602us (37739us total) trans 0 rc 2019328/2019328 00000100:00100000:2.0:1746066821.479740:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7951 00002000:00100000:2.0:1746066821.479752:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4116479) req@ffff8800a59c4700 x1830882985654272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2019328/2019328 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.479761:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4700 with x1830882985654272 ext(2097152->4116479) 00002000:00010000:2.0:1746066821.479767:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c4700 00000100:00100000:0.0:1746066821.481267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.481310:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.481316:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655296 00000100:00100000:1.0:1746066821.481324:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655296 00000100:00100000:1.0:1746066821.481370:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6566 00000100:00100000:1.0:1746066821.481377:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3676:x1830882985655296:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066821.481596:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:3676:x1830882985655296:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 219us (333us total) trans 8589937869 rc 0/0 00000100:00100000:1.0:1746066821.481601:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6566 00000100:00100000:2.0:1746066821.481704:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655040 00000100:00100000:2.0:1746066821.481708:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655040 00000100:00100000:2.0:1746066821.481743:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 954 00000100:00100000:2.0:1746066821.481748:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985655040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.481756:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.481780:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfb29be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82dc expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.481798:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.481802:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.481820:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985655040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.481825:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 954 00000100:00100000:3.0:1746066821.482140:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985654912 00000100:00100000:3.0:1746066821.482144:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985654912 00000100:00100000:3.0:1746066821.482861:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20935 00000100:00100000:3.0:1746066821.482869:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3674:x1830882985654912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.482881:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.483267:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82e3 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.483432:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483445:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 33 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483452:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 52 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483457:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.483459:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.483463:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [2060288->2068479] (req 2060288->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.483493:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 52 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483505:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 52 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.483518:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198336:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.483604:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 33 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483613:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 33 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.483621:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198464:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.483646:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.483658:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 11 pid: 9590 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.483666:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198592:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.483682:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.490337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.490401:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655552 00000100:00100000:2.0:1746066821.490411:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655552 00002000:00100000:2.0:1746066821.490459:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a59c6a00 x1830882985655552/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.490469:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6a00 with x1830882985655552 ext(4194304->5074943) 00002000:00010000:2.0:1746066821.490475:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c6a00 00000100:00100000:2.0:1746066821.490508:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7952 00000100:00100000:2.0:1746066821.490516:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2013:x1830882985655552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.491648:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198336:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.491658:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198464:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.491665:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985198592:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066821.491680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066821.491696:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [2060288->2068479] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.491702:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066821.491712:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66200, rc 0) 00000100:00100000:0.0:1746066821.491895:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.491910:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655680 00000100:00100000:0.0:1746066821.491913:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655680 00010000:00010000:0.0:1746066821.491932:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.492247:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:3674:x1830882985654912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9378us (12576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.492255:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20935 00000100:00100000:0.0:1746066821.492662:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655936 00000100:00100000:0.0:1746066821.492665:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655936 00010000:00010000:0.0:1746066821.492679:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 12 pid: 9590 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.492708:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985655808 00000100:00100000:1.0:1746066821.492712:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985655808 00010000:00010000:1.0:1746066821.492724:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 35 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746066821.492745:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9646 00000100:00100000:1.0:1746066821.492751:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985655680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066821.492762:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066821.492781:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492791:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492810:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a600/0xf1867c21abfb2860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d820a expref: 53 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492826:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066821.492845:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985655680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.492850:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9646 00000100:00100000:1.0:1746066821.492912:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9647 00000100:00100000:1.0:1746066821.492917:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985655936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066821.492923:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066821.492930:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 12 pid: 9590 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492937:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 12 pid: 9590 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492952:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfb27cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81d2 expref: 12 pid: 9590 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.492959:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066821.492971:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985655936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.492975:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9647 00000100:00100000:1.0:1746066821.492984:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9648 00000100:00100000:1.0:1746066821.492988:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985655808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066821.492993:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066821.492998:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 35 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.493006:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 35 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.493016:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cd000/0xf1867c21abfb28c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8242 expref: 35 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746066821.493023:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.493025:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.493036:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.493048:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.493079:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.493090:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985198720:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066821.493141:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.503910:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.504110:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985198720:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066821.504128:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066821.504164:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2016:x1830882985655808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11175us (12281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.504173:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9648 00000100:00100000:2.0:1746066821.504241:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985656192 00000100:00100000:2.0:1746066821.504247:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985656192 00000100:00100000:2.0:1746066821.504296:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17363 00000100:00100000:2.0:1746066821.504303:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:3679:x1830882985656192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.504324:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.504339:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a000/0xf1867c21abfb29d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82ea expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.504344:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985655552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13829us (14019us total) trans 0 rc 880640/880640 00000100:00100000:0.0:1746066821.504352:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7952 00002000:00100000:0.0:1746066821.504360:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a59c6a00 x1830882985655552/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.504375:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6a00 with x1830882985655552 ext(4194304->5074943) 00002000:00010000:0.0:1746066821.504379:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c6a00 00010000:00010000:2.0:1746066821.504409:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504422:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504431:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504442:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504446:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504451:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504530:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb29e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504537:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb29e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504542:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb29e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066821.504549:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066821.504614:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504620:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504625:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504630:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504636:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066821.504640:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504646:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504654:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066821.504657:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066821.504660:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504664:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb29da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504689:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504697:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504701:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504704:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589a600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066821.504706:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504710:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504714:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20c00) 00010000:00010000:2.0:1746066821.504716:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066821.504717:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504720:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a600/0xf1867c21abfb29e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066821.504748:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a000/0xf1867c21abfb29d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ea expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.504757:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb29e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ea expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.504762:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.504764:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066821.504766:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589bc00, rc 0) 00000100:00100000:2.0:1746066821.504791:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:3679:x1830882985656192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 490us (919us total) trans 8589937870 rc 0/0 00000100:00100000:2.0:1746066821.504797:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17363 00000100:00100000:3.0:1746066821.505320:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.505502:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985656448 00000100:00100000:0.0:1746066821.505507:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985656448 00002000:00100000:0.0:1746066821.505532:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2064383) req@ffff8800a5d7f480 x1830882985656448/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.505540:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882985656448 ext(2060288->2064383) 00002000:00010000:0.0:1746066821.505543:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:0.0:1746066821.505566:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7953 00000100:00100000:0.0:1746066821.505571:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985656448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.505679:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985656448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 107us (360us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066821.505684:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7953 00002000:00100000:0.0:1746066821.505688:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2064383) req@ffff8800a5d7f480 x1830882985656448/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.505696:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882985656448 ext(2060288->2064383) 00002000:00010000:0.0:1746066821.505698:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:1.0:1746066821.508138:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.508170:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.508208:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.508265:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657088 00000100:00100000:0.0:1746066821.508273:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657088 00000100:00100000:3.0:1746066821.508297:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985656704 00000100:00100000:3.0:1746066821.508301:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985656704 00002000:00100000:3.0:1746066821.508329:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (2064384->2068479) req@ffff880094371f80 x1830882985656704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.508338:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371f80 with x1830882985656704 ext(2064384->2068479) 00002000:00010000:3.0:1746066821.508344:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371f80 00000100:00100000:3.0:1746066821.508459:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7954 00000100:00100000:3.0:1746066821.508466:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985656704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.508575:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985656704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 109us (445us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066821.508581:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7954 00002000:00100000:3.0:1746066821.508585:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (2064384->2068479) req@ffff880094371f80 x1830882985656704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.508592:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371f80 with x1830882985656704 ext(2064384->2068479) 00002000:00010000:3.0:1746066821.508594:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371f80 00000100:00100000:0.0:1746066821.508754:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6567 00000100:00100000:0.0:1746066821.508761:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:3679:x1830882985657088:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066821.510983:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:3679:x1830882985657088:12345-192.168.204.16@tcp:35:cat.0 Request processed in 2213us (2764us total) trans 8589937871 rc 0/0 00000100:00100000:0.0:1746066821.511002:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6567 00000100:00100000:0.0:1746066821.511040:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985656832 00000100:00100000:0.0:1746066821.511046:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985656832 00000100:00100000:0.0:1746066821.511081:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 955 00000100:00100000:0.0:1746066821.511086:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985656832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.511097:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066821.511123:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb29e8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ea expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.511143:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066821.511147:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066821.511179:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985656832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.511185:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 955 00000100:00100000:1.0:1746066821.511437:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.511597:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657216 00000100:00100000:3.0:1746066821.511601:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657216 00000100:00100000:3.0:1746066821.511628:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20936 00000100:00100000:3.0:1746066821.511633:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+18:3676:x1830882985657216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.511647:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.511660:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82f1 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.511744:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.511751:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.511753:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.511756:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2875392->3145727] (req 2875392->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.511792:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.511803:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 7 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.511815:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198848:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.512214:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.518130:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.518212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.518251:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657600 00000100:00100000:0.0:1746066821.518260:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657600 00000100:00100000:2.0:1746066821.518303:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657472 00000100:00100000:2.0:1746066821.518308:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657472 00002000:00100000:0.0:1746066821.518322:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4194303) req@ffff88012c492d80 x1830882985657600/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.518332:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882985657600 ext(4116480->4194303) 00010000:00010000:0.0:1746066821.518341:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 8 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.518351:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6568 00010000:00010000:0.0:1746066821.518356:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 8 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.518358:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3674:x1830882985657472:12345-192.168.204.16@tcp:35:multiop.0 00002000:00010000:0.0:1746066821.518368:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c492d80 00000100:00100000:0.0:1746066821.518382:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2268 00000100:00100000:0.0:1746066821.518388:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2016:x1830882985657600:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066821.518548:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3674:x1830882985657472:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 190us (430us total) trans 8589937872 rc 0/0 00000100:00100000:2.0:1746066821.518555:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6568 00000100:00100000:3.0:1746066821.518564:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198848:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.518591:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2875392->3145727] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.518605:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14600, rc 0) 00000100:00100000:3.0:1746066821.518624:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+19:3676:x1830882985657216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6991us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.518631:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20936 00000100:00100000:0.0:1746066821.518846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.518919:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657856 00000100:00100000:3.0:1746066821.518923:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657856 00000100:00100000:1.0:1746066821.518923:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.518947:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.519018:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985658112 00000100:00100000:2.0:1746066821.519019:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657728 00000100:00100000:3.0:1746066821.519021:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985658112 00000100:00100000:2.0:1746066821.519023:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657728 00000100:00100000:2.0:1746066821.519035:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20937 00000100:00100000:2.0:1746066821.519042:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985657856:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066821.519049:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20938 00000100:00100000:3.0:1746066821.519055:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985658112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.519064:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.519078:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb29fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d830d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.519118:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198976:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.519172:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066821.519174:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00010000:00010000:2.0:1746066821.519180:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82ff expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.519192:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.519194:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.519203:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.519216:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.519223:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a800, rc 0) 00000100:00100000:2.0:1746066821.519238:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985657856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 198us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.519244:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20937 00000100:00100000:0.0:1746066821.519267:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20939 00000100:00100000:0.0:1746066821.519274:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985657728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.519291:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.519298:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d82f8 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.519308:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.519310:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.519315:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 23 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.519324:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 23 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.519331:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf800, rc 0) 00000100:00100000:0.0:1746066821.519344:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985657728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.519349:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20939 00000100:00100000:0.0:1746066821.520493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.520539:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985657984 00000100:00100000:3.0:1746066821.520544:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985657984 00000100:00100000:3.0:1746066821.520576:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20940 00000100:00100000:3.0:1746066821.520581:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985657984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.520591:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.520603:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2a12 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8306 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.520634:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985199104:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066821.520687:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.521796:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985657600:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3405us (3581us total) trans 21474842826 rc 0/0 00000100:00100000:0.0:1746066821.521808:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2268 00002000:00100000:0.0:1746066821.521816:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4194303) req@ffff88012c492d80 x1830882985657600/t21474842826(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.521825:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882985657600 ext(4116480->4194303) 00010000:00010000:0.0:1746066821.521831:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.521843:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00002000:00010000:0.0:1746066821.521849:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c492d80 00002000:00010000:3.0:1746066821.524052:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066819 -> 1746066822 00002000:00010000:3.0:1746066821.524061:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066819 -> 1746066822 00002000:00010000:3.0:1746066821.524063:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066819 -> 1746066822 00000100:00100000:3.0:1746066821.524086:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985199104:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066821.524120:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2a12 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8306 expref: 53 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.524134:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2a12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8306 expref: 53 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.524162:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2de00, rc 0) 00000100:00100000:3.0:1746066821.524213:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985657984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3630us (3723us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066821.524222:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20940 00000100:00100000:3.0:1746066821.524489:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985198976:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066821.524507:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb29fd lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d830d expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.524516:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb29fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d830d expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.524525:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14c00, rc 0) 00000100:00100000:3.0:1746066821.524558:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985658112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5503us (5635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066821.524563:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20938 00000100:00100000:0.0:1746066821.526663:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.527255:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985658240 00000100:00100000:2.0:1746066821.527264:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985658240 00010000:00010000:2.0:1746066821.527309:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.527335:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9649 00000100:00100000:2.0:1746066821.527341:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985658240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.527356:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.527376:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.527387:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.527406:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb290f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d827a expref: 10 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.527434:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.527436:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.527450:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.527458:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.527606:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.527744:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985199232:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066821.528294:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.531482:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985199232:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066821.531504:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.531565:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985658240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4221us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.531575:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9649 00000100:00100000:0.0:1746066821.531667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.531706:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985658496 00000100:00100000:2.0:1746066821.531712:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985658496 00002000:00100000:2.0:1746066821.531748:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->2879487) req@ffff88012c491c00 x1830882985658496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.531758:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882985658496 ext(2875392->2879487) 00002000:00010000:2.0:1746066821.531763:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:2.0:1746066821.531784:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7955 00000100:00100000:2.0:1746066821.531791:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985658496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.532104:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985658496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 312us (437us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066821.532110:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7955 00002000:00100000:2.0:1746066821.532115:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->2879487) req@ffff88012c491c00 x1830882985658496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.532121:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882985658496 ext(2875392->2879487) 00002000:00010000:2.0:1746066821.532124:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:0.0:1746066821.532343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.532358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.532378:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.532420:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985658880 00000100:00100000:2.0:1746066821.532423:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985658880 00000100:00100000:3.0:1746066821.532435:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659136 00000100:00100000:3.0:1746066821.532440:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659136 00000100:00100000:1.0:1746066821.532440:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659008 00002000:00100000:2.0:1746066821.532441:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c493800 x1830882985658880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066821.532443:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659008 00002000:00100000:2.0:1746066821.532448:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882985658880 ext(0->1048575) 00002000:00010000:2.0:1746066821.532451:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c493800 00002000:00100000:1.0:1746066821.532457:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c491500 x1830882985659008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.532458:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c490700 x1830882985659136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.532464:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882985659008 ext(1048576->2097151) 00002000:00100000:3.0:1746066821.532465:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882985659136 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.532467:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00002000:00010000:3.0:1746066821.532468:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:2.0:1746066821.532476:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7956 00000100:00100000:1.0:1746066821.532480:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7957 00000100:00100000:2.0:1746066821.532481:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985658880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.532483:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985659008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.532493:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7958 00000100:00100000:3.0:1746066821.532499:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985659136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.537305:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.537455:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659392 00000100:00100000:3.0:1746066821.537463:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659392 00000100:00100000:3.0:1746066821.537792:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20941 00000100:00100000:3.0:1746066821.537800:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+54:3676:x1830882985659392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.537822:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.537840:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8314 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.537878:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 55 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.537906:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.537912:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.537914:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.537917:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 55 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.537947:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.537957:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 31 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.537972:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.540365:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 55 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.540383:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 55 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.540403:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.540464:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.542125:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985658880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9636us (9775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.542138:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7956 00002000:00100000:2.0:1746066821.542150:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88012c493800 x1830882985658880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.542159:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882985658880 ext(0->1048575) 00002000:00010000:2.0:1746066821.542165:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:3.0:1746066821.545345:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.545603:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.545635:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 53 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.545654:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83800, rc 0) 00000100:00100000:2.0:1746066821.545672:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882985659136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13170us (13310us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.545676:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:3676:x1830882985659392:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7877us (8383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.545681:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7958 00000100:00100000:3.0:1746066821.545682:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20941 00002000:00100000:2.0:1746066821.545691:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c490700 x1830882985659136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.545700:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882985659136 ext(1048576->2097151) 00002000:00010000:2.0:1746066821.545706:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:0.0:1746066821.551157:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.551344:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659520 00000100:00100000:2.0:1746066821.551353:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659520 00010000:00010000:2.0:1746066821.551390:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.551416:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9650 00000100:00100000:1.0:1746066821.551417:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985659008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18931us (19036us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.551422:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985659520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066821.551425:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7957 00010000:00010000:2.0:1746066821.551433:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746066821.551434:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c491500 x1830882985659008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.551441:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882985659008 ext(1048576->2097151) 00002000:00010000:1.0:1746066821.551445:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00010000:00010000:2.0:1746066821.551450:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.551459:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.551482:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfb292b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4857856->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8296 expref: 53 pid: 12237 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.551515:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.551536:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985659520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.551541:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9650 00000100:00100000:0.0:1746066821.552978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.553033:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659648 00000100:00100000:2.0:1746066821.553039:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659648 00010000:00010000:2.0:1746066821.553067:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746066821.553096:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9651 00000100:00100000:2.0:1746066821.553102:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2013:x1830882985659648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.553113:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.553129:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.553138:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.553157:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07e00/0xf1867c21abfb2971 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c0 expref: 32 pid: 1893 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746066821.553169:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.553171:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.553178:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 51 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.553186:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 51 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.553216:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 51 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.553228:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985199616:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066821.553318:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.555942:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985199616:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066821.555963:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.556006:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985659648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2903us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.556016:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9651 00000100:00100000:0.0:1746066821.557058:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.557668:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985659904 00000100:00100000:1.0:1746066821.557677:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985659904 00002000:00100000:1.0:1746066821.557725:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3227648->3231743) req@ffff88009d89ca80 x1830882985659904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.557740:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ca80 with x1830882985659904 ext(3227648->3231743) 00002000:00010000:1.0:1746066821.557746:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ca80 00000100:00100000:1.0:1746066821.558062:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7959 00000100:00100000:1.0:1746066821.558070:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882985659904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.558213:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882985659904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 144us (1158us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066821.558219:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7959 00002000:00100000:1.0:1746066821.558223:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3227648->3231743) req@ffff88009d89ca80 x1830882985659904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.558229:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ca80 with x1830882985659904 ext(3227648->3231743) 00002000:00010000:1.0:1746066821.558232:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ca80 00000100:00100000:0.0:1746066821.563485:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.564021:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985660032 00000100:00100000:3.0:1746066821.564030:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985660032 00000100:00100000:3.0:1746066821.564085:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20942 00000100:00100000:3.0:1746066821.564092:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+52:3679:x1830882985660032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066821.564112:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.564129:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d831b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.564158:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.564165:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.564167:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.564170:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 53 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.564199:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.564210:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 30 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.564222:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199744:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.564679:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.570525:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985199744:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.570560:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 53 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.570577:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece800, rc 0) 00000100:00100000:0.0:1746066821.570873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.571729:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+53:3679:x1830882985660032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7634us (8252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.571738:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20942 00000100:00100000:2.0:1746066821.571997:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985660160 00000100:00100000:2.0:1746066821.572005:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985660160 00002000:00100000:2.0:1746066821.572045:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2068479) req@ffff88009d89ed80 x1830882985660160/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 8680/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.572053:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ed80 with x1830882985660160 ext(2060288->2068479) 00010000:00010000:2.0:1746066821.572060:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 31 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.572073:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 31 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.572079:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d89ed80 00000100:00100000:2.0:1746066821.572691:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2269 00000100:00100000:2.0:1746066821.572700:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985660160:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066821.573966:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2015:x1830882985660160:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1264us (3090us total) trans 17179875485 rc 0/0 00000100:00100000:2.0:1746066821.573975:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2269 00002000:00100000:2.0:1746066821.573983:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2068479) req@ffff88009d89ed80 x1830882985660160/t17179875485(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 8680/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.573991:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ed80 with x1830882985660160 ext(2060288->2068479) 00010000:00010000:2.0:1746066821.573999:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 33 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.574010:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 33 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.574022:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d89ed80 00000001:00080000:3.0:1746066821.575732:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875485 is committed 00000001:00080000:3.0:1746066821.575750:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875483 is committed 00000001:00080000:3.0:1746066821.575784:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875465 is committed 00000001:00080000:3.0:1746066821.575814:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875451 is committed 00000100:00100000:0.0:1746066821.577611:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.577685:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985660288 00000100:00100000:2.0:1746066821.577695:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985660288 00010000:00010000:2.0:1746066821.577729:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 7 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.577768:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9652 00000100:00100000:2.0:1746066821.577776:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2013:x1830882985660288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.577789:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.577808:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 7 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.577819:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 7 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.577844:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66200/0xf1867c21abfb29cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82e3 expref: 7 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.577873:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.577875:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.577902:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.577911:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.577950:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.577967:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985199872:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066821.578492:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.581837:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f711880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985199872:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.581862:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.581944:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+6:2013:x1830882985660288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4167us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.581956:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9652 00000100:00100000:0.0:1746066821.583851:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.584045:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985660544 00000100:00100000:2.0:1746066821.584058:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985660544 00002000:00100000:2.0:1746066821.584102:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89ea00 x1830882985660544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.584112:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985660544 ext(1048576->2097151) 00002000:00010000:2.0:1746066821.584118:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00000100:00100000:2.0:1746066821.584148:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7960 00000100:00100000:2.0:1746066821.584155:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985660544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.593677:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985660544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9512us (9826us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.593688:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7960 00002000:00100000:2.0:1746066821.593699:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89ea00 x1830882985660544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.593707:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985660544 ext(1048576->2097151) 00002000:00010000:2.0:1746066821.593713:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00000100:00100000:0.0:1746066821.615531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.615648:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985660800 00000100:00100000:2.0:1746066821.615657:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985660800 00002000:00100000:2.0:1746066821.615698:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89df80 x1830882985660800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 504/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.615709:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89df80 with x1830882985660800 ext(2097152->4194303) 00002000:00010000:2.0:1746066821.615714:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89df80 00000100:00100000:2.0:1746066821.615745:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7961 00000100:00100000:2.0:1746066821.615752:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985660800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.620296:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.620903:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985661056 00000100:00100000:1.0:1746066821.620911:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985661056 00002000:00100000:1.0:1746066821.620955:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89f480 x1830882985661056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 504/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.620964:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985661056 ext(2097152->4194303) 00002000:00010000:1.0:1746066821.620969:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:1.0:1746066821.620997:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7962 00000100:00100000:1.0:1746066821.621004:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882985661056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.631514:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985660800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15753us (15981us total) trans 0 rc 2011136/2011136 00000100:00100000:2.0:1746066821.631525:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7961 00002000:00100000:2.0:1746066821.631536:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89df80 x1830882985660800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 504/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2011136/2011136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.631545:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89df80 with x1830882985660800 ext(2097152->4194303) 00002000:00010000:2.0:1746066821.631550:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89df80 00000100:00100000:1.0:1746066821.640161:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882985661056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19142us (19871us total) trans 0 rc 1826816/1826816 00000100:00100000:1.0:1746066821.640175:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7962 00002000:00100000:1.0:1746066821.640190:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89f480 x1830882985661056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 504/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1826816/1826816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.640199:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985661056 ext(2097152->4194303) 00002000:00010000:1.0:1746066821.640206:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:0.0:1746066821.645363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.645626:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985661312 00000100:00100000:2.0:1746066821.645636:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985661312 00000100:00100000:1.0:1746066821.646171:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17364 00000100:00100000:1.0:1746066821.646181:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3686:x1830882985661312:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066821.646369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.646500:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985661568 00000100:00100000:2.0:1746066821.646504:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985661568 00002000:00100000:2.0:1746066821.646541:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88009d89f800 x1830882985661568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.646550:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f800 with x1830882985661568 ext(4194304->5074943) 00002000:00010000:2.0:1746066821.646556:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f800 00000100:00100000:2.0:1746066821.646580:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7963 00000100:00100000:2.0:1746066821.646586:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985661568:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066821.646700:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.646720:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c600/0xf1867c21abfb2a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8322 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.646952:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.646964:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.646974:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.646986:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.646991:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.646995:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647086:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfb2a3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647094:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfb2a3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647098:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfb2a3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.647106:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.647174:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647179:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647184:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647189:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647193:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7de00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.647196:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647202:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647211:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066821.647213:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.647216:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647221:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647250:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647255:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647259:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647262:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.647264:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647267:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647280:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476e00) 00010000:00010000:1.0:1746066821.647282:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.647284:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647288:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb2a35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.647323:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c600/0xf1867c21abfb2a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8322 expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.647332:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfb2a3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8322 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.647338:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.647339:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066821.647341:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7dc00, rc 0) 00000100:00100000:1.0:1746066821.647558:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3686:x1830882985661312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1378us (2206us total) trans 8589937873 rc 0/0 00000100:00100000:1.0:1746066821.647563:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17364 00000100:00100000:0.0:1746066821.652871:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.652985:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985661824 00000100:00100000:1.0:1746066821.652994:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985661824 00000100:00100000:0.0:1746066821.652999:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.653253:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6569 00000100:00100000:1.0:1746066821.653262:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3686:x1830882985661824:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066821.653296:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985661952 00000100:00100000:3.0:1746066821.653300:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985661952 00000100:00100000:3.0:1746066821.653343:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 956 00000100:00100000:3.0:1746066821.653348:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985661952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.653358:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.653379:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfb2a3c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8322 expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.653394:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.653399:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.653435:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985661952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.653437:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3686:x1830882985661824:12345-192.168.204.16@tcp:35:cat.0 Request processed in 177us (579us total) trans 8589937874 rc 0/0 00000100:00100000:3.0:1746066821.653441:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 956 00000100:00100000:1.0:1746066821.653442:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6569 00000100:00100000:2.0:1746066821.654098:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985661568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7509us (7727us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066821.654110:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7963 00002000:00100000:2.0:1746066821.654119:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88009d89f800 x1830882985661568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.654128:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f800 with x1830882985661568 ext(4194304->5074943) 00002000:00010000:2.0:1746066821.654374:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89f800 00000100:00100000:0.0:1746066821.656846:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.657031:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662592 00000100:00100000:1.0:1746066821.657041:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662592 00000100:00100000:1.0:1746066821.657096:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17365 00000100:00100000:1.0:1746066821.657104:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3687:x1830882985662592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066821.657129:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.657147:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d833e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.657236:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657248:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657258:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657268:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657283:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657288:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657376:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb2a5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657385:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657390:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.657398:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.657464:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657470:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657479:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657485:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657490:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.657494:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657501:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657511:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066821.657513:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.657517:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657522:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb2a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657535:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657540:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657545:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657548:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.657550:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657558:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657563:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476300) 00010000:00010000:1.0:1746066821.657565:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.657566:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657571:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb2a58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.657601:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfb2a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d833e expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.657610:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb2a5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d833e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.657616:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.657617:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066821.657619:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c400, rc 0) 00000100:00100000:1.0:1746066821.657677:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3687:x1830882985662592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 573us (839us total) trans 8589937875 rc 0/0 00000100:00100000:1.0:1746066821.657683:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17365 00000100:00100000:0.0:1746066821.657964:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.658064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.658105:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.658123:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662208 00000100:00100000:0.0:1746066821.658126:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662208 00000100:00100000:1.0:1746066821.658129:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662080 00000100:00100000:1.0:1746066821.658140:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662080 00000100:00100000:0.0:1746066821.658148:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662336 00000100:00100000:0.0:1746066821.658150:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662336 00000100:00100000:0.0:1746066821.658164:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20943 00000100:00100000:0.0:1746066821.658170:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985662208:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066821.658297:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20944 00000100:00100000:1.0:1746066821.658306:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985662336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.658320:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.658336:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2a6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8337 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.658380:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200000:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066821.658381:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20945 00000100:00100000:2.0:1746066821.658390:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985662080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.658400:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.658413:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8329 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.658426:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.658428:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.658436:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.658446:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.658455:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589ac00, rc 0) 00000100:00100000:1.0:1746066821.658462:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.658477:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985662080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.658483:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20945 00010000:00010000:0.0:1746066821.659021:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.659028:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfb2a7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8330 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066821.659059:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985200128:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066821.659266:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066821.664032:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200000:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066821.664068:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2a6d lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8337 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.664080:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2a6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8337 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.664104:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:1.0:1746066821.664150:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985662336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5845us (6043us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066821.664158:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20944 00002000:00010000:0.0:1746066821.664358:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066820 -> 1746066822 00000100:00100000:0.0:1746066821.664371:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985200128:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066821.664389:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfb2a7b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8330 expref: 8 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.664396:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fae000/0xf1867c21abfb2a7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8330 expref: 8 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.664421:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae000, rc 0) 00000100:00100000:0.0:1746066821.664437:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985662208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6267us (6474us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066821.664443:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20943 00000100:00100000:0.0:1746066821.667855:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.668293:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662720 00000100:00100000:2.0:1746066821.668302:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662720 00000100:00100000:2.0:1746066821.668359:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 957 00000100:00100000:2.0:1746066821.668367:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985662720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.668379:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.668402:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb2a5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d833e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.668431:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.668435:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.668953:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985662720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 585us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.668961:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 957 00010000:00010000:3.0:1746066821.672546:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066821.678315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.678835:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985662976 00000100:00100000:2.0:1746066821.678846:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985662976 00002000:00100000:2.0:1746066821.678921:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5884380 x1830882985662976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.679039:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884380 with x1830882985662976 ext(1048576->2097151) 00002000:00010000:2.0:1746066821.679045:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884380 00000100:00100000:2.0:1746066821.679322:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7964 00000100:00100000:2.0:1746066821.679331:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985662976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.682283:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.682426:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985663232 00000100:00100000:3.0:1746066821.682434:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985663232 00000100:00100000:3.0:1746066821.682481:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17366 00000100:00100000:3.0:1746066821.682489:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:3691:x1830882985663232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.682512:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.682532:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2a82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8345 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.682609:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682622:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682633:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682645:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682651:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682656:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682750:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2a97 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682760:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682766:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066821.682774:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066821.682847:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682853:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682859:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682864:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682870:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d07600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066821.682874:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682905:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682918:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066821.682921:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066821.682926:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682931:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07600/0xf1867c21abfb2a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682947:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682951:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682956:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682960:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d06200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066821.682963:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682967:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682973:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34e600) 00010000:00010000:3.0:1746066821.682975:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066821.682977:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.682985:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06200/0xf1867c21abfb2a90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066821.683021:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2a82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8345 expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.683030:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8345 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.683036:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.683038:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066821.683039:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06c00, rc 0) 00000100:00100000:3.0:1746066821.683085:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:3691:x1830882985663232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 597us (821us total) trans 8589937876 rc 0/0 00000100:00100000:3.0:1746066821.683091:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17366 00000100:00100000:0.0:1746066821.687005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.688443:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985663488 00000100:00100000:0.0:1746066821.688452:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985663488 00000100:00100000:2.0:1746066821.688570:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.688598:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985663616 00000100:00100000:2.0:1746066821.688603:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985663616 00000100:00100000:2.0:1746066821.688669:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 958 00000100:00100000:2.0:1746066821.688680:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985663616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.688698:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.688730:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2a97 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8345 expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.688752:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.688757:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066821.688810:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985663616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.688818:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 958 00000100:00100000:1.0:1746066821.689362:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6570 00000100:00100000:1.0:1746066821.689368:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:3691:x1830882985663488:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066821.689392:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2016:x1830882985662976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10063us (11090us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066821.689399:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7964 00002000:00100000:0.0:1746066821.689407:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5884380 x1830882985662976/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.689415:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884380 with x1830882985662976 ext(1048576->2097151) 00002000:00010000:0.0:1746066821.689419:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884380 00000100:00100000:1.0:1746066821.690101:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:3691:x1830882985663488:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 729us (3103us total) trans 8589937877 rc 0/0 00000100:00100000:1.0:1746066821.690108:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6570 00000100:00100000:0.0:1746066821.693683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.693839:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985663744 00000100:00100000:2.0:1746066821.693848:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985663744 00000100:00100000:2.0:1746066821.693961:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20946 00000100:00100000:2.0:1746066821.693969:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985663744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.693988:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.694004:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589b600/0xf1867c21abfb2aa5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d834c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.694061:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985200256:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066821.694150:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.694619:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.695149:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985663872 00000100:00100000:1.0:1746066821.695153:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985663872 00000100:00100000:1.0:1746066821.695184:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20947 00000100:00100000:1.0:1746066821.695189:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985663872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.695199:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.695214:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2aac lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8353 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.695240:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200384:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066821.695283:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.696411:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882985200256:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.696439:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589b600/0xf1867c21abfb2aa5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d834c expref: 8 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.696450:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589b600/0xf1867c21abfb2aa5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d834c expref: 8 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.696476:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589b600, rc 0) 00000100:00100000:2.0:1746066821.696505:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2015:x1830882985663744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2537us (2833us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066821.696512:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20946 00000100:00100000:1.0:1746066821.696693:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200384:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066821.696707:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2aac lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8353 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.696715:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2aac lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8353 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.696722:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7ce00, rc 0) 00000100:00100000:1.0:1746066821.696740:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985663872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1551us (2122us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066821.696745:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20947 00000100:00100000:0.0:1746066821.699007:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.699137:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664000 00000100:00100000:1.0:1746066821.699147:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664000 00000100:00100000:1.0:1746066821.699290:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20948 00000100:00100000:1.0:1746066821.699299:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:3686:x1830882985664000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.699319:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.699336:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d835a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.699365:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.699374:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066821.699376:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066821.699379:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.699414:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.699428:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 26 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066821.699440:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985200512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066821.700164:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.702874:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.703104:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664128 00000100:00100000:2.0:1746066821.703113:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664128 00002000:00100000:2.0:1746066821.703157:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3231743) req@ffff8800a5885880 x1830882985664128/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.703167:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885880 with x1830882985664128 ext(3145728->3231743) 00010000:00010000:2.0:1746066821.703177:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 27 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.703192:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 27 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.703199:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5885880 00000100:00100000:2.0:1746066821.703227:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2270 00000100:00100000:2.0:1746066821.703234:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985664128:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066821.703430:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985200512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.703459:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 8 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.703474:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:1.0:1746066821.703501:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3686:x1830882985664000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4203us (4506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.703508:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20948 00000100:00100000:0.0:1746066821.711780:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985664128:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8535us (8904us total) trans 17179875486 rc 0/0 00000100:00100000:0.0:1746066821.711793:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2270 00002000:00100000:0.0:1746066821.711807:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->3231743) req@ffff8800a5885880 x1830882985664128/t17179875486(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.711817:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885880 with x1830882985664128 ext(3145728->3231743) 00010000:00010000:0.0:1746066821.711828:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.711843:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:0.0:1746066821.711850:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5885880 00000100:00100000:0.0:1746066821.717233:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.717360:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664256 00000100:00100000:3.0:1746066821.717369:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664256 00010000:00010000:3.0:1746066821.717406:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.717485:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9653 00000100:00100000:3.0:1746066821.717493:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985664256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.717508:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.717529:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.717546:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.717568:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83800/0xf1867c21abfb2a19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3231743) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8314 expref: 29 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.717598:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.717600:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.717607:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.717612:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.717641:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 7 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.717651:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985200640:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.717730:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.720535:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985200640:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.720556:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.720594:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985664256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3101us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.720604:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9653 00000100:00100000:0.0:1746066821.725484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.725563:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664512 00000100:00100000:2.0:1746066821.725572:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664512 00002000:00100000:2.0:1746066821.725618:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800967a8000 x1830882985664512/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.725626:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882985664512 ext(2097152->3145727) 00002000:00010000:2.0:1746066821.725631:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:2.0:1746066821.726159:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7965 00000100:00100000:2.0:1746066821.726167:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985664512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066821.737258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.737360:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664640 00000100:00100000:1.0:1746066821.737369:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664640 00000100:00100000:1.0:1746066821.737429:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17367 00000100:00100000:1.0:1746066821.737437:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:3692:x1830882985664640:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066821.737466:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.737484:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb2aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8361 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.737526:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985664512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11358us (12053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.737537:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7965 00010000:00010000:1.0:1746066821.737545:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00002000:00100000:2.0:1746066821.737549:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800967a8000 x1830882985664512/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066821.737557:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00002000:00100000:2.0:1746066821.737558:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882985664512 ext(2097152->3145727) 00002000:00010000:2.0:1746066821.737563:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8000 00010000:00010000:1.0:1746066821.737567:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737578:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737583:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737587:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737647:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737657:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.737663:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.737690:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.737706:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 36 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746066821.737718:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985200768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066821.737781:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.739083:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.739163:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094371500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985200768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.739178:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066821.739232:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664768 00000100:00100000:3.0:1746066821.739237:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664768 00010000:00010000:3.0:1746066821.739257:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 37 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.739301:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9654 00000100:00100000:3.0:1746066821.739306:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985664768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.739315:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.739320:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 37 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.739328:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 37 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.739346:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb288a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d821f expref: 37 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.739359:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066821.739363:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066821.739369:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066821.739375:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066821.739397:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.739418:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985664768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.739423:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9654 00010000:00010000:0.0:1746066821.739727:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739733:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066821.739787:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:0.0:1746066821.739791:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066821.739808:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739817:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739829:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739838:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739845:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739850:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739855:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bde00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066821.739859:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739865:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739873:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066821.739875:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066821.739879:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739906:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739960:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739965:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739970:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739974:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066821.739977:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739981:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739988:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476500) 00010000:00010000:0.0:1746066821.739990:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066821.739993:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.739997:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd600/0xf1867c21abfb2ac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.740027:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bda00/0xf1867c21abfb2aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.740038:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.740043:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066821.740045:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066821.740047:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd800, rc 0) 00000100:00100000:0.0:1746066821.742060:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3692:x1830882985664640:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4613us (4803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.742070:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17367 00000100:00100000:2.0:1746066821.742238:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.742403:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985664896 00000100:00100000:0.0:1746066821.742409:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985664896 00000100:00100000:0.0:1746066821.742441:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20949 00000100:00100000:0.0:1746066821.742447:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3686:x1830882985664896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.742468:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.742484:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8368 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.742515:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.742521:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.742524:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.742527:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.742553:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.742565:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 20 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746066821.742576:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066821.743820:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066821.744011:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.744030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.744055:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.744085:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665152 00000100:00100000:1.0:1746066821.744090:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665152 00000100:00100000:1.0:1746066821.744113:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665280 00000100:00100000:1.0:1746066821.744115:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665280 00000100:00100000:1.0:1746066821.744131:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20950 00000100:00100000:1.0:1746066821.744137:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+6:2014:x1830882985665152:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066821.744147:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.744159:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d836f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.744176:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066821.744178:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066821.744317:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985200896:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066821.744337:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.744348:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:0.0:1746066821.744379:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3686:x1830882985664896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1931us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.744385:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20949 00000100:00100000:0.0:1746066821.744400:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20951 00000100:00100000:0.0:1746066821.744404:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985665280:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066821.744411:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.744417:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8376 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.744428:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.744430:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.744435:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.744446:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066821.744453:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf800, rc 0) 00000100:00100000:0.0:1746066821.744467:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985665280:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.744472:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20951 00000100:00100000:2.0:1746066821.744550:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.744562:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665408 00000100:00100000:2.0:1746066821.744565:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665408 00000100:00100000:2.0:1746066821.744581:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20952 00000100:00100000:2.0:1746066821.744585:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985665408:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066821.744591:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.744599:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d837d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.744610:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.744611:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.744615:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.744623:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.744629:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589be00, rc 0) 00000100:00100000:2.0:1746066821.744640:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985665408:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 55us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.744648:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20952 00000100:00100000:2.0:1746066821.744681:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.744691:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665536 00000100:00100000:2.0:1746066821.744693:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665536 00000100:00100000:2.0:1746066821.744704:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20953 00000100:00100000:2.0:1746066821.744707:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985665536:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066821.744712:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.744718:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8384 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.744727:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.744728:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.744732:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.744739:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.744745:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a000, rc 0) 00000100:00100000:2.0:1746066821.744755:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985665536:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 47us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.744759:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20953 00000100:00100000:2.0:1746066821.744786:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.744794:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665664 00000100:00100000:2.0:1746066821.744796:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665664 00000100:00100000:2.0:1746066821.744805:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20954 00000100:00100000:2.0:1746066821.744809:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985665664:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066821.744814:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.744819:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb2af9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d838b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.744843:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985201024:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066821.744871:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066821.744994:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.745009:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066821.745016:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd200, rc 0) 00000100:00100000:1.0:1746066821.745034:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985665152:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 898us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.745039:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20950 00000100:00100000:3.0:1746066821.745106:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665024 00000100:00100000:3.0:1746066821.745110:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665024 00002000:00100000:3.0:1746066821.745139:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->3145727) req@ffff880094373800 x1830882985665024/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.745148:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373800 with x1830882985665024 ext(2875392->3145727) 00010000:00010000:3.0:1746066821.745153:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 21 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.745164:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 21 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746066821.745171:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094373800 00000100:00100000:3.0:1746066821.745189:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2271 00000100:00100000:3.0:1746066821.745193:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882985665024:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066821.745806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.745849:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985665792 00000100:00100000:3.0:1746066821.745852:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985665792 00000100:00100000:3.0:1746066821.745867:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20955 00000100:00100000:3.0:1746066821.745871:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:3691:x1830882985665792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.745877:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.745899:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8392 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.745915:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066821.745919:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.745924:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066821.745926:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3059711] (req 2514944->3059711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.745951:0:3528:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.745961:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2514944->3059711] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.745968:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779800, rc 0) 00000100:00100000:3.0:1746066821.745985:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:3691:x1830882985665792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 114us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.745990:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20955 00000100:00100000:2.0:1746066821.750420:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985201024:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.750462:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb2af9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d838b expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.750475:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589bc00/0xf1867c21abfb2af9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d838b expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.750489:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589bc00, rc 0) 00000100:00100000:2.0:1746066821.750534:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985665664:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5722us (5744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066821.750542:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20954 00000100:00100000:0.0:1746066821.752714:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985665024:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7510us (8674us total) trans 21474842827 rc 0/0 00000100:00100000:0.0:1746066821.752726:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2271 00002000:00100000:0.0:1746066821.752737:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2875392->3145727) req@ffff880094373800 x1830882985665024/t21474842827(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.752752:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373800 with x1830882985665024 ext(2875392->3145727) 00010000:00010000:0.0:1746066821.752761:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.752775:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00002000:00010000:0.0:1746066821.752781:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094373800 00000100:00100000:1.0:1746066821.752810:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.752880:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985666048 00000100:00100000:0.0:1746066821.753089:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985666048 00000100:00100000:0.0:1746066821.753681:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17368 00000100:00100000:0.0:1746066821.753689:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3692:x1830882985666048:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066821.753708:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.753725:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8399 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.753942:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.753959:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.753966:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.753998:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.754012:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 8 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746066821.754025:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985201280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066821.754124:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.756784:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.757000:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e437480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985201280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.757021:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066821.757150:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.757232:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985666176 00000100:00100000:2.0:1746066821.757239:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985666176 00010000:00010000:2.0:1746066821.757266:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.757307:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985666304 00000100:00100000:2.0:1746066821.757309:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985666304 00010000:00010000:2.0:1746066821.757321:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.757340:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9655 00000100:00100000:2.0:1746066821.757347:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985666176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.757359:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066821.757367:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9656 00000100:00100000:0.0:1746066821.757374:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985666304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066821.757378:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.757383:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066821.757388:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.757388:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.757398:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.757409:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfb29f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f1 expref: 24 pid: 3528 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.757412:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd800/0xf1867c21abfb2acf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8361 expref: 9 pid: 10125 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.757425:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.757426:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066821.757427:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.757431:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066821.757434:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.757439:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066821.757442:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.757445:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066821.757460:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066821.757472:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.757483:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 9 pid: 11630 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746066821.757492:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985666304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.757498:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9656 00000100:00100000:2.0:1746066821.757499:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985201408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066821.757546:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066821.757923:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.757930:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.757949:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.758320:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb2b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8399 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.758349:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8399 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.758355:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.758358:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066821.758360:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf200, rc 0) 00000100:00100000:1.0:1746066821.759054:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3692:x1830882985666048:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5363us (6242us total) trans 8589937878 rc 0/0 00000100:00100000:1.0:1746066821.759062:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17368 00000100:00100000:3.0:1746066821.759421:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985201408:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.759438:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.759472:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882985666176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2125us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.759479:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9655 00000100:00100000:0.0:1746066821.762028:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.762109:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985666560 00000100:00100000:1.0:1746066821.762118:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985666560 00000100:00100000:1.0:1746066821.762844:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17369 00000100:00100000:1.0:1746066821.762853:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3692:x1830882985666560:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066821.762877:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.763687:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066821.763719:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfb2b0e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8399 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.763734:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.763738:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066821.763749:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2b1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83a0 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.763847:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763860:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763867:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763877:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763902:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763906:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763911:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bcc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.763914:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763919:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763925:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.763928:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066821.763930:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763934:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb2b23 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.763954:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2b1c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a0 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.763960:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb2b1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a0 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.763965:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bde00, rc 0) 00000100:00100000:1.0:1746066821.764340:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3692:x1830882985666560:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1486us (2318us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066821.764347:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17369 00000100:00100000:0.0:1746066821.764981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.765030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.765114:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985666944 00000100:00100000:2.0:1746066821.765122:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985666944 00002000:00100000:2.0:1746066821.765157:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88008e434a80 x1830882985666944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.765165:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434a80 with x1830882985666944 ext(3145728->4194303) 00002000:00010000:2.0:1746066821.765170:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e434a80 00000100:00100000:2.0:1746066821.765183:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667072 00000100:00100000:2.0:1746066821.765186:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667072 00002000:00100000:2.0:1746066821.765198:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88008e434000 x1830882985667072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.765204:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434000 with x1830882985667072 ext(2097152->4194303) 00010000:00010000:2.0:1746066821.765210:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.765220:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.765226:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e434000 00000100:00100000:2.0:1746066821.765870:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2272 00000100:00100000:2.0:1746066821.765878:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985667072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.767574:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7966 00000100:00100000:3.0:1746066821.767594:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985666944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.771259:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.771396:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667328 00000100:00100000:1.0:1746066821.771407:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667328 00000100:00100000:1.0:1746066821.771450:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6571 00000100:00100000:1.0:1746066821.771457:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+7:3692:x1830882985667328:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:0.0:1746066821.771528:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.771623:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667456 00000100:00100000:3.0:1746066821.771627:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667456 00000100:00100000:1.0:1746066821.771872:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+8:3692:x1830882985667328:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 414us (622us total) trans 8589937879 rc 0/0 00000100:00100000:1.0:1746066821.771878:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6571 00000100:00100000:3.0:1746066821.772058:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20956 00000100:00100000:3.0:1746066821.772065:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3687:x1830882985667456:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066821.772075:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066821.772189:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83a7 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.772221:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.772230:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.772237:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.772238:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.772243:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.772284:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066821.772296:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 9 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.772309:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985201536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066821.773710:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.773722:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 11 pid: 11630 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.773733:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985201664:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.773781:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066821.776527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.776623:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985201536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066821.776727:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667584 00000100:00100000:3.0:1746066821.776734:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667584 00010000:00010000:3.0:1746066821.776767:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746066821.776832:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9657 00000100:00100000:3.0:1746066821.776839:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985667584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.776853:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.776872:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.776899:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.776922:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a000/0xf1867c21abfb2af2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8384 expref: 10 pid: 12237 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746066821.776946:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.777586:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985667584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 744us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.777593:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9657 00000100:00100000:1.0:1746066821.777782:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985201664:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.777808:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.777819:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778000, rc 0) 00000100:00100000:1.0:1746066821.777839:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3687:x1830882985667456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5776us (6312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.777844:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20956 00000100:00100000:2.0:1746066821.778078:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985667072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12199us (13046us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066821.778088:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2272 00002000:00100000:2.0:1746066821.778096:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88008e434000 x1830882985667072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.778105:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434000 with x1830882985667072 ext(2097152->4194303) 00010000:00010000:2.0:1746066821.778112:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.778121:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.778127:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e434000 00000100:00100000:3.0:1746066821.779744:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985666944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12151us (14755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.779754:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7966 00002000:00100000:3.0:1746066821.779763:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88008e434a80 x1830882985666944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.779772:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434a80 with x1830882985666944 ext(3145728->4194303) 00010000:00010000:3.0:1746066821.779780:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 9 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.779790:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 9 pid: 11630 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746066821.779797:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e434a80 00000100:00100000:3.0:1746066821.783401:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.783605:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667712 00000100:00100000:0.0:1746066821.783615:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667712 00000100:00100000:0.0:1746066821.783657:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20957 00000100:00100000:0.0:1746066821.783666:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3686:x1830882985667712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.783685:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066821.783702:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83ae expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.783729:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.783735:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.783742:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.783746:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.783782:0:9592:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.783798:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.783809:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfe00, rc 0) 00000100:00100000:0.0:1746066821.783851:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3686:x1830882985667712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 186us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.783856:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20957 00000100:00100000:1.0:1746066821.784473:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.784825:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667840 00000100:00100000:3.0:1746066821.784831:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667840 00010000:00010000:3.0:1746066821.784854:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746066821.784996:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.785112:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985667968 00000100:00100000:3.0:1746066821.785115:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985667968 00010000:00010000:3.0:1746066821.785128:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746066821.785421:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9658 00000100:00100000:3.0:1746066821.785429:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985667840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.785439:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.785459:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.785474:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.785494:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfb2ad6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8368 expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746066821.785518:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.785519:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.785526:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.785533:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.785557:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.785568:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985201920:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.785634:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.785797:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9659 00000100:00100000:0.0:1746066821.785818:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985667968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066821.785826:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066821.785839:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.785847:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.785858:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2ab3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d835a expref: 10 pid: 11630 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746066821.785869:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.785871:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066821.785874:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.785880:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.785913:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.785923:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746066821.785930:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e434700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985202048:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066821.785965:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066821.788239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.788284:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.788351:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985668224 00000100:00100000:2.0:1746066821.788358:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985668224 00002000:00100000:2.0:1746066821.788397:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->2519039) req@ffff88008e434e00 x1830882985668224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.788406:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434e00 with x1830882985668224 ext(2514944->2519039) 00002000:00010000:2.0:1746066821.788412:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434e00 00000100:00100000:1.0:1746066821.788481:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e434700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985202048:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066821.788500:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066821.788540:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985667968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2737us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.788548:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9659 00000100:00100000:3.0:1746066821.788624:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985201920:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.788634:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.788648:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985667840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3220us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.788653:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9658 00000100:00100000:2.0:1746066821.788790:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985668480 00000100:00100000:2.0:1746066821.788793:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985668480 00002000:00100000:2.0:1746066821.788806:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4124671) req@ffff88008e434380 x1830882985668480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.788812:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434380 with x1830882985668480 ext(4120576->4124671) 00010000:00010000:2.0:1746066821.788819:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.788834:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746066821.788839:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e434380 00000100:00100000:2.0:1746066821.788848:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2273 00000100:00100000:2.0:1746066821.788853:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985668480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066821.788970:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985668480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 116us (685us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066821.788974:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2273 00002000:00100000:2.0:1746066821.788978:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4124671) req@ffff88008e434380 x1830882985668480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.788984:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434380 with x1830882985668480 ext(4120576->4124671) 00010000:00010000:2.0:1746066821.788988:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746066821.788996:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066821.789001:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e434380 00000100:00100000:2.0:1746066821.789010:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7967 00000100:00100000:2.0:1746066821.789014:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985668224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066821.789062:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985668224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 47us (833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066821.789069:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7967 00002000:00100000:2.0:1746066821.789072:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->2519039) req@ffff88008e434e00 x1830882985668224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.789078:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434e00 with x1830882985668224 ext(2514944->2519039) 00002000:00010000:2.0:1746066821.789081:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434e00 00000100:00100000:0.0:1746066821.794581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.794625:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.796063:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.796812:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985669120 00000100:00100000:0.0:1746066821.796821:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985669120 00000100:00100000:0.0:1746066821.796865:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20958 00000100:00100000:3.0:1746066821.796873:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985668864 00000100:00100000:0.0:1746066821.796873:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3687:x1830882985669120:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066821.796878:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985668864 00010000:00010000:0.0:1746066821.796907:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746066821.796919:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4194303) req@ffff88008e437480 x1830882985668864/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746066821.796924:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83b5 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066821.796929:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437480 with x1830882985668864 ext(4120576->4194303) 00010000:00010000:3.0:1746066821.796938:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.796952:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 9 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066821.796955:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066821.796959:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e437480 00010000:00010000:0.0:1746066821.796967:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.796970:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.796973:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->3846143] (req 3145728->3846143) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.796986:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985668992 00000100:00100000:3.0:1746066821.796989:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985668992 00002000:00100000:3.0:1746066821.797003:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3055616->3059711) req@ffff88008e434700 x1830882985668992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746066821.797003:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066821.797009:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434700 with x1830882985668992 ext(3055616->3059711) 00010000:00010000:0.0:1746066821.797013:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.797014:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.797022:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066821.797024:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985202176:192.168.204.16@tcp:104: 00002000:00010000:3.0:1746066821.797027:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e434700 00000100:00100000:3.0:1746066821.797039:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2274 00000100:00100000:3.0:1746066821.797045:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985668864:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066821.797095:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.797138:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2275 00000100:00100000:3.0:1746066821.797144:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985668992:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066821.797268:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882985668992:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 123us (2641us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066821.797286:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2275 00002000:00100000:3.0:1746066821.797291:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3055616->3059711) req@ffff88008e434700 x1830882985668992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.797299:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434700 with x1830882985668992 ext(3055616->3059711) 00010000:00010000:3.0:1746066821.797304:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.797311:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066821.797316:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e434700 00000100:00100000:1.0:1746066821.800072:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985202176:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066821.800102:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->3846143] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.800124:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecee00, rc 0) 00000100:00100000:1.0:1746066821.800162:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3687:x1830882985669120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3289us (4101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066821.800170:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20958 00000100:00100000:3.0:1746066821.801452:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985668864:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4402us (6876us total) trans 17179875487 rc 0/0 00000100:00100000:3.0:1746066821.801462:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2274 00002000:00100000:3.0:1746066821.801472:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4194303) req@ffff88008e437480 x1830882985668864/t17179875487(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.801482:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437480 with x1830882985668864 ext(4120576->4194303) 00010000:00010000:3.0:1746066821.801491:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.801503:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066821.801510:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e437480 00000100:00100000:0.0:1746066821.802224:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.802319:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.802552:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985669632 00000100:00100000:1.0:1746066821.802560:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985669632 00000100:00100000:1.0:1746066821.802602:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6572 00000100:00100000:1.0:1746066821.802608:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:3691:x1830882985669632:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066821.802949:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985669376 00000100:00100000:3.0:1746066821.802953:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985669376 00002000:00100000:3.0:1746066821.802976:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->3059711) req@ffff8801310f2a00 x1830882985669376/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.802984:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2a00 with x1830882985669376 ext(2514944->3059711) 00010000:00010000:3.0:1746066821.802991:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.803000:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 23 pid: 3528 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066821.803007:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801310f2a00 00000100:00100000:3.0:1746066821.803019:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2276 00000100:00100000:3.0:1746066821.803025:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882985669376:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066821.803544:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:3691:x1830882985669632:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 934us (1320us total) trans 8589937880 rc 0/0 00000100:00100000:1.0:1746066821.803551:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6572 00000100:00100000:0.0:1746066821.809712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.810317:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985669760 00000100:00100000:3.0:1746066821.810327:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985669760 00010000:00010000:3.0:1746066821.810366:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066821.810411:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9660 00000100:00100000:3.0:1746066821.810418:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985669760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.810433:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.810452:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.810464:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.810488:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778000/0xf1867c21abfb2b2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83a7 expref: 11 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.810521:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.810523:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.810530:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.810538:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.810977:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.810992:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985202304:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.811300:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.814089:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985202304:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.814112:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.814154:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985669760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3735us (4451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.814340:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9660 00000100:00100000:2.0:1746066821.815743:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985669376:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 12712us (13419us total) trans 21474842828 rc 0/0 00000100:00100000:2.0:1746066821.815754:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2276 00002000:00100000:2.0:1746066821.815766:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2514944->3059711) req@ffff8801310f2a00 x1830882985669376/t21474842828(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.815937:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2a00 with x1830882985669376 ext(2514944->3059711) 00010000:00010000:2.0:1746066821.815949:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066821.815963:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066821.815970:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801310f2a00 00000100:00100000:0.0:1746066821.816318:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.816616:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985670016 00000100:00100000:2.0:1746066821.816623:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985670016 00002000:00100000:2.0:1746066821.816655:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8801310f1500 x1830882985670016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.816662:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1500 with x1830882985670016 ext(3145728->4194303) 00002000:00010000:2.0:1746066821.816665:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f1500 00000100:00100000:2.0:1746066821.816693:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7968 00000100:00100000:2.0:1746066821.816699:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985670016:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066821.818572:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.818816:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985670144 00000100:00100000:3.0:1746066821.818823:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985670144 00010000:00010000:3.0:1746066821.818851:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066821.818907:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9661 00000100:00100000:3.0:1746066821.818914:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985670144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.818925:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.818943:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.818955:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.818979:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779800/0xf1867c21abfb2b00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3059711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8392 expref: 25 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.818994:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.818997:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.819004:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.819013:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.819042:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.819053:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985202432:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.819111:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.824185:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985202432:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.824208:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.824264:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985670144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5348us (5697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.824283:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9661 00000100:00100000:3.0:1746066821.825016:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985670016:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8314us (8697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066821.825024:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7968 00002000:00100000:3.0:1746066821.825034:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8801310f1500 x1830882985670016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.825043:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1500 with x1830882985670016 ext(3145728->4194303) 00002000:00010000:3.0:1746066821.825146:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f1500 00000100:00100000:0.0:1746066821.837445:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.837514:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985670400 00000100:00100000:3.0:1746066821.837523:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985670400 00002000:00100000:3.0:1746066821.837569:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3559424->4194303) req@ffff8801310f0000 x1830882985670400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066821.837580:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0000 with x1830882985670400 ext(3559424->4194303) 00002000:00010000:3.0:1746066821.837585:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f0000 00000100:00100000:1.0:1746066821.845563:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7969 00000100:00100000:1.0:1746066821.845584:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985670400:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066821.853403:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985670400:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7819us (15961us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746066821.853413:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7969 00002000:00100000:1.0:1746066821.853423:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3559424->4194303) req@ffff8801310f0000 x1830882985670400/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 634880/634880 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.853433:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0000 with x1830882985670400 ext(3559424->4194303) 00002000:00010000:1.0:1746066821.853439:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f0000 00000100:00100000:0.0:1746066821.862307:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.862368:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985670656 00000100:00100000:1.0:1746066821.862380:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985670656 00000100:00100000:1.0:1746066821.862436:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6573 00000100:00100000:1.0:1746066821.862444:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3687:x1830882985670656:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066821.862984:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3687:x1830882985670656:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 539us (682us total) trans 8589937881 rc 0/0 00000100:00100000:1.0:1746066821.862991:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6573 00000100:00100000:0.0:1746066821.864389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.864866:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985670912 00000100:00100000:1.0:1746066821.864873:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985670912 00002000:00100000:1.0:1746066821.864921:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880098f54380 x1830882985670912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.864929:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54380 with x1830882985670912 ext(4194304->5074943) 00002000:00010000:1.0:1746066821.864933:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f54380 00000100:00100000:1.0:1746066821.864959:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7970 00000100:00100000:1.0:1746066821.864965:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985670912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066821.872648:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985670912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7674us (8252us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066821.872660:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7970 00002000:00100000:2.0:1746066821.872674:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880098f54380 x1830882985670912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.872682:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54380 with x1830882985670912 ext(4194304->5074943) 00002000:00010000:2.0:1746066821.872686:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f54380 00000100:00100000:0.0:1746066821.891616:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.891924:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985671168 00000100:00100000:1.0:1746066821.891934:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985671168 00000100:00100000:1.0:1746066821.891994:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17370 00000100:00100000:1.0:1746066821.892002:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:3699:x1830882985671168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066821.892029:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066821.892048:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfb2b3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83bc expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.892123:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892137:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892150:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892165:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892169:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892174:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892278:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892286:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892293:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066821.892301:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066821.892371:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892377:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892382:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892387:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892393:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd0200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.892397:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892404:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892414:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066821.892416:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.892421:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892425:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfb2b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892443:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892448:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892452:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892456:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd1400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066821.892458:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892463:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892643:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476700) 00010000:00010000:1.0:1746066821.892646:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066821.892648:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892653:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1400/0xf1867c21abfb2b4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066821.892692:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfb2b3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.892702:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066821.892708:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066821.892709:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066821.892712:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93c600, rc 0) 00000100:00100000:1.0:1746066821.892777:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3699:x1830882985671168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 776us (1172us total) trans 8589937882 rc 0/0 00000100:00100000:1.0:1746066821.892784:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17370 00000100:00100000:0.0:1746066821.894480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.894556:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985671424 00000100:00100000:1.0:1746066821.894563:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985671424 00000100:00100000:1.0:1746066821.894609:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6574 00000100:00100000:1.0:1746066821.894616:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:3699:x1830882985671424:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066821.894783:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:3699:x1830882985671424:12345-192.168.204.16@tcp:35:cat.0 Request processed in 167us (309us total) trans 8589937883 rc 0/0 00000100:00100000:1.0:1746066821.894789:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6574 00000100:00100000:0.0:1746066821.897155:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066821.897247:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.897538:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985671552 00000100:00100000:1.0:1746066821.897547:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985671552 00000100:00100000:1.0:1746066821.898053:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985671680 00000100:00100000:1.0:1746066821.898057:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985671680 00000100:00100000:2.0:1746066821.898103:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20959 00000100:00100000:2.0:1746066821.898113:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985671552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.898131:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.898148:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83c3 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.898173:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.898175:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066821.898184:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 29 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.898198:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 29 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.898209:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15600, rc 0) 00000100:00100000:2.0:1746066821.898255:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985671552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 143us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.898264:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20959 00000100:00100000:2.0:1746066821.898292:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20960 00000100:00100000:2.0:1746066821.898297:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985671680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066821.898304:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066821.898312:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb2b69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83ca expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.898351:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985202560:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066821.898410:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.902166:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985202560:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066821.902208:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb2b69 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ca expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.902222:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb2b69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ca expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066821.902248:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14c00, rc 0) 00000100:00100000:2.0:1746066821.902720:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985671680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4419us (5470us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066821.902729:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20960 00000100:00100000:0.0:1746066821.911787:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.911944:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985671936 00000100:00100000:2.0:1746066821.911955:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985671936 00002000:00100000:2.0:1746066821.912004:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098f57480 x1830882985671936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.912016:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57480 with x1830882985671936 ext(2097152->3145727) 00002000:00010000:2.0:1746066821.912022:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f57480 00000100:00100000:2.0:1746066821.912531:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7971 00000100:00100000:2.0:1746066821.912540:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985671936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.917059:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28b87956-2543-42c1-b799-d011d2dfefc7:3774:1830882985202688:0@lo:400:kworker.0 00000100:00100000:1.0:1746066821.917124:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.917226:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985202688 00000100:00100000:3.0:1746066821.917234:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985202688 00000100:00100000:3.0:1746066821.917285:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1746066821.917292:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3774:x1830882985202688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066821.917676:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3774:x1830882985202688:12345-0@lo:400:kworker.0 Request processed in 384us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.917684:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1746066821.917714:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985202816:0@lo:400:kworker.0 00000100:00100000:3.0:1746066821.917734:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.917758:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985202816 00000100:00100000:3.0:1746066821.917761:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985202816 00000100:00100000:3.0:1746066821.917778:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1746066821.917781:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985202816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066821.917803:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985202816:12345-0@lo:400:kworker.0 Request processed in 22us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.917807:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1746066821.917830:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985202816:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.917959:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882985203328:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.917984:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918001:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985203840:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918015:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918026:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746066821.918030:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985203200:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918046:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918057:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3775:1830882985203712:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918070:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918079:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3775:1830882985204224:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918092:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918109:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203840 00000100:00100000:2.0:1746066821.918112:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203840 00000100:00100000:2.0:1746066821.918129:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1746066821.918133:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985203840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918156:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985203840:12345-0@lo:400:kworker.0 Request processed in 23us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918160:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1746066821.918177:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985203840:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918194:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203200 00000100:00100000:2.0:1746066821.918197:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203200 00000100:00100000:2.0:1746066821.918224:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1746066821.918229:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985203200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918254:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985203200:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918259:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00080000:2.0:1746066821.918283:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066821.918298:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985203200:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918323:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203328 00000100:00100000:2.0:1746066821.918326:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203328 00000100:00100000:2.0:1746066821.918348:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203712 00000100:00100000:2.0:1746066821.918350:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203712 00000100:00100000:2.0:1746066821.918360:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204224 00000100:00100000:2.0:1746066821.918362:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204224 00000100:00100000:2.0:1746066821.918374:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1746066821.918378:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882985203328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918404:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882985203328:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918409:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1746066821.918417:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1746066821.918421:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3775:x1830882985203712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918446:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3775:x1830882985203712:12345-0@lo:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918450:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1746066821.918459:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1746066821.918462:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3775:x1830882985204224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918480:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3775:x1830882985204224:12345-0@lo:400:kworker.0 Request processed in 19us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918488:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:2.0:1746066821.918501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746066821.918503:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066821.918514:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3775:1830882985203712:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918520:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3775:1830882985204224:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918526:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882985203328:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918556:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985203072:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918574:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918586:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882985203584:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918600:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918609:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985204096:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918621:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918631:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746066821.918636:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882985202944:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918649:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918658:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882985203456:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918671:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918679:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985203968:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918693:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066821.918709:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203584 00000100:00100000:2.0:1746066821.918712:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203584 00000100:00100000:2.0:1746066821.918728:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985202944 00000100:00100000:2.0:1746066821.918729:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985202944 00000100:00100000:2.0:1746066821.918736:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203456 00000100:00100000:2.0:1746066821.918738:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203456 00000100:00100000:2.0:1746066821.918746:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1746066821.918749:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882985203584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918773:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882985203584:12345-0@lo:400:kworker.0 Request processed in 23us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918777:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1746066821.918785:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1746066821.918788:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882985202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918806:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882985202944:12345-0@lo:400:kworker.0 Request processed in 17us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918810:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1746066821.918817:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1746066821.918820:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882985203456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918835:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882985203456:12345-0@lo:400:kworker.0 Request processed in 15us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918839:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:2.0:1746066821.918848:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746066821.918850:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066821.918861:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882985202944:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918868:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882985203456:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918875:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882985203584:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918915:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203072 00000100:00100000:2.0:1746066821.918918:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203072 00000100:00100000:2.0:1746066821.918939:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204096 00000100:00100000:2.0:1746066821.918941:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204096 00000100:00100000:2.0:1746066821.918950:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985203968 00000100:00100000:2.0:1746066821.918952:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985203968 00000100:00100000:2.0:1746066821.918963:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1746066821.918967:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882985203072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.918993:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882985203072:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.918998:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1746066821.919006:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1746066821.919010:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985204096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.919030:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985204096:12345-0@lo:400:kworker.0 Request processed in 20us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.919034:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1746066821.919041:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1746066821.919045:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985203968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.919061:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985203968:12345-0@lo:400:kworker.0 Request processed in 16us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.919064:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00080000:2.0:1746066821.919073:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066821.919083:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842823 gen 2 00000004:00080000:2.0:1746066821.919088:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e1c00, transno 21474842781 00000004:00080000:2.0:1746066821.919094:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e2680, transno 21474842782 00000004:00080000:2.0:1746066821.919096:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e1880, transno 21474842783 00000004:00080000:2.0:1746066821.919099:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e1f80, transno 21474842784 00000004:00080000:2.0:1746066821.919101:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e212a00, transno 21474842785 00000004:00080000:2.0:1746066821.919103:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e0700, transno 21474842786 00000004:00080000:2.0:1746066821.919105:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e2a00, transno 21474842787 00000004:00080000:2.0:1746066821.919108:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e3480, transno 21474842788 00000004:00080000:2.0:1746066821.919110:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8b100, transno 21474842792 00000004:00080000:2.0:1746066821.919113:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8a300, transno 21474842793 00000004:00080000:2.0:1746066821.919116:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88e00, transno 21474842794 00000004:00080000:2.0:1746066821.919118:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89f80, transno 21474842795 00000004:00080000:2.0:1746066821.919120:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8b800, transno 21474842796 00000004:00080000:2.0:1746066821.919122:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c777480, transno 21474842797 00000004:00080000:2.0:1746066821.919124:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88000, transno 21474842798 00000004:00080000:2.0:1746066821.919127:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677f480, transno 21474842799 00000004:00080000:2.0:1746066821.919129:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b165c00, transno 21474842808 00000004:00080000:2.0:1746066821.919130:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b164380, transno 21474842809 00000004:00080000:2.0:1746066821.919132:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762d80, transno 21474842810 00000004:00080000:2.0:1746066821.919134:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b165f80, transno 21474842811 00000004:00080000:2.0:1746066821.919136:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b166680, transno 21474842812 00000004:00080000:2.0:1746066821.919138:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760700, transno 21474842813 00000004:00080000:2.0:1746066821.919140:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f762300, transno 21474842814 00000004:00080000:2.0:1746066821.919142:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f760000, transno 21474842815 00000004:00080000:2.0:1746066821.919144:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5962d80, transno 21474842816 00000004:00080000:2.0:1746066821.919147:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963800, transno 21474842817 00000004:00080000:2.0:1746066821.919148:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963b80, transno 21474842818 00000004:00080000:2.0:1746066821.919150:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5962680, transno 21474842819 00000004:00080000:2.0:1746066821.919152:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5961500, transno 21474842820 00000004:00080000:2.0:1746066821.919154:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5960e00, transno 21474842821 00000004:00080000:2.0:1746066821.919157:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963480, transno 21474842822 00000004:00080000:2.0:1746066821.919159:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5963100, transno 21474842823 00000100:00100000:2.0:1746066821.919162:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985203968:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.919170:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985203072:0@lo:400:kworker.0 00000100:00100000:2.0:1746066821.919176:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875483 gen 2 00000004:00080000:2.0:1746066821.919178:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c6a300, transno 17179875440 00000004:00080000:2.0:1746066821.919184:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f713800, transno 17179875441 00000004:00080000:2.0:1746066821.919187:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89180, transno 17179875442 00000004:00080000:2.0:1746066821.919189:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710380, transno 17179875443 00000004:00080000:2.0:1746066821.919192:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765500, transno 17179875444 00000004:00080000:2.0:1746066821.919194:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c6b480, transno 17179875445 00000004:00080000:2.0:1746066821.919196:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f710e00, transno 17179875446 00000004:00080000:2.0:1746066821.919198:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8bb80, transno 17179875447 00000004:00080000:2.0:1746066821.919200:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8a680, transno 17179875448 00000004:00080000:2.0:1746066821.919202:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1180, transno 17179875452 00000004:00080000:2.0:1746066821.919204:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e0000, transno 17179875453 00000004:00080000:2.0:1746066821.919207:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3100, transno 17179875454 00000004:00080000:2.0:1746066821.919209:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e2d80, transno 17179875455 00000004:00080000:2.0:1746066821.919212:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e1180, transno 17179875456 00000004:00080000:2.0:1746066821.919214:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e0a80, transno 17179875457 00000004:00080000:2.0:1746066821.919216:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e3b80, transno 17179875458 00000004:00080000:2.0:1746066821.919218:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930e3100, transno 17179875459 00000004:00080000:2.0:1746066821.919220:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54e00, transno 17179875460 00000004:00080000:2.0:1746066821.919222:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d803800, transno 17179875466 00000004:00080000:2.0:1746066821.919224:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306a00, transno 17179875467 00000004:00080000:2.0:1746066821.919226:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d801500, transno 17179875468 00000004:00080000:2.0:1746066821.919228:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307b80, transno 17179875469 00000004:00080000:2.0:1746066821.919230:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304380, transno 17179875470 00000004:00080000:2.0:1746066821.919232:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304a80, transno 17179875471 00000004:00080000:2.0:1746066821.919234:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd6a00, transno 17179875472 00000004:00080000:2.0:1746066821.919236:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306d80, transno 17179875473 00000004:00080000:2.0:1746066821.919238:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098926300, transno 17179875474 00000004:00080000:2.0:1746066821.919240:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855180, transno 17179875475 00000004:00080000:2.0:1746066821.919242:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c6bb80, transno 17179875476 00000004:00080000:2.0:1746066821.919244:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d856d80, transno 17179875477 00000004:00080000:2.0:1746066821.919246:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855500, transno 17179875478 00000004:00080000:2.0:1746066821.919248:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d857800, transno 17179875479 00000004:00080000:2.0:1746066821.919251:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d854380, transno 17179875480 00000004:00080000:2.0:1746066821.919253:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d857b80, transno 17179875481 00000004:00080000:2.0:1746066821.919256:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d856300, transno 17179875482 00000004:00080000:2.0:1746066821.919258:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958af100, transno 17179875483 00000100:00100000:2.0:1746066821.919261:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985204096:0@lo:400:kworker.0 00000004:00080000:2.0:1746066821.919488:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 36 done 00000100:00100000:1.0:1746066821.920473:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28b87956-2543-42c1-b799-d011d2dfefc7:3774:1830882985202688:0@lo:400:kworker.0 00000004:00080000:2.0:1746066821.920927:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000100:00100000:2.0:1746066821.929104:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985671936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16554us (17318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066821.929116:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7971 00002000:00100000:2.0:1746066821.929129:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880098f57480 x1830882985671936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.929139:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57480 with x1830882985671936 ext(2097152->3145727) 00002000:00010000:2.0:1746066821.929146:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f57480 00000100:00100000:1.0:1746066821.932682:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066821.932703:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985204352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746066821.932762:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066821.933135:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.933156:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204352 00000100:00100000:2.0:1746066821.933164:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204352 00000100:00100000:0.0:1746066821.933164:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985672064 00000100:00100000:0.0:1746066821.933169:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985672064 00000100:00100000:2.0:1746066821.933218:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1746066821.933218:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20961 00000100:00100000:2.0:1746066821.933225:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985204352:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066821.933225:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:3699:x1830882985672064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066821.933241:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00000024:2.0:1746066821.933248:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 77824 granted 1193220544 pending 1515520 free 3909910528 avail 3674140672 00010000:00010000:0.0:1746066821.933258:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83d1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.933294:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985204352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (531us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066821.933298:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066821.933299:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00010000:00010000:0.0:1746066821.933305:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.933306:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066821.933309:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066821.933314:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985204352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1746066821.933332:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066821.933344:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 9 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066821.933353:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985204480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066821.933725:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066821.935953:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985204480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066821.935985:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066821.936011:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ed600, rc 0) 00000100:00100000:2.0:1746066821.936063:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:3699:x1830882985672064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2838us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066821.936071:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20961 00000100:00100000:0.0:1746066821.936252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066821.936411:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985672192 00000100:00100000:2.0:1746066821.936418:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985672192 00002000:00100000:2.0:1746066821.936455:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3846143) req@ffff880098f57800 x1830882985672192/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.936464:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57800 with x1830882985672192 ext(3145728->3846143) 00010000:00010000:2.0:1746066821.936471:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 10 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066821.936484:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 10 pid: 1893 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066821.936491:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f57800 00000100:00100000:2.0:1746066821.936670:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2277 00000100:00100000:2.0:1746066821.936679:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985672192:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066821.945335:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985672192:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8645us (9076us total) trans 21474842829 rc 0/0 00000100:00100000:2.0:1746066821.945348:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2277 00002000:00100000:2.0:1746066821.945363:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3846143) req@ffff880098f57800 x1830882985672192/t21474842829(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:227/0 lens 488/448 e 0 to 0 dl 1746066832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066821.945378:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57800 with x1830882985672192 ext(3145728->3846143) 00010000:00010000:2.0:1746066821.945389:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066821.945406:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066821.945414:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f57800 00000100:00100000:3.0:1746066821.948119:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985204608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066821.948179:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.948233:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204608 00000100:00100000:3.0:1746066821.948240:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204608 00000100:00100000:3.0:1746066821.948285:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1746066821.948291:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985204608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746066821.948327:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445527552 avail 1316065280 00000100:00100000:3.0:1746066821.948360:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3776:x1830882985204608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.948366:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1746066821.948398:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985204608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066821.948411:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066821.948415:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985204736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066821.948667:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066821.948734:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204736 00000100:00100000:0.0:1746066821.948741:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204736 00000100:00100000:0.0:1746066821.948794:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1746066821.948802:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985204736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746066821.948833:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746066821.948938:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985204736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066821.948944:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1746066821.948996:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985204736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746066821.954190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.954592:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985672320 00000100:00100000:3.0:1746066821.954604:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985672320 00010000:00010000:3.0:1746066821.954646:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066821.954692:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9662 00000100:00100000:3.0:1746066821.954700:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985672320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066821.954714:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066821.954734:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.954746:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.954769:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb2b38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83b5 expref: 12 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066821.954797:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.954799:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066821.954807:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.954816:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066821.954854:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066821.954869:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985204864:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066821.955583:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066821.958206:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985204864:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066821.958228:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066821.958292:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985672320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3591us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.958304:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9662 00000100:00100000:0.0:1746066821.963974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066821.964237:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066821.964258:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985204992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746066821.964395:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985672704 00000100:00100000:2.0:1746066821.964404:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985672704 00002000:00100000:2.0:1746066821.964447:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f56680 x1830882985672704/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066821.964449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066821.964457:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56680 with x1830882985672704 ext(2097152->4194303) 00002000:00010000:2.0:1746066821.964462:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f56680 00000100:00100000:2.0:1746066821.964485:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985672832 00000100:00100000:2.0:1746066821.964487:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985672832 00000100:00100000:1.0:1746066821.964494:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7972 00002000:00100000:2.0:1746066821.964502:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880094372680 x1830882985672832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066821.964506:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985672704:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066821.964509:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372680 with x1830882985672832 ext(3145728->4194303) 00002000:00010000:2.0:1746066821.964512:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094372680 00000100:00100000:2.0:1746066821.964527:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7973 00000100:00100000:2.0:1746066821.964533:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985672832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066821.965188:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066821.965247:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985204992 00000100:00100000:3.0:1746066821.965252:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985204992 00000100:00100000:3.0:1746066821.965291:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1746066821.965297:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985204992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066821.965310:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1292000576 pending 208896 free 3906400256 avail 3662270464 00000100:00100000:3.0:1746066821.965358:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985204992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066821.965364:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1746066821.965667:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985204992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066821.982249:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985672832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17703us (17795us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066821.982263:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7973 00002000:00100000:0.0:1746066821.982287:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880094372680 x1830882985672832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066821.982300:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372680 with x1830882985672832 ext(3145728->4194303) 00002000:00010000:0.0:1746066821.982306:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094372680 00000100:00100000:1.0:1746066821.983837:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985672704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19327us (19869us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066821.983846:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7972 00002000:00100000:1.0:1746066821.983855:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f56680 x1830882985672704/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.983862:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56680 with x1830882985672704 ext(2097152->4194303) 00002000:00010000:1.0:1746066821.983868:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f56680 00000100:00100000:0.0:1746066821.990056:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066821.990163:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673088 00000100:00100000:1.0:1746066821.990173:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673088 00002000:00100000:1.0:1746066821.990228:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880098f56a00 x1830882985673088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/0 e 0 to 0 dl 1746066832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.990239:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56a00 with x1830882985673088 ext(4194304->5074943) 00002000:00010000:1.0:1746066821.990244:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f56a00 00000100:00100000:1.0:1746066821.990808:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7974 00000100:00100000:1.0:1746066821.990817:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985673088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066821.997036:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985673088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6206us (6978us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066821.997049:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7974 00002000:00100000:1.0:1746066821.997062:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880098f56a00 x1830882985673088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:227/0 lens 488/440 e 0 to 0 dl 1746066832 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066821.997072:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56a00 with x1830882985673088 ext(4194304->5074943) 00002000:00010000:1.0:1746066821.997079:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f56a00 00000100:00100000:0.0:1746066822.028176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.028475:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673344 00000100:00100000:1.0:1746066822.028484:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673344 00000100:00100000:1.0:1746066822.028542:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17371 00000100:00100000:1.0:1746066822.028550:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3702:x1830882985673344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066822.028576:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.028594:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb2b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83d8 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.028696:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.028711:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.028718:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.028750:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.028762:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 41 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.028774:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985205120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.028864:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.031517:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985205120:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.031545:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066822.032730:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.032822:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673472 00000100:00100000:3.0:1746066822.032830:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673472 00010000:00010000:3.0:1746066822.032877:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.033291:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9663 00000100:00100000:3.0:1746066822.033298:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985673472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.033312:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.033318:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.033662:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.033684:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfb2b54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83bc expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.033716:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.033721:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.033731:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.033737:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.033870:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066822.033872:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.033880:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066822.033915:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:3.0:1746066822.033936:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985673472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 637us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.033942:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9663 00010000:00010000:1.0:1746066822.034041:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfb2b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.034435:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.034442:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.034444:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066822.034446:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37a00, rc 0) 00000100:00100000:1.0:1746066822.034483:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:3702:x1830882985673344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5933us (6318us total) trans 8589937884 rc 0/0 00000100:00100000:1.0:1746066822.034489:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17371 00000100:00100000:0.0:1746066822.095788:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.096425:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673728 00000100:00100000:1.0:1746066822.096435:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673728 00000100:00100000:1.0:1746066822.096537:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17372 00000100:00100000:1.0:1746066822.096545:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3704:x1830882985673728:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066822.096567:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.096584:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfb2b8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83df expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.096662:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096674:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096685:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096697:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096703:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096707:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096793:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfb2ba1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096801:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfb2ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096805:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfb2ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066822.096814:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066822.096876:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096919:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096925:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096930:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096935:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066822.096938:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096944:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096953:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066822.096955:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066822.096959:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096963:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37800/0xf1867c21abfb2b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096988:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096992:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.096997:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.097004:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066822.097006:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.097010:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.097015:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476f00) 00010000:00010000:1.0:1746066822.097017:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066822.097018:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.097022:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfb2b9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.097053:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfb2b8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83df expref: 23 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.097062:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfb2ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83df expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.097067:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.097069:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066822.097071:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37400, rc 0) 00000100:00100000:1.0:1746066822.097115:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3704:x1830882985673728:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 571us (1339us total) trans 8589937885 rc 0/0 00000100:00100000:1.0:1746066822.097121:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17372 00000100:00100000:0.0:1746066822.110145:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.114404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.114530:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673984 00000100:00100000:3.0:1746066822.114540:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673984 00000100:00100000:3.0:1746066822.114598:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 959 00000100:00100000:3.0:1746066822.114606:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985673984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.114623:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.114651:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfb2ba1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83df expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.115045:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985673856 00000100:00100000:2.0:1746066822.115051:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985673856 00000100:00100000:2.0:1746066822.115093:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20962 00000100:00100000:2.0:1746066822.115099:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3704:x1830882985673856:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.115115:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746066822.115199:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746066822.115213:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83e6 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.115238:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.115246:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.115253:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 24 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.115259:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.115261:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.115273:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1265664->1323007] (req 1265664->1323007) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 12 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.115302:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 24 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.115322:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 24 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.115376:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.115381:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.115427:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985673984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 822us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.115433:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 959 00000100:00100000:2.0:1746066822.115830:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.115938:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.115947:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 6 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.115955:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.115980:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.115988:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.115995:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.116010:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.123524:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.125372:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.125413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.125605:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.125618:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.125627:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.125657:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1265664->1323007] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 12 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.125676:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44000, rc 0) 00000100:00100000:2.0:1746066822.125724:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3704:x1830882985673856:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10624us (15589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.125736:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20962 00000100:00100000:1.0:1746066822.125816:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985674112 00000100:00100000:1.0:1746066822.125825:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985674112 00000100:00100000:3.0:1746066822.125934:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985674368 00000100:00100000:3.0:1746066822.125940:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985674368 00010000:00010000:3.0:1746066822.125973:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.126001:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9664 00000100:00100000:3.0:1746066822.126008:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985674368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.126021:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066822.126038:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985674240 00010000:00010000:3.0:1746066822.126041:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.126042:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985674240 00010000:00010000:3.0:1746066822.126050:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.126059:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 7 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.126072:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66a00/0xf1867c21abfb2978 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82c7 expref: 12 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.126088:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9665 00010000:00010000:3.0:1746066822.126092:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.126093:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985674240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066822.126101:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066822.126109:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 7 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.126114:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2013:x1830882985674368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (749us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066822.126117:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 7 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.126120:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9664 00010000:00010000:0.0:1746066822.126129:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb2add lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d836f expref: 7 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.126141:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.126156:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2013:x1830882985674240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.126162:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9665 00010000:00010000:1.0:1746066822.126246:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 25 pid: 12237 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.126278:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9666 00000100:00100000:1.0:1746066822.126284:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882985674112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.126291:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.126299:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 25 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.127328:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 25 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.127345:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf800/0xf1867c21abfb2a0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82f8 expref: 25 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.127372:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.127375:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.127382:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.127391:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.127423:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.127435:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985205632:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.128028:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.133546:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985205632:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.133569:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.133626:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882985674112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7340us (10114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.133637:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9666 00000100:00100000:0.0:1746066822.134677:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.134745:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985674624 00000100:00100000:1.0:1746066822.134752:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985674624 00002000:00100000:1.0:1746066822.134795:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1269759) req@ffff8800958a6680 x1830882985674624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.134805:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882985674624 ext(1265664->1269759) 00002000:00010000:1.0:1746066822.134810:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:1.0:1746066822.134827:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7975 00000100:00100000:1.0:1746066822.134833:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985674624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066822.135102:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2015:x1830882985674624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 269us (427us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.135109:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7975 00002000:00100000:1.0:1746066822.135114:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1269759) req@ffff8800958a6680 x1830882985674624/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.135121:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882985674624 ext(1265664->1269759) 00002000:00010000:1.0:1746066822.135124:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:0.0:1746066822.136657:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.136877:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985674752 00000100:00100000:2.0:1746066822.136910:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985674752 00000100:00100000:2.0:1746066822.136943:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20963 00000100:00100000:2.0:1746066822.136949:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985674752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.136965:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.136981:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bb6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83ed expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.137030:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205760:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066822.137119:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.138192:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.138276:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985675008 00000100:00100000:1.0:1746066822.138282:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985675008 00002000:00100000:1.0:1746066822.138312:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1318912->1323007) req@ffff8800958a7100 x1830882985675008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.138327:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882985675008 ext(1318912->1323007) 00002000:00010000:1.0:1746066822.138332:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7100 00000100:00100000:1.0:1746066822.138346:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7976 00000100:00100000:1.0:1746066822.138352:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985675008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066822.138547:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985675008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 193us (355us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.138553:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7976 00002000:00100000:1.0:1746066822.138559:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1318912->1323007) req@ffff8800958a7100 x1830882985675008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.138565:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882985675008 ext(1318912->1323007) 00002000:00010000:1.0:1746066822.138568:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7100 00002000:00010000:2.0:1746066822.139730:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066822 -> 1746066823 00002000:00010000:2.0:1746066822.139735:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066822 -> 1746066823 00000100:00100000:2.0:1746066822.139748:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205760:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066822.139775:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bb6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ed expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.139787:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bb6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ed expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.139803:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:2.0:1746066822.139843:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882985674752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2893us (3190us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.139849:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20963 00000100:00100000:0.0:1746066822.140708:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.140771:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985675264 00000100:00100000:2.0:1746066822.140777:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985675264 00000100:00100000:2.0:1746066822.140816:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6575 00000100:00100000:2.0:1746066822.140823:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3704:x1830882985675264:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066822.141046:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3704:x1830882985675264:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 223us (339us total) trans 8589937886 rc 0/0 00000100:00100000:2.0:1746066822.141053:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6575 00000100:00100000:0.0:1746066822.144991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.145108:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985675392 00000100:00100000:2.0:1746066822.145117:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985675392 00000100:00100000:2.0:1746066822.145155:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20964 00000100:00100000:2.0:1746066822.145161:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:3708:x1830882985675392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.145179:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.145195:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83f4 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.145224:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.145231:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.145232:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.145235:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.145261:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.145281:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 10 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.145297:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205888:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.145373:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.146207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.146432:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985675648 00000100:00100000:2.0:1746066822.146436:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985675648 00000100:00100000:2.0:1746066822.148174:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17373 00000100:00100000:2.0:1746066822.148186:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3710:x1830882985675648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.148211:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.148230:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb2bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d83fb expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.148321:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148334:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148343:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148356:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148360:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148365:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148457:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb2bd9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148467:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb2bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148472:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb2bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066822.148481:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.148552:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148558:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.148563:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.148968:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985205888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.148992:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.149007:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44400, rc 0) 00000100:00100000:3.0:1746066822.149050:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:3708:x1830882985675392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3888us (4071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.149058:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20964 00000100:00100000:0.0:1746066822.149186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.149280:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985675776 00000100:00100000:1.0:1746066822.149287:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985675776 00002000:00100000:1.0:1746066822.149317:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1323007) req@ffff8800958a5500 x1830882985675776/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.149326:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5500 with x1830882985675776 ext(1265664->1323007) 00010000:00010000:1.0:1746066822.149332:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 11 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.149344:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 11 pid: 1893 timeout: 890 lvb_type: 0 00002000:00010000:1.0:1746066822.149350:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a5500 00000100:00100000:1.0:1746066822.149363:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2278 00000100:00100000:1.0:1746066822.149369:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985675776:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746066822.149952:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.149962:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.149966:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.149973:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.149985:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.149988:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.149991:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.149996:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb2bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150009:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150014:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150018:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150021:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.150023:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150027:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150032:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20300) 00010000:00010000:2.0:1746066822.150033:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.150035:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150039:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45a00/0xf1867c21abfb2bd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.150079:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45e00/0xf1867c21abfb2bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83fb expref: 25 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.150088:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb2bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83fb expref: 24 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.150094:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.150096:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066822.150098:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44c00, rc 0) 00000100:00100000:2.0:1746066822.150135:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3710:x1830882985675648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1953us (3929us total) trans 8589937887 rc 0/0 00000100:00100000:2.0:1746066822.150141:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17373 00000100:00100000:1.0:1746066822.152290:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985675776:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2911us (3094us total) trans 21474842830 rc 0/0 00000100:00100000:1.0:1746066822.152300:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2278 00002000:00100000:1.0:1746066822.152310:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1323007) req@ffff8800958a5500 x1830882985675776/t21474842830(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.152319:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5500 with x1830882985675776 ext(1265664->1323007) 00010000:00010000:1.0:1746066822.152328:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.152347:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00002000:00010000:1.0:1746066822.152354:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a5500 00000100:00100000:2.0:1746066822.153688:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.153761:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676032 00000100:00100000:1.0:1746066822.153769:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676032 00000100:00100000:1.0:1746066822.153803:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6576 00000100:00100000:1.0:1746066822.153810:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3710:x1830882985676032:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066822.154640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.155194:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3710:x1830882985676032:12345-192.168.204.16@tcp:35:cat.0 Request processed in 1383us (1511us total) trans 8589937888 rc 0/0 00000100:00100000:1.0:1746066822.155202:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6576 00000100:00100000:1.0:1746066822.155226:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676160 00000100:00100000:1.0:1746066822.155230:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676160 00000100:00100000:1.0:1746066822.155652:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 960 00000100:00100000:1.0:1746066822.155659:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985676160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.155671:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.155697:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44c00/0xf1867c21abfb2bd9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83fb expref: 25 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.155712:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.155717:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.155737:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985676160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.155742:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 960 00000100:00100000:0.0:1746066822.155925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.156221:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676288 00000100:00100000:2.0:1746066822.156226:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676288 00010000:00010000:2.0:1746066822.156244:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.156275:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9667 00000100:00100000:2.0:1746066822.156281:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985676288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.156289:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.156309:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.156319:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.156334:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfb2baf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83e6 expref: 13 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.156345:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.156347:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.156354:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.156366:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.156396:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.156410:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985206016:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066822.156612:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.157836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.158538:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676416 00000100:00100000:3.0:1746066822.158546:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676416 00000100:00100000:3.0:1746066822.158581:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20965 00000100:00100000:3.0:1746066822.158588:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985676416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.158605:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.158619:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8402 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.158641:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.158642:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.158648:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.158667:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.158676:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778400, rc 0) 00000100:00100000:3.0:1746066822.158975:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985676416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 386us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.158981:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20965 00000100:00100000:1.0:1746066822.159598:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.159643:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985206016:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.159659:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.159680:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985676288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3399us (3755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.159688:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9667 00000100:00100000:3.0:1746066822.159773:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676544 00000100:00100000:3.0:1746066822.159777:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676544 00000100:00100000:3.0:1746066822.159805:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20966 00000100:00100000:3.0:1746066822.159810:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985676544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.159819:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.159828:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8409 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.159839:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.159841:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.159846:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.159855:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.159863:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:3.0:1746066822.159900:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985676544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.159908:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20966 00000100:00100000:0.0:1746066822.160950:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.163062:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985676800 00000100:00100000:1.0:1746066822.163075:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985676800 00002000:00100000:1.0:1746066822.163130:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5765180 x1830882985676800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.163140:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765180 with x1830882985676800 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.163145:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5765180 00000100:00100000:1.0:1746066822.163171:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7977 00000100:00100000:1.0:1746066822.163179:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985676800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.170175:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.170369:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985676800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7189us (9419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066822.170384:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7977 00002000:00100000:1.0:1746066822.170396:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5765180 x1830882985676800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.170405:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765180 with x1830882985676800 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.170411:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5765180 00000100:00100000:1.0:1746066822.171414:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677056 00000100:00100000:1.0:1746066822.171423:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677056 00002000:00100000:1.0:1746066822.171457:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5767800 x1830882985677056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.171465:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767800 with x1830882985677056 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.171468:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5767800 00000100:00100000:2.0:1746066822.172462:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7978 00000100:00100000:2.0:1746066822.172475:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985677056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066822.184124:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985677056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11641us (13950us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.184137:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7978 00002000:00100000:2.0:1746066822.184150:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5767800 x1830882985677056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.184159:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5767800 with x1830882985677056 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.184165:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5767800 00000100:00100000:0.0:1746066822.197043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.197104:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.197200:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677312 00000100:00100000:1.0:1746066822.197211:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677312 00002000:00100000:1.0:1746066822.197298:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5764380 x1830882985677312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.197310:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764380 with x1830882985677312 ext(2097152->3145727) 00002000:00010000:1.0:1746066822.197315:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5764380 00000100:00080000:0.0:1746066822.197430:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066822.197602:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677568 00000100:00100000:1.0:1746066822.197606:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677568 00002000:00100000:1.0:1746066822.197621:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880095dd6a00 x1830882985677568/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.197628:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6a00 with x1830882985677568 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.197632:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd6a00 00000100:00100000:2.0:1746066822.197658:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7979 00000100:00100000:2.0:1746066822.197669:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985677312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.198748:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7980 00000100:00100000:3.0:1746066822.198764:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985677568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.212685:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.214198:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985677312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16522us (17158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066822.214210:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7979 00002000:00100000:3.0:1746066822.214222:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5764380 x1830882985677312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.214232:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5764380 with x1830882985677312 ext(2097152->3145727) 00002000:00010000:3.0:1746066822.214237:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5764380 00000100:00100000:2.0:1746066822.214672:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677696 00000100:00100000:2.0:1746066822.214682:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677696 00000100:00100000:2.0:1746066822.215464:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20967 00000100:00100000:2.0:1746066822.215482:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+25:3702:x1830882985677696:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.215499:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.215622:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8410 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.215663:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.215672:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.215678:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.215680:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.215683:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.215712:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.215723:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.215734:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985206144:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.215846:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.215853:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.215866:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985206272:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.215910:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.218832:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2013:x1830882985677568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20067us (21719us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066822.218842:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7980 00002000:00100000:3.0:1746066822.218854:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880095dd6a00 x1830882985677568/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.218862:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6a00 with x1830882985677568 ext(2097152->4194303) 00010000:00010000:3.0:1746066822.218870:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 14 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.218904:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 14 pid: 1893 timeout: 890 lvb_type: 1 00002000:00010000:3.0:1746066822.218911:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd6a00 00000100:00100000:2.0:1746066822.222866:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985206144:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.222878:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985206272:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.222944:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 26 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.222959:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d400, rc 0) 00000100:00100000:2.0:1746066822.223010:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+26:3702:x1830882985677696:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7537us (10338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.223017:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20967 00000100:00100000:0.0:1746066822.223995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.224076:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677824 00000100:00100000:2.0:1746066822.224083:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677824 00000100:00100000:2.0:1746066822.224561:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20968 00000100:00100000:2.0:1746066822.224568:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3710:x1830882985677824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.224582:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.224594:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8417 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.224614:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.224619:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.224625:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.224628:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.224667:0:13726:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.224677:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.224685:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326dc00, rc 0) 00000100:00100000:2.0:1746066822.225162:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3710:x1830882985677824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 594us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.225168:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20968 00000100:00100000:0.0:1746066822.226622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.226677:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985677952 00000100:00100000:1.0:1746066822.226686:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985677952 00010000:00010000:1.0:1746066822.226715:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.226747:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9668 00000100:00100000:1.0:1746066822.226753:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985677952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.226762:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.226780:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.226790:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.226807:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2bee lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8409 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.226828:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.226861:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985677952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.226867:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9668 00000100:00100000:0.0:1746066822.230632:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.230799:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678080 00000100:00100000:1.0:1746066822.230809:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678080 00010000:00010000:1.0:1746066822.230846:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.230873:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9669 00000100:00100000:1.0:1746066822.230880:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985678080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.230921:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.230940:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.230953:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.230978:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed600/0xf1867c21abfb2b70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d1 expref: 26 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.231003:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.231004:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.231011:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.231019:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.231053:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.231064:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.231075:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985206528:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.231169:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.236017:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.236118:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009586a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985206528:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066822.236138:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678336 00010000:00010000:1.0:1746066822.236139:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.236150:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678336 00000100:00100000:1.0:1746066822.236179:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985678080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5298us (5557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.236190:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9669 00002000:00100000:3.0:1746066822.236193:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4120575) req@ffff880095dd5180 x1830882985678336/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.236203:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5180 with x1830882985678336 ext(4116480->4120575) 00010000:00010000:3.0:1746066822.236212:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.236225:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.236232:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5180 00000100:00100000:3.0:1746066822.236281:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2279 00000100:00100000:3.0:1746066822.236288:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985678336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066822.236416:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985678336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 128us (409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.236422:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2279 00002000:00100000:3.0:1746066822.236427:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4120575) req@ffff880095dd5180 x1830882985678336/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.236434:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5180 with x1830882985678336 ext(4116480->4120575) 00010000:00010000:3.0:1746066822.236438:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.236447:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.236457:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5180 00000100:00100000:0.0:1746066822.240653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.240734:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678592 00000100:00100000:3.0:1746066822.240741:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678592 00002000:00100000:3.0:1746066822.240773:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4194303) req@ffff880095dd5500 x1830882985678592/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.240780:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5500 with x1830882985678592 ext(4116480->4194303) 00010000:00010000:3.0:1746066822.240786:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.240795:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 25 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.240799:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5500 00000100:00100000:3.0:1746066822.240824:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2280 00000100:00100000:3.0:1746066822.240828:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985678592:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066822.241724:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.241761:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678720 00000100:00100000:2.0:1746066822.241766:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678720 00000100:00100000:2.0:1746066822.241801:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20969 00000100:00100000:2.0:1746066822.241807:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+29:3702:x1830882985678720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.241816:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.241829:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d841e expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.241850:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.241858:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.241868:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.241870:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.241873:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.241924:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.241939:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.241949:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985206656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.242026:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.242034:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 9 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.242042:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985206784:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.242060:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.243490:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985678592:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2657us (2840us total) trans 21474842831 rc 0/0 00000100:00100000:3.0:1746066822.243499:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2280 00002000:00100000:3.0:1746066822.243507:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4116480->4194303) req@ffff880095dd5500 x1830882985678592/t21474842831(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.243515:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5500 with x1830882985678592 ext(4116480->4194303) 00010000:00010000:3.0:1746066822.243523:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.243537:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.243543:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5500 00000100:00100000:2.0:1746066822.247292:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985206656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.247305:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985206784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.247333:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.247354:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00000100:00100000:2.0:1746066822.247397:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+30:3702:x1830882985678720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5588us (5672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.247405:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20969 00000100:00100000:0.0:1746066822.250977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.251019:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.251105:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678976 00000100:00100000:1.0:1746066822.251114:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678976 00010000:00010000:1.0:1746066822.251150:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.251176:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985678848 00000100:00100000:1.0:1746066822.251178:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985678848 00010000:00010000:1.0:1746066822.251189:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.251214:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9670 00000100:00100000:1.0:1746066822.251221:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985678976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.251234:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.251254:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.251280:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.251299:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9671 00010000:00010000:1.0:1746066822.251304:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c15600/0xf1867c21abfb2b62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83c3 expref: 30 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.251315:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985678848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.251325:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066822.251332:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066822.251350:0:16766:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066822 -> 1746066823 00002000:00010000:3.0:1746066822.251353:0:16766:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066822 -> 1746066823 00010000:00010000:3.0:1746066822.251359:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.251364:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985678976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 143us (399us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066822.251372:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.251372:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9670 00010000:00010000:3.0:1746066822.251391:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfb2bf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8410 expref: 27 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.251415:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.251417:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.251422:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.251429:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.251463:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.251474:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985206912:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066822.251548:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.253633:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985206912:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066822.253650:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.253705:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985678848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2395us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.253714:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9671 00000100:00100000:0.0:1746066822.257968:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.259626:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985679104 00000100:00100000:3.0:1746066822.259637:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985679104 00010000:00010000:3.0:1746066822.259686:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.259731:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9672 00000100:00100000:3.0:1746066822.259740:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985679104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.259756:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.259778:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.259791:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.259825:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb2b31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83ae expref: 10 pid: 9592 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.259857:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.259859:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.259871:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.259879:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.259929:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.259942:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985207040:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066822.260034:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.261741:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.261854:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985207040:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.261868:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.261925:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985679104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2185us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.261935:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9672 00000100:00100000:3.0:1746066822.262003:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985679360 00000100:00100000:3.0:1746066822.262009:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985679360 00002000:00100000:3.0:1746066822.262044:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009586a300 x1830882985679360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.262054:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586a300 with x1830882985679360 ext(3145728->4194303) 00002000:00010000:3.0:1746066822.262058:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586a300 00000100:00100000:3.0:1746066822.262173:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7981 00000100:00100000:3.0:1746066822.262180:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985679360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.269199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.269531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.269603:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985679872 00000100:00100000:3.0:1746066822.269608:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985679616 00000100:00100000:3.0:1746066822.269614:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985679616 00000100:00100000:2.0:1746066822.269614:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985679872 00002000:00100000:3.0:1746066822.269656:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (5070848->5074943) req@ffff880094306d80 x1830882985679616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.269666:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882985679616 ext(5070848->5074943) 00002000:00010000:3.0:1746066822.269672:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:3.0:1746066822.269688:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7982 00000100:00100000:3.0:1746066822.269694:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985679616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.269865:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17374 00000100:00100000:2.0:1746066822.269873:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3714:x1830882985679872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.269916:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.269934:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d200/0xf1867c21abfb2c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8425 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.270005:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270018:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270029:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.270183:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985679616:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 487us (996us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.270190:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7982 00002000:00100000:3.0:1746066822.270196:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (5070848->5074943) req@ffff880094306d80 x1830882985679616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.270203:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882985679616 ext(5070848->5074943) 00002000:00010000:3.0:1746066822.270206:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306d80 00010000:00010000:2.0:1746066822.270461:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270469:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270475:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270571:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326de00/0xf1867c21abfb2c1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270580:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326de00/0xf1867c21abfb2c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270586:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326de00/0xf1867c21abfb2c1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066822.270595:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.270676:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270684:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270689:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270695:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270702:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009326c600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.270705:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270712:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270723:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.270726:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.270730:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270743:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfb2c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270768:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270773:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270777:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270781:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009326d600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.270783:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270788:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270794:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20300) 00010000:00010000:2.0:1746066822.270796:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.270799:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270803:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.270837:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d200/0xf1867c21abfb2c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8425 expref: 27 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.270848:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326de00/0xf1867c21abfb2c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8425 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.270858:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.270860:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066822.270862:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326de00, rc 0) 00000100:00100000:2.0:1746066822.271007:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3714:x1830882985679872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1134us (1474us total) trans 8589937889 rc 0/0 00000100:00100000:2.0:1746066822.271014:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17374 00000100:00100000:0.0:1746066822.276353:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985679360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14162us (14604us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066822.276364:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7981 00002000:00100000:0.0:1746066822.276376:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88009586a300 x1830882985679360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.276385:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586a300 with x1830882985679360 ext(3145728->4194303) 00002000:00010000:0.0:1746066822.276391:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586a300 00000100:00100000:2.0:1746066822.276476:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.276708:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680000 00000100:00100000:1.0:1746066822.276715:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680000 00000100:00100000:1.0:1746066822.276755:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 961 00000100:00100000:1.0:1746066822.276763:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985680000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.276778:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.276806:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326de00/0xf1867c21abfb2c1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8425 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.277135:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.277141:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.277178:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985680000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 415us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.277184:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 961 00000100:00100000:0.0:1746066822.279127:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.279328:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680128 00000100:00100000:2.0:1746066822.279336:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680128 00000100:00100000:2.0:1746066822.280045:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20970 00000100:00100000:2.0:1746066822.280055:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985680128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.280074:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.280093:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb2c2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d842c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.280149:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985207168:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066822.281494:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00002000:00010000:2.0:1746066822.283402:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066822 -> 1746066823 00002000:00010000:2.0:1746066822.283411:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066822 -> 1746066823 00002000:00010000:2.0:1746066822.283414:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066822 -> 1746066823 00000100:00100000:2.0:1746066822.283435:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985207168:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066822.283469:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb2c2d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d842c expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.283484:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfb2c2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d842c expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.283507:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326da00, rc 0) 00000100:00100000:2.0:1746066822.283975:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985680128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3921us (4853us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.283985:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20970 00000100:00100000:0.0:1746066822.285100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.285405:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680256 00000100:00100000:3.0:1746066822.285413:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680256 00000100:00100000:3.0:1746066822.285448:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20971 00000100:00100000:3.0:1746066822.285455:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3714:x1830882985680256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066822.285471:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.285487:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8433 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.285512:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.285523:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.285525:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.285528:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3354624->3604479] (req 3354624->3604479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.285555:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.285567:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.285579:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985207296:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.286379:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.286511:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.286583:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680384 00000100:00100000:2.0:1746066822.286587:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680384 00000100:00100000:2.0:1746066822.286609:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20972 00000100:00100000:2.0:1746066822.286614:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3710:x1830882985680384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.286624:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.286634:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d843a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.286652:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.286658:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.286659:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.286662:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.286677:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.286684:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 28 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.286697:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985207424:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.286722:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.289457:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985207296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.289487:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3354624->3604479] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 15 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.289506:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:3.0:1746066822.289554:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3714:x1830882985680256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4098us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.289562:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20971 00000100:00100000:0.0:1746066822.289739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.289935:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985207424:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.289957:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->5074943] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.289967:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576be00, rc 0) 00000100:00100000:2.0:1746066822.289989:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3710:x1830882985680384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3375us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.289994:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20972 00000100:00100000:1.0:1746066822.291610:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680512 00000100:00100000:1.0:1746066822.291622:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680512 00002000:00100000:1.0:1746066822.291668:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5073343) req@ffff88009677ea00 x1830882985680512/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.291679:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882985680512 ext(4194304->5073343) 00010000:00010000:1.0:1746066822.291689:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 29 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.291700:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 29 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:1.0:1746066822.291707:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677ea00 00000100:00100000:1.0:1746066822.291787:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2281 00000100:00100000:1.0:1746066822.291795:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985680512:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066822.291814:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.291857:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680640 00000100:00100000:1.0:1746066822.291861:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680640 00010000:00010000:1.0:1746066822.291879:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.292429:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9673 00000100:00100000:1.0:1746066822.292437:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985680640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.292446:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.292463:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.292474:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.292496:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2bfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8417 expref: 15 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.292532:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.292534:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.292541:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 14 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.292549:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 14 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.292709:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 14 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.292723:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985207552:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.292810:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.298395:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.298637:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985207552:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.298658:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.298706:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985680640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6270us (6893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.298717:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9673 00000100:00100000:3.0:1746066822.298752:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985680896 00000100:00100000:3.0:1746066822.298759:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985680896 00002000:00100000:3.0:1746066822.298799:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff8800966e3480 x1830882985680896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.298814:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985680896 ext(3354624->3358719) 00002000:00010000:3.0:1746066822.298819:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:3.0:1746066822.298840:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7983 00000100:00100000:3.0:1746066822.298846:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985680896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.300087:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2015:x1830882985680896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1237us (1700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.300094:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7983 00002000:00100000:3.0:1746066822.300100:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff8800966e3480 x1830882985680896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.300108:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985680896 ext(3354624->3358719) 00002000:00010000:3.0:1746066822.300111:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:2.0:1746066822.305862:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985680512:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14055us (16111us total) trans 17179875488 rc 0/0 00000100:00100000:2.0:1746066822.305875:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2281 00002000:00100000:2.0:1746066822.305920:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5073343) req@ffff88009677ea00 x1830882985680512/t17179875488(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.305930:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882985680512 ext(4194304->5073343) 00010000:00010000:2.0:1746066822.305941:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.305959:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066822.305971:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677ea00 00000100:00100000:0.0:1746066822.308683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.308725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.308757:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.308793:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985681280 00000100:00100000:0.0:1746066822.308794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.308802:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985681280 00000100:00100000:3.0:1746066822.308841:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985681408 00000100:00100000:3.0:1746066822.308843:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985681408 00000100:00100000:1.0:1746066822.308849:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985681536 00000100:00100000:1.0:1746066822.308854:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985681536 00000100:00100000:3.0:1746066822.308857:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20973 00000100:00100000:3.0:1746066822.308864:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985681280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.308902:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 32 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.308908:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.308923:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d400/0xf1867c21abfb2c42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8441 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.308929:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9674 00000100:00100000:1.0:1746066822.308935:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985681536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.308945:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.308965:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 33 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.308975:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985207680:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066822.308977:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 33 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.308998:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.309000:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.309007:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.309016:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.309038:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 9 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.309046:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985207808:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066822.309054:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.309071:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.309074:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20974 00000100:00100000:3.0:1746066822.309079:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985681408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.309086:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.309096:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8448 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.309119:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985207936:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066822.309214:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985681152 00000100:00100000:2.0:1746066822.309218:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985681152 00002000:00100000:2.0:1746066822.309246:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3600384->3604479) req@ffff88009677c000 x1830882985681152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.309255:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882985681152 ext(3600384->3604479) 00002000:00010000:2.0:1746066822.309259:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:2.0:1746066822.309292:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7984 00000100:00100000:2.0:1746066822.309298:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985681152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.309533:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.309618:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985681152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 319us (945us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066822.309625:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7984 00002000:00100000:2.0:1746066822.309631:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3600384->3604479) req@ffff88009677c000 x1830882985681152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.309637:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882985681152 ext(3600384->3604479) 00002000:00010000:2.0:1746066822.309640:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:1.0:1746066822.312344:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985207808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.312364:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.312399:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985681536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3463us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.312408:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9674 00000100:00100000:0.0:1746066822.312729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066822.312861:0:1893:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff8800a5d7ca80 x1830882985207680) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 32 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.312913:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfb2c03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d841e expref: 32 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.312918:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.312935:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985207680:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.312962:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d400/0xf1867c21abfb2c42 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8441 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.312975:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d400/0xf1867c21abfb2c42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8441 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.312983:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d400, rc 0) 00000100:00100000:3.0:1746066822.313010:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985681280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4145us (4283us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.313017:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20973 00002000:00010000:3.0:1746066822.313048:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066822 -> 1746066823 00000100:00100000:3.0:1746066822.313061:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985207936:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.313075:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c49 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8448 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066822.313082:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985681792 00010000:00010000:3.0:1746066822.313083:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8448 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066822.313089:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985681792 00010000:00010000:3.0:1746066822.313090:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d600, rc 0) 00000100:00100000:3.0:1746066822.313106:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985681408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4026us (4348us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.313111:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20974 00002000:00100000:2.0:1746066822.313123:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88009677df80 x1830882985681792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.313132:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677df80 with x1830882985681792 ext(4194304->5074943) 00002000:00010000:2.0:1746066822.313136:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677df80 00000100:00100000:2.0:1746066822.313153:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7985 00000100:00100000:2.0:1746066822.313161:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985681792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.313226:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682048 00000100:00100000:1.0:1746066822.313230:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682048 00000100:00100000:1.0:1746066822.313254:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6577 00000100:00100000:1.0:1746066822.313259:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3714:x1830882985682048:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066822.313443:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3714:x1830882985682048:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 182us (524us total) trans 8589937890 rc 0/0 00000100:00100000:1.0:1746066822.313449:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6577 00000100:00100000:2.0:1746066822.322231:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985681792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9056us (9488us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066822.322243:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7985 00002000:00100000:2.0:1746066822.322257:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88009677df80 x1830882985681792/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.322274:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677df80 with x1830882985681792 ext(4194304->5074943) 00002000:00010000:2.0:1746066822.322280:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677df80 00000100:00100000:0.0:1746066822.323437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.323504:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682176 00000100:00100000:0.0:1746066822.323507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.323512:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682176 00000100:00100000:3.0:1746066822.323559:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682304 00000100:00100000:3.0:1746066822.323561:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682304 00000100:00100000:2.0:1746066822.323564:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20975 00000100:00100000:2.0:1746066822.323573:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882985682176:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066822.323589:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20976 00010000:00010000:2.0:1746066822.323592:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066822.323594:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985682304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.323602:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.323616:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c50 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8456 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.323616:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d844f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.323638:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.323640:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066822.323667:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208064:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066822.323726:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00010000:00010000:2.0:1746066822.323818:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.323837:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.323847:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b400, rc 0) 00000100:00100000:2.0:1746066822.323880:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985682176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 309us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.323903:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20975 00000100:00100000:3.0:1746066822.325140:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208064:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.325163:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c50 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8456 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.325178:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d600/0xf1867c21abfb2c50 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8456 expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.325201:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d600, rc 0) 00000100:00100000:3.0:1746066822.325232:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882985682304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1637us (1724us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.325237:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20976 00000100:00100000:0.0:1746066822.334348:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.336031:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682560 00000100:00100000:2.0:1746066822.336043:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682560 00002000:00100000:2.0:1746066822.336096:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800986cd180 x1830882985682560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.336107:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd180 with x1830882985682560 ext(2097152->3145727) 00002000:00010000:2.0:1746066822.336112:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cd180 00000100:00100000:2.0:1746066822.336149:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7986 00000100:00100000:2.0:1746066822.336157:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882985682560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066822.343027:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882985682560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6858us (8680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.343041:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7986 00002000:00100000:2.0:1746066822.343055:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800986cd180 x1830882985682560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.343065:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd180 with x1830882985682560 ext(2097152->3145727) 00002000:00010000:2.0:1746066822.343072:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cd180 00000100:00100000:0.0:1746066822.347836:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.349660:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682688 00000100:00100000:1.0:1746066822.349670:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682688 00000100:00100000:1.0:1746066822.349724:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20977 00000100:00100000:1.0:1746066822.349732:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:3718:x1830882985682688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.349748:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.349764:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d845d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.349793:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.349800:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066822.349802:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066822.349804:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.349833:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.349843:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 13 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.349859:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208192:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.349955:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.355920:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.356142:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.356174:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.356194:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771400, rc 0) 00000100:00100000:1.0:1746066822.356240:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:3718:x1830882985682688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6508us (8414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.356248:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20977 00000100:00100000:2.0:1746066822.356346:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682816 00000100:00100000:2.0:1746066822.356353:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682816 00002000:00100000:2.0:1746066822.356394:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3604479) req@ffff8800986cca80 x1830882985682816/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.356404:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cca80 with x1830882985682816 ext(3354624->3604479) 00010000:00010000:2.0:1746066822.356411:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 14 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.356429:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 14 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066822.356436:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800986cca80 00000100:00100000:2.0:1746066822.356468:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2282 00000100:00100000:2.0:1746066822.356475:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985682816:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066822.360791:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985682816:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4304us (4897us total) trans 21474842832 rc 0/0 00000100:00100000:2.0:1746066822.360804:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2282 00002000:00100000:2.0:1746066822.360817:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3604479) req@ffff8800986cca80 x1830882985682816/t21474842832(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.360910:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cca80 with x1830882985682816 ext(3354624->3604479) 00010000:00010000:2.0:1746066822.360922:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.360939:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746066822.360946:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800986cca80 00000100:00100000:0.0:1746066822.363986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.364836:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985682944 00000100:00100000:1.0:1746066822.364846:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985682944 00010000:00010000:1.0:1746066822.364911:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.364939:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9675 00000100:00100000:1.0:1746066822.364946:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985682944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.364961:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.364979:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.364990:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.365017:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xf1867c21abfb2c34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8433 expref: 16 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.365534:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.365537:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.365545:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.365554:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.365586:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.365597:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985208320:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.365682:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.366930:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985208320:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.366945:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.366979:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2014:x1830882985682944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2034us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.366988:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9675 00000100:00100000:0.0:1746066822.376387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.377135:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.377684:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985683328 00000100:00100000:3.0:1746066822.377694:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985683328 00002000:00100000:3.0:1746066822.377745:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800986cce00 x1830882985683328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.377756:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cce00 with x1830882985683328 ext(3145728->4194303) 00002000:00010000:3.0:1746066822.377761:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cce00 00000100:00100000:3.0:1746066822.377780:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985683456 00000100:00100000:3.0:1746066822.377782:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985683456 00002000:00100000:3.0:1746066822.377795:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800986cd880 x1830882985683456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.377802:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd880 with x1830882985683456 ext(2097152->4194303) 00002000:00010000:3.0:1746066822.377805:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cd880 00000100:00100000:3.0:1746066822.377823:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7987 00000100:00100000:3.0:1746066822.377831:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985683328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.378638:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7988 00000100:00100000:3.0:1746066822.378646:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985683456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.387456:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985683328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9614us (11071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066822.387470:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7987 00002000:00100000:3.0:1746066822.387482:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800986cce00 x1830882985683328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.387491:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cce00 with x1830882985683328 ext(3145728->4194303) 00002000:00010000:3.0:1746066822.387498:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cce00 00000100:00100000:3.0:1746066822.391619:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985683456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12961us (14472us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066822.391632:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7988 00002000:00100000:3.0:1746066822.391645:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800986cd880 x1830882985683456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.391655:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd880 with x1830882985683456 ext(2097152->4194303) 00002000:00010000:3.0:1746066822.391661:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800986cd880 00000100:00100000:0.0:1746066822.394978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.395133:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985683712 00000100:00100000:3.0:1746066822.395143:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985683712 00002000:00100000:3.0:1746066822.395189:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800986cd500 x1830882985683712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.395200:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd500 with x1830882985683712 ext(4194304->5074943) 00002000:00010000:3.0:1746066822.395206:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cd500 00000100:00100000:3.0:1746066822.395243:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7989 00000100:00100000:3.0:1746066822.395251:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985683712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.401178:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985683712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5914us (6197us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066822.401192:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7989 00002000:00100000:3.0:1746066822.401204:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800986cd500 x1830882985683712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.401214:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800986cd500 with x1830882985683712 ext(4194304->5074943) 00002000:00010000:3.0:1746066822.401221:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800986cd500 00000100:00100000:0.0:1746066822.433323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.433429:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985683968 00000100:00100000:2.0:1746066822.433438:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985683968 00000100:00100000:2.0:1746066822.433551:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17375 00000100:00100000:2.0:1746066822.433560:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3723:x1830882985683968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.433585:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.433604:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8464 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.433687:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.433699:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.433710:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.433722:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.433727:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.433731:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434011:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2c7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434022:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2c7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434027:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2c7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066822.434037:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.434211:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434218:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434224:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434230:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434234:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.434239:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434245:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434255:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.434269:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.434273:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434277:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434302:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434306:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434311:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434315:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.434317:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434324:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434330:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20c00) 00010000:00010000:2.0:1746066822.434332:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.434334:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434338:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2c73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.434373:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8464 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.434384:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2c7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8464 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.434389:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.434391:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066822.434393:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778a00, rc 0) 00000100:00100000:2.0:1746066822.434454:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3723:x1830882985683968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 893us (1141us total) trans 8589937891 rc 0/0 00000100:00100000:2.0:1746066822.434460:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17375 00000100:00100000:0.0:1746066822.436231:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.436318:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.436319:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985684096 00000100:00100000:1.0:1746066822.436327:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985684096 00000100:00100000:2.0:1746066822.436471:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985684224 00000100:00100000:1.0:1746066822.436474:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 962 00000100:00100000:2.0:1746066822.436475:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985684224 00000100:00100000:1.0:1746066822.436481:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985684096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.436497:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066822.436510:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20978 00000100:00100000:2.0:1746066822.436514:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3723:x1830882985684224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066822.436517:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2c7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8464 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.436527:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.436535:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.436539:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d846b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.436539:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.436559:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.436566:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.436568:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066822.436569:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985684096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (344us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066822.436571:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.436574:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 962 00010000:00010000:2.0:1746066822.436598:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.436622:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 26 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.436639:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.436701:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.438465:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985208448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.438675:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.438692:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2400, rc 0) 00000100:00100000:2.0:1746066822.438745:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3723:x1830882985684224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2229us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.438753:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20978 00000100:00100000:0.0:1746066822.440614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.441265:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985684352 00000100:00100000:2.0:1746066822.441274:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985684352 00010000:00010000:2.0:1746066822.441309:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.441353:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9676 00000100:00100000:2.0:1746066822.441361:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985684352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.441374:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.441394:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.441410:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.441437:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771400/0xf1867c21abfb2c5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d845d expref: 27 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.441464:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.441466:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.441472:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.441487:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.442046:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.442064:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985208576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066822.442156:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.445753:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985208576:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066822.445775:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.445793:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.446093:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985684608 00000100:00100000:3.0:1746066822.446100:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985684608 00002000:00100000:3.0:1746066822.446143:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3944447) req@ffff88012e421180 x1830882985684608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.446153:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882985684608 ext(3940352->3944447) 00002000:00010000:3.0:1746066822.446158:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421180 00000100:00100000:3.0:1746066822.446187:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7990 00000100:00100000:3.0:1746066822.446195:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985684608:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.446357:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985684352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4994us (5746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.446366:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9676 00000100:00100000:3.0:1746066822.446773:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985684608:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 578us (987us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.446780:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7990 00002000:00100000:3.0:1746066822.446786:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3944447) req@ffff88012e421180 x1830882985684608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.446793:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882985684608 ext(3940352->3944447) 00002000:00010000:3.0:1746066822.446797:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421180 00000100:00100000:0.0:1746066822.449152:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.449415:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985684864 00000100:00100000:3.0:1746066822.449424:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985684864 00002000:00100000:3.0:1746066822.449462:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3944448->3948543) req@ffff88012e420380 x1830882985684864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.449477:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420380 with x1830882985684864 ext(3944448->3948543) 00002000:00010000:3.0:1746066822.449482:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420380 00000100:00100000:3.0:1746066822.449512:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7991 00000100:00100000:3.0:1746066822.449519:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985684864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066822.449641:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985684864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (497us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.449646:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7991 00002000:00100000:3.0:1746066822.449651:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3944448->3948543) req@ffff88012e420380 x1830882985684864/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.449658:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420380 with x1830882985684864 ext(3944448->3948543) 00002000:00010000:3.0:1746066822.449661:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420380 00000100:00100000:0.0:1746066822.451452:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.452525:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685120 00000100:00100000:3.0:1746066822.452535:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685120 00000100:00100000:3.0:1746066822.452586:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6578 00000100:00100000:3.0:1746066822.452594:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3723:x1830882985685120:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066822.452823:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3723:x1830882985685120:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 229us (1377us total) trans 8589937892 rc 0/0 00000100:00100000:3.0:1746066822.452831:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6578 00000100:00100000:0.0:1746066822.485796:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.486014:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685248 00000100:00100000:2.0:1746066822.486024:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685248 00000100:00080000:0.0:1746066822.486054:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066822.486111:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17376 00000100:00100000:2.0:1746066822.486121:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3725:x1830882985685248:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.486145:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.486162:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb2c8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8472 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.486227:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486240:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486269:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486287:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486293:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486298:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486367:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486377:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.486383:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.486413:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.486424:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 40 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.486436:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985208704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.486536:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.488857:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.489015:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985208704:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.489036:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066822.489053:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685504 00000100:00100000:1.0:1746066822.489060:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685504 00000100:00100000:1.0:1746066822.489213:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6579 00000100:00100000:1.0:1746066822.489220:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:30848:x1830882985685504:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066822.489437:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:30848:x1830882985685504:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 216us (586us total) trans 8589937893 rc 0/0 00000100:00100000:1.0:1746066822.489443:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6579 00000100:00100000:0.0:1746066822.491575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.491638:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685632 00000100:00100000:2.0:1746066822.491646:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685632 00010000:00010000:2.0:1746066822.491767:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.491806:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9677 00000100:00100000:2.0:1746066822.491815:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985685632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.491828:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.491834:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.491844:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.491866:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37a00/0xf1867c21abfb2b7e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83d8 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.491930:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.491935:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.491945:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.491952:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.491970:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066822.492026:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492034:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066822.492089:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066822.492093:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066822.492109:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492118:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492130:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492135:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492141:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492146:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492151:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a2a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066822.492154:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492161:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492173:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066822.492176:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066822.492179:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492182:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2c96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492192:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492196:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492200:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492206:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a2800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066822.492208:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066822.492213:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985685632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 398us (644us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066822.492213:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066822.492219:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9677 00010000:00010000:1.0:1746066822.492219:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20500) 00010000:00010000:1.0:1746066822.492220:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066822.492222:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492226:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfb2c9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.492255:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2200/0xf1867c21abfb2c8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.492277:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.492283:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.492285:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066822.492286:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2600, rc 0) 00000100:00100000:1.0:1746066822.492322:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3725:x1830882985685248:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6203us (6538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.492328:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17376 00000100:00100000:0.0:1746066822.495084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.495124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.495154:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.495269:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685760 00000100:00100000:1.0:1746066822.495277:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686016 00000100:00100000:3.0:1746066822.495278:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685760 00000100:00100000:1.0:1746066822.495282:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686016 00000100:00100000:2.0:1746066822.495315:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985685888 00000100:00100000:2.0:1746066822.495319:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985685888 00000100:00080000:0.0:1746066822.495351:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066822.495375:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20979 00000100:00100000:1.0:1746066822.495382:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985686016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.495446:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066822.495458:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20980 00000100:00100000:2.0:1746066822.495463:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20981 00000100:00100000:3.0:1746066822.495465:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985685760:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066822.495469:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985685888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.495472:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.495475:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb2cab lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8487 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.495477:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.495480:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8479 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.495486:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8480 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.495501:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.495501:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.495502:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.495502:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.495510:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.495510:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.495521:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.495522:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066822.495527:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985208832:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.495530:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00010000:00010000:2.0:1746066822.495530:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3e00, rc 0) 00000100:00100000:2.0:1746066822.495566:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985685888:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 98us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.495572:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20981 00000100:00100000:3.0:1746066822.495611:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985685760:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 146us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.495617:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20980 00000100:00100000:1.0:1746066822.495694:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.500584:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985208832:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066822.500620:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb2cab lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8487 expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.500634:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356b000/0xf1867c21abfb2cab lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8487 expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.500646:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b000, rc 0) 00000100:00100000:1.0:1746066822.500688:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985686016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5305us (5562us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066822.500697:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20979 00000100:00100000:2.0:1746066822.505839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.506281:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686272 00000100:00100000:1.0:1746066822.506291:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686272 00000100:00100000:1.0:1746066822.506343:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17377 00000100:00100000:1.0:1746066822.506352:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3725:x1830882985686272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.506373:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.506391:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a800/0xf1867c21abfb2cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d848e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.506503:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.506519:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.506527:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066822.506557:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.506569:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 10 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.506581:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985208960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.506672:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.507095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.507138:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686528 00000100:00100000:3.0:1746066822.507143:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686528 00000100:00100000:3.0:1746066822.507169:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17378 00000100:00100000:3.0:1746066822.507174:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:3727:x1830882985686528:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066822.507184:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.507192:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d200/0xf1867c21abfb2cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8495 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.507235:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.507244:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.507453:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066822.508870:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985208960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.508928:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066822.509361:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.509423:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686656 00000100:00100000:2.0:1746066822.509429:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686656 00010000:00010000:2.0:1746066822.509455:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 11 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.509486:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9678 00000100:00100000:2.0:1746066822.509493:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985686656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.509505:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.509510:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 11 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.509524:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 11 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.509542:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfb2ca4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8472 expref: 11 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.509568:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.509573:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.509581:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.509586:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.509593:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.509598:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.509602:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.509617:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.509651:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985686656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.509657:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9678 00010000:00010000:3.0:1746066822.509797:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.509805:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066822.509824:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:0.0:1746066822.509921:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066822.509927:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066822.509937:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066822.509961:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d200/0xf1867c21abfb2cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 44 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.509977:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a800/0xf1867c21abfb2cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.509978:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 43 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.509985:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.509987:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066822.509989:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00010000:00010000:0.0:1746066822.509994:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.509998:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066822.510000:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066822.510002:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b200, rc 0) 00000100:00100000:3.0:1746066822.510011:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:3727:x1830882985686528:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2837us (2918us total) trans 8589937894 rc 0/0 00000100:00100000:0.0:1746066822.510013:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3725:x1830882985686272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3664us (4186us total) trans 8589937895 rc 0/0 00000100:00100000:3.0:1746066822.510018:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17378 00000100:00100000:0.0:1746066822.510020:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17377 00000100:00100000:0.0:1746066822.512709:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.512805:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686784 00000100:00100000:1.0:1746066822.512814:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686784 00000100:00100000:1.0:1746066822.512866:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20982 00000100:00100000:1.0:1746066822.512873:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+31:3727:x1830882985686784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066822.512915:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.512932:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d849c expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.512960:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.512968:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.512975:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.512979:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.512981:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.512983:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [2060288->2068479] (req 2060288->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.513010:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.513020:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.513031:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.513114:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.513121:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.513133:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209216:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.513153:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.513158:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.513165:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.513195:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.514594:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.514656:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985686912 00000100:00100000:3.0:1746066822.514661:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985686912 00000100:00100000:3.0:1746066822.514711:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17379 00000100:00100000:3.0:1746066822.514718:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3725:x1830882985686912:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.514736:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.514751:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d400/0xf1867c21abfb2cf1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84a3 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.514848:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.514863:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.514869:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.514874:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.515742:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.515753:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.515765:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985209472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.515845:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.515852:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 11 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.515859:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985209600:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.515875:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.517533:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.517636:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.517645:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.517652:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009586b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209344:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.517682:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [2060288->2068479] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.517697:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:1.0:1746066822.517730:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+32:3727:x1830882985686784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4858us (5031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.517737:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20982 00000100:00100000:2.0:1746066822.517859:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687040 00000100:00100000:2.0:1746066822.517866:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687040 00010000:00010000:2.0:1746066822.517927:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.517947:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9679 00000100:00100000:2.0:1746066822.517955:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985687040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.517967:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.517987:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.517997:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.518017:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfb2aeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d837d expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.518031:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.518048:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985687040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.518054:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9679 00000100:00100000:0.0:1746066822.519706:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.519745:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.519760:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.519779:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687168 00000100:00100000:0.0:1746066822.519784:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687168 00010000:00010000:0.0:1746066822.519807:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.519876:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985209472:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.520034:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.520089:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985209600:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.520110:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066822.520159:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687296 00000100:00100000:2.0:1746066822.520163:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687296 00000100:00100000:1.0:1746066822.520169:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687424 00000100:00100000:1.0:1746066822.520173:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687424 00010000:00010000:2.0:1746066822.520178:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 12 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.520189:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.520193:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687552 00000100:00100000:2.0:1746066822.520195:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687552 00000100:00100000:1.0:1746066822.520201:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9680 00010000:00010000:2.0:1746066822.520204:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.520207:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985687168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066822.520219:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9681 00010000:00010000:1.0:1746066822.520219:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066822.520224:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985687296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.520225:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.520232:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.520233:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.520237:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 12 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.520252:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfb2cd5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8495 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.520253:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 12 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.520277:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356b200/0xf1867c21abfb2cc7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d848e expref: 12 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.520283:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.520288:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.520297:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.520305:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.520312:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.520316:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066822.520320:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.520341:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985687296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 116us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.520343:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985687168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.520346:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9681 00000100:00100000:1.0:1746066822.520349:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9680 00000100:00100000:2.0:1746066822.520358:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9682 00000100:00100000:2.0:1746066822.520362:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882985687424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.520369:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066822.520384:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9683 00010000:00010000:2.0:1746066822.520386:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.520390:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985687552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.520393:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.520396:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.520406:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfb2a20 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d831b expref: 32 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.520407:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.520417:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.520425:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066822.520431:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ac00/0xf1867c21abfb2a74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8329 expref: 10 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.520440:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985687424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (679us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066822.520441:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.520443:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066822.520444:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9682 00010000:00010000:1.0:1746066822.520448:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.520456:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.520481:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.520494:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985209728:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.520544:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61acc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066822.520727:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.520734:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066822.520783:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:3.0:1746066822.520787:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066822.520801:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.520828:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d400/0xf1867c21abfb2cf1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84a3 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.520844:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84a3 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.520850:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.520852:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066822.520854:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d600, rc 0) 00000100:00100000:3.0:1746066822.520876:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3725:x1830882985686912:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6159us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.520900:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17379 00000100:00100000:0.0:1746066822.524241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.525427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.525478:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687680 00000100:00100000:1.0:1746066822.525488:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687680 00000100:00100000:1.0:1746066822.525585:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20983 00000100:00100000:1.0:1746066822.525593:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985687680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.525611:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.525626:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acda7e00/0xf1867c21abfb2cff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84aa expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.525675:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209856:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066822.526113:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985687808 00000100:00100000:3.0:1746066822.526117:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985687808 00000100:00100000:3.0:1746066822.526144:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20984 00000100:00100000:3.0:1746066822.526149:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985687808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.526160:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.526169:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb2d06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84b1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.526196:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985209984:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066822.526285:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.526530:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.526584:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.526734:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985209728:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.526747:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.526765:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985687552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6376us (6731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.526774:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9683 00000100:00100000:1.0:1746066822.526798:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985688064 00000100:00100000:1.0:1746066822.526801:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985688064 00002000:00100000:1.0:1746066822.526823:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2064383) req@ffff88012d800700 x1830882985688064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.526832:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800700 with x1830882985688064 ext(2060288->2064383) 00002000:00010000:1.0:1746066822.526835:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800700 00000100:00100000:1.0:1746066822.527344:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7992 00000100:00100000:1.0:1746066822.527350:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985688064:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066822.527546:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985688064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 195us (1016us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.527552:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7992 00002000:00100000:1.0:1746066822.527557:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2064383) req@ffff88012d800700 x1830882985688064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.527565:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800700 with x1830882985688064 ext(2060288->2064383) 00002000:00010000:1.0:1746066822.527568:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800700 00002000:00010000:1.0:1746066822.528360:0:13726:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime: 1746066822 -> 1746066823 00002000:00010000:1.0:1746066822.528364:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime: 1746066822 -> 1746066823 00002000:00010000:1.0:1746066822.528366:0:13726:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime: 1746066822 -> 1746066823 00000100:00100000:1.0:1746066822.528375:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985209856:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066822.528396:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acda7e00/0xf1867c21abfb2cff lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84aa expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.528407:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acda7e00/0xf1867c21abfb2cff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84aa expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.528415:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda7e00, rc 0) 00000100:00100000:1.0:1746066822.528560:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985687680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2967us (4327us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066822.528566:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20983 00000100:00100000:0.0:1746066822.531202:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.531320:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985209984:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.531347:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb2d06 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b1 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.531360:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfb2d06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b1 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.531374:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07600, rc 0) 00000100:00100000:3.0:1746066822.531408:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985687808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5258us (5985us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.531414:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20984 00000100:00100000:1.0:1746066822.531552:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985688320 00000100:00100000:1.0:1746066822.531558:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985688320 00002000:00100000:1.0:1746066822.531590:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2064384->2068479) req@ffff88012d800380 x1830882985688320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.531598:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800380 with x1830882985688320 ext(2064384->2068479) 00002000:00010000:1.0:1746066822.531602:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800380 00000100:00100000:1.0:1746066822.531613:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7993 00000100:00100000:1.0:1746066822.531619:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985688320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066822.531735:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882985688320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 116us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.531741:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7993 00002000:00100000:1.0:1746066822.531746:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (2064384->2068479) req@ffff88012d800380 x1830882985688320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.531753:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800380 with x1830882985688320 ext(2064384->2068479) 00002000:00010000:1.0:1746066822.531756:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800380 00000100:00100000:0.0:1746066822.533715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.534268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.534346:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985688832 00000100:00100000:2.0:1746066822.534354:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985688832 00000100:00100000:2.0:1746066822.534393:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6580 00000100:00100000:2.0:1746066822.534400:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:3727:x1830882985688832:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066822.534585:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:3727:x1830882985688832:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 185us (326us total) trans 8589937896 rc 0/0 00000100:00100000:2.0:1746066822.534591:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6580 00000100:00100000:3.0:1746066822.534702:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985688576 00000100:00100000:3.0:1746066822.534705:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985688576 00000100:00100000:3.0:1746066822.534727:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17380 00000100:00100000:3.0:1746066822.534731:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3725:x1830882985688576:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.534738:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.534753:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2d0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84b8 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.534805:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.534817:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.534825:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066822.534833:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066822.534879:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06c00/0xf1867c21abfb2d0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.534914:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.534922:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.534925:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066822.534928:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06600, rc 0) 00000100:00100000:3.0:1746066822.534948:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3725:x1830882985688576:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 216us (1239us total) trans 8589937897 rc 0/0 00000100:00100000:3.0:1746066822.534953:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17380 00000100:00100000:0.0:1746066822.537393:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.537432:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.537558:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.537851:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.537900:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985688960 00000100:00100000:3.0:1746066822.537909:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985688960 00000100:00100000:3.0:1746066822.537950:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689216 00000100:00100000:3.0:1746066822.537952:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689216 00000100:00100000:3.0:1746066822.537966:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689472 00000100:00100000:3.0:1746066822.537967:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689472 00000100:00100000:0.0:1746066822.538313:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689088 00000100:00100000:0.0:1746066822.538316:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689088 00000100:00100000:0.0:1746066822.538334:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20985 00000100:00100000:0.0:1746066822.538340:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985688960:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066822.538380:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538397:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538405:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538416:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538422:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.538423:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.538426:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538454:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538464:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 30 pid: 12237 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.538475:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210112:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066822.538536:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538543:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 8 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.538549:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210240:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066822.538565:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538576:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 10 pid: 9590 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.538584:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210368:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.538599:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.538625:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.538643:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689344 00000100:00100000:0.0:1746066822.538646:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689344 00000100:00100000:0.0:1746066822.538668:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20986 00000100:00100000:0.0:1746066822.538674:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985689216:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066822.538694:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538705:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538711:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538719:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538724:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.538725:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.538728:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538745:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538753:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 25 pid: 11630 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.538762:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210496:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066822.538789:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.538797:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 8 pid: 11630 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.538804:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210624:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066822.538825:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.538833:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 15 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.538840:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210752:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.538854:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.538920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.539031:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689600 00000100:00100000:2.0:1746066822.539034:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689600 00000100:00100000:2.0:1746066822.539053:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20987 00000100:00100000:2.0:1746066822.539057:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985689472:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066822.539072:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539081:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539087:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539094:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539098:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.539099:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.539101:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539112:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539118:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 30 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.539124:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985210880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.539151:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539158:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 11 pid: 3528 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.539164:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985211008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.539178:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539188:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.539193:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985211136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.539203:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.539215:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20988 00000100:00100000:2.0:1746066822.539219:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985689088:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066822.539232:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539240:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539247:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539252:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539266:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.539267:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.539269:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539281:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539288:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 15 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.539294:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211264:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.539311:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.539317:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.539323:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211392:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.539336:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539342:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.539350:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211520:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.539362:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.539377:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20989 00000100:00100000:2.0:1746066822.539382:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985689344:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066822.539395:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539409:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539415:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.539416:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.539418:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539432:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.539438:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 30 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.539445:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985211648:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.539462:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.539675:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20990 00000100:00100000:1.0:1746066822.539684:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985689600:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066822.539700:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.539710:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.539716:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066822.539718:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066822.539721:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.539734:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.539742:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.539756:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985211776:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.539777:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.542634:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.542649:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210240:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.542658:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985210368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.542686:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.542687:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210496:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.542696:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210624:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.542703:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985210752:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.542722:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.542908:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.542915:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985211648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.542916:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211392:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.542921:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882985211520:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.542929:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.542935:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.542948:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985210880:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.542954:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985211008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.542960:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985211136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.542973:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.542983:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985211776:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.542992:0:13726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.548134:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.548166:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.548190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.548223:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.548249:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690368 00000100:00100000:0.0:1746066822.548271:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690368 00000100:00100000:3.0:1746066822.548288:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690240 00000100:00100000:3.0:1746066822.548297:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690240 00010000:00010000:0.0:1746066822.548303:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 12 pid: 3528 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548324:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 26 pid: 11630 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.548327:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691136 00000100:00100000:2.0:1746066822.548331:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691136 00000100:00100000:0.0:1746066822.548340:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690496 00000100:00100000:0.0:1746066822.548342:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690496 00000100:00100000:3.0:1746066822.548349:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9684 00010000:00010000:2.0:1746066822.548350:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 16 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.548354:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.548357:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985690368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066822.548365:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9685 00010000:00010000:3.0:1746066822.548370:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066822.548373:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985690240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066822.548378:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9686 00010000:00010000:0.0:1746066822.548386:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066822.548387:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985691136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.548394:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.548396:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 12 pid: 3528 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.548405:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 26 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.548406:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 16 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548408:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 12 pid: 3528 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.548415:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 16 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.548416:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 26 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548427:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a3e00/0xf1867c21abfb2cb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8480 expref: 12 pid: 3528 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.548429:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095778400/0xf1867c21abfb2be7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8402 expref: 16 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.548433:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb2a04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ff expref: 26 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548441:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.548443:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066822.548452:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.548501:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985690368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.548507:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9684 00000100:00100000:3.0:1746066822.548523:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9687 00000100:00100000:3.0:1746066822.548528:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2014:x1830882985690496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.548536:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.548544:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548555:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.548564:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985691136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 179us (372us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066822.548565:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfb2891 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8226 expref: 9 pid: 9592 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.548572:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.548576:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882985690240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 202us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.548585:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9685 00000100:00100000:3.0:1746066822.548586:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985690496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.548592:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9687 00000100:00100000:2.0:1746066822.548620:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9686 00000100:00100000:0.0:1746066822.549146:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.549523:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.549624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.549640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.549707:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691008 00000100:00100000:3.0:1746066822.549711:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691008 00002000:00100000:3.0:1746066822.549741:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2068479) req@ffff880097a8b100 x1830882985691008/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 8680/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.549749:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882985691008 ext(2060288->2068479) 00010000:00010000:3.0:1746066822.549755:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.549765:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.549770:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8b100 00000100:00100000:3.0:1746066822.549782:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2283 00000100:00100000:3.0:1746066822.549786:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985691008:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066822.550104:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.550117:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690880 00000100:00100000:0.0:1746066822.550119:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690880 00002000:00100000:0.0:1746066822.550135:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3948543) req@ffff8800930e3b80 x1830882985690880/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 8680/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.550143:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e3b80 with x1830882985690880 ext(3940352->3948543) 00010000:00010000:0.0:1746066822.550148:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.550155:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 15 pid: 3528 timeout: 890 lvb_type: 0 00002000:00010000:0.0:1746066822.550160:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e3b80 00000100:00100000:0.0:1746066822.550169:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2284 00000100:00100000:0.0:1746066822.550173:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985690880:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066822.550594:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691264 00000100:00100000:1.0:1746066822.550598:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691264 00010000:00010000:1.0:1746066822.550614:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.550627:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689856 00000100:00100000:1.0:1746066822.550628:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689856 00010000:00010000:1.0:1746066822.550635:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 10 pid: 11630 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.550644:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690112 00000100:00100000:1.0:1746066822.550646:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690112 00010000:00010000:1.0:1746066822.550652:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.550662:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9688 00000100:00100000:1.0:1746066822.550666:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2014:x1830882985691264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.550674:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.550683:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550691:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550707:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfb2c3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d843a expref: 8 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550720:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.550744:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+7:2014:x1830882985691264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.550749:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9688 00000100:00100000:1.0:1746066822.550758:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9689 00000100:00100000:1.0:1746066822.550761:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985689856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.550767:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.550774:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 10 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.550781:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 10 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.550792:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfb2ae4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8376 expref: 10 pid: 11630 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746066822.550799:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.550809:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985689856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.550818:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9689 00000100:00100000:1.0:1746066822.550825:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9690 00000100:00100000:1.0:1746066822.550828:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985690112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.550833:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.550837:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 18 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550844:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 18 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550852:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfb297f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ce expref: 18 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.550860:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.550862:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.550867:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.550867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066822.550874:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.550897:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690752 00000100:00100000:0.0:1746066822.550900:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690752 00010000:00010000:1.0:1746066822.550905:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066822.550913:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.550916:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985690112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.550921:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9690 00000100:00100000:0.0:1746066822.550929:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9691 00000100:00100000:0.0:1746066822.550934:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985690752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066822.550940:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066822.550947:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.550954:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.550966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfb2cb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8479 expref: 9 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746066822.550990:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.551010:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985690752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.551060:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.551070:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689728 00000100:00100000:2.0:1746066822.551072:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689728 00010000:00010000:2.0:1746066822.551085:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 11 pid: 9590 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.551149:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9691 00010000:00010000:1.0:1746066822.551157:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.551165:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.551178:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.551184:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.551188:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985690880:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1014us (1084us total) trans 21474842833 rc 0/0 00010000:00010000:1.0:1746066822.551190:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.551194:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2284 00010000:00010000:1.0:1746066822.551196:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066822.551199:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066822.551199:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3948543) req@ffff8800930e3b80 x1830882985690880/t21474842833(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 8680/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746066822.551206:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066822.551207:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e3b80 with x1830882985690880 ext(3940352->3948543) 00010000:00010000:0.0:1746066822.551211:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.551219:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551219:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.551224:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfb2d29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066822.551229:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e3b80 00000100:00100000:1.0:1746066822.551269:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985689216:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12584us (13826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.551275:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20986 00000100:00100000:3.0:1746066822.551354:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985691008:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1567us (1831us total) trans 17179875489 rc 0/0 00000100:00100000:3.0:1746066822.551360:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2283 00002000:00100000:3.0:1746066822.551364:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (2060288->2068479) req@ffff880097a8b100 x1830882985691008/t17179875489(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 8680/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.551372:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882985691008 ext(2060288->2068479) 00010000:00010000:3.0:1746066822.551376:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 33 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.551384:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 33 pid: 13726 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.551389:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8b100 00000100:00100000:0.0:1746066822.551411:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.551435:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985689984 00000100:00100000:2.0:1746066822.551438:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985689984 00010000:00010000:2.0:1746066822.551448:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 33 pid: 12237 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746066822.551450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.551462:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985690624 00000100:00100000:2.0:1746066822.551464:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985690624 00000100:00100000:0.0:1746066822.551469:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9692 00010000:00010000:2.0:1746066822.551471:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.551474:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985689728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066822.551481:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066822.551482:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9693 00000100:00100000:2.0:1746066822.551486:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985689984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066822.551489:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 11 pid: 9590 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551492:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066822.551497:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 11 pid: 9590 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551517:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 33 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551526:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 33 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551541:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb286e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81f5 expref: 33 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551550:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.551561:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985689984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.551566:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9693 00000100:00100000:2.0:1746066822.551575:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9694 00000100:00100000:2.0:1746066822.551579:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985690624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.551584:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.551590:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.551597:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.551606:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44400/0xf1867c21abfb2bbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d83f4 expref: 25 pid: 1893 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.551612:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.551613:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.551616:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551622:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551635:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.551644:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985690624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.551648:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9694 00000100:00100000:2.0:1746066822.551732:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.551744:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691392 00000100:00100000:2.0:1746066822.551746:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691392 00010000:00010000:2.0:1746066822.551754:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 32 pid: 1893 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.551764:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9695 00000100:00100000:2.0:1746066822.551767:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985691392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.551772:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.551777:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 32 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551785:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 32 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551794:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfb2c57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d844f expref: 32 pid: 1893 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551801:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.551802:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.551805:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551815:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551824:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.551834:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985691392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.551838:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9695 00010000:00010000:2.0:1746066822.551850:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551856:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551866:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551872:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551877:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551896:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a2a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066822.551898:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551905:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfb27b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d81bd expref: 11 pid: 9590 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746066822.551908:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551913:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.551915:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551915:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.551918:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551920:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfb2d30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551924:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.551937:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.551947:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985689472:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12889us (14390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.551948:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985689728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 474us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.551952:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20987 00000100:00100000:0.0:1746066822.551956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9692 00010000:00010000:2.0:1746066822.551965:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551972:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551981:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551986:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.551992:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.552002:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf57800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066822.552004:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.552009:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.552016:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.552021:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfb2d22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.552037:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985688960:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13698us (14653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.552041:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20985 00010000:00010000:3.0:1746066822.552103:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552110:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552120:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552125:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552134:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552139:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066822.552141:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552145:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552153:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.552158:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9400/0xf1867c21abfb2d37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.552182:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+6:2013:x1830882985689088:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12963us (14332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.552187:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20988 00000100:00100000:0.0:1746066822.553063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.553138:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691648 00000100:00100000:3.0:1746066822.553143:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691648 00000100:00100000:3.0:1746066822.553178:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17381 00000100:00100000:3.0:1746066822.553182:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3731:x1830882985691648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.553204:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.553217:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46ee00/0xf1867c21abfb2d4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84bf expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.553292:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553303:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553311:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553323:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553328:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553332:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553415:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553422:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553426:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066822.553433:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066822.553480:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553485:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553493:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553500:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea5400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.553503:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553508:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553515:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.553518:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066822.553521:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553525:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb2d61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553538:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553541:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553545:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553550:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553553:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b46fc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.553555:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553562:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553567:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066822.553568:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.553570:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553574:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fc00/0xf1867c21abfb2d53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553580:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553584:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553588:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553591:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.553593:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553597:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553601:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e34ed00) 00010000:00010000:3.0:1746066822.553603:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.553604:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553608:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfb2d5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.553634:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46ee00/0xf1867c21abfb2d4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84bf expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.553641:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46ee00/0xf1867c21abfb2d4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84bf expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.553647:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46ee00, rc 0) 00000100:00100000:3.0:1746066822.553688:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3731:x1830882985691648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 505us (631us total) trans 8589937898 rc 301/301 00000100:00100000:3.0:1746066822.553693:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17381 00000100:00100000:0.0:1746066822.553931:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.553960:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.554066:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691776 00000100:00100000:1.0:1746066822.554072:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691776 00010000:00010000:1.0:1746066822.554088:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.554102:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985691904 00000100:00100000:1.0:1746066822.554104:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985691904 00010000:00010000:1.0:1746066822.554110:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.554121:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9696 00000100:00100000:1.0:1746066822.554125:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985691776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.554132:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.554142:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.554143:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9697 00010000:00010000:1.0:1746066822.554150:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.554155:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985691904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.554163:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfb2cea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d849c expref: 31 pid: 13726 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.554173:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.554174:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.554174:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.554178:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554185:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.554197:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.554206:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066822.554211:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.554215:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.554223:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.554224:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985691776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.554229:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9696 00010000:00010000:0.0:1746066822.554230:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfb2c88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d846b expref: 16 pid: 3528 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.554240:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.554246:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.554249:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.554251:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.554253:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.554254:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.554273:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.554301:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.554335:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985691904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 184us (373us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066822.554345:0:13726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.554345:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9697 00010000:00010000:2.0:1746066822.554348:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066822.554352:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554352:0:13726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.554359:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554365:0:13726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.554369:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554370:0:13726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.554375:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9200/0xf1867c21abfb2d3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554380:0:13726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554385:0:13726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acda6800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066822.554387:0:13726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554392:0:13726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554400:0:13726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.554404:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6800/0xf1867c21abfb2d45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.554418:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985689344:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15034us (15791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.554425:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20989 00000100:00100000:1.0:1746066822.554436:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+5:2013:x1830882985689600:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 14755us (15515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.554442:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20990 00000100:00100000:0.0:1746066822.555616:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.555700:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.555763:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692416 00000100:00100000:3.0:1746066822.555769:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692416 00000100:00100000:3.0:1746066822.555813:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17382 00000100:00100000:3.0:1746066822.555819:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+12:3725:x1830882985692416:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746066822.555856:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.555872:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfb2cf8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84a3 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555922:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.555925:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066822.555949:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.555960:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555967:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555974:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 28 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555980:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555986:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.555992:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 8/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.556016:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.556026:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 42 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.556037:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985211904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.556109:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.556116:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 28 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.556123:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.556225:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692160 00000100:00100000:2.0:1746066822.556232:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692160 00000100:00100000:2.0:1746066822.556277:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6581 00000100:00100000:2.0:1746066822.556283:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3731:x1830882985692160:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066822.556425:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3731:x1830882985692160:12345-192.168.204.16@tcp:35:cat.0 Request processed in 141us (811us total) trans 8589937899 rc 0/0 00000100:00100000:2.0:1746066822.556433:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6581 00010000:00010000:3.0:1746066822.559450:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 29 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.559469:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 29 pid: 13370 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.559485:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.559557:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.559566:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.559574:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212288:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.559599:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.559607:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.559614:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.559631:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.560067:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.560120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.560121:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692544 00000100:00100000:2.0:1746066822.560130:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692544 00000100:00100000:1.0:1746066822.560140:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.560144:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692672 00000100:00100000:2.0:1746066822.560146:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692672 00000100:00100000:1.0:1746066822.560152:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.560166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.560312:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.561918:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692800 00000100:00100000:3.0:1746066822.561927:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692800 00000100:00100000:3.0:1746066822.561957:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693056 00000100:00100000:3.0:1746066822.561958:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693056 00000100:00100000:3.0:1746066822.561973:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20991 00000100:00100000:3.0:1746066822.561980:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985692672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.561997:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.562015:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84cd expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066822.562037:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd87, atime: 0x6812dd86, ctime: 0x6812dd87, blocks: 0x808 00010000:00010000:3.0:1746066822.562055:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562057:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562066:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562080:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562090:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e363600, rc 0) 00000100:00100000:3.0:1746066822.562128:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985692672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.562133:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20991 00000100:00100000:3.0:1746066822.562148:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20992 00000100:00100000:3.0:1746066822.562151:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985692800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.562156:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.562163:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84d4 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066822.562172:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd86, atime: 0x6812dd84, ctime: 0x6812dd86, blocks: 0x800 00010000:00010000:3.0:1746066822.562179:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562180:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562183:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562194:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562200:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:3.0:1746066822.562209:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985692800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.562213:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20992 00000100:00100000:3.0:1746066822.562223:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20993 00000100:00100000:3.0:1746066822.562226:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985693056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.562231:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.562241:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84e2 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066822.562251:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 5073344, mtime: 0x6812dd87, atime: 0x6812dd86, ctime: 0x6812dd87, blocks: 0x16b8 00010000:00010000:3.0:1746066822.562269:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562270:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.562274:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562282:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.562288:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:3.0:1746066822.562299:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985693056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.562307:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20993 00000100:00100000:3.0:1746066822.562349:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985211904:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.562387:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693184 00000100:00100000:0.0:1746066822.562391:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693184 00000100:00100000:0.0:1746066822.562420:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20994 00000100:00100000:0.0:1746066822.562424:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985693184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066822.562429:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066822.562436:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84e9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066822.562446:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd87, atime: 0x6812dd87, ctime: 0x6812dd87, blocks: 0x1000 00010000:00010000:0.0:1746066822.562452:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.562453:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.562457:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.562465:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.562471:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0c00, rc 0) 00000100:00100000:0.0:1746066822.562485:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985693184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 61us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.562489:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20994 00000100:00100000:1.0:1746066822.562597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.562696:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.562709:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693312 00000100:00100000:1.0:1746066822.562711:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693312 00010000:00010000:1.0:1746066822.562730:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.562744:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693568 00000100:00100000:1.0:1746066822.562745:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693568 00010000:00010000:1.0:1746066822.562752:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 30 pid: 13370 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.562763:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9698 00000100:00100000:1.0:1746066822.562767:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985693312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.562777:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.562781:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.562791:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.562806:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bc400/0xf1867c21abfb299b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82d5 expref: 43 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.562817:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.562822:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.562829:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.562842:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985693312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.562851:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9698 00000100:00100000:1.0:1746066822.562858:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9699 00000100:00100000:1.0:1746066822.562861:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985693568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.562866:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.562869:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 30 pid: 13370 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.562877:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 30 pid: 13370 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.562901:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.562904:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.562908:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.562918:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985693568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.562923:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9699 00000100:00100000:1.0:1746066822.562946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.562961:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693440 00000100:00100000:1.0:1746066822.562963:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693440 00010000:00010000:1.0:1746066822.562970:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 30 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.562976:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985692928 00000100:00100000:2.0:1746066822.562981:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985692928 00000100:00100000:1.0:1746066822.562981:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9700 00000100:00100000:1.0:1746066822.562985:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985693440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.562990:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.562993:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 30 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.563000:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 30 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.563005:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20995 00010000:00010000:1.0:1746066822.563007:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:2.0:1746066822.563010:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985692928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.563010:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.563013:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.563017:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066822.563023:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985693440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 38us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.563028:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9700 00000100:00100000:1.0:1746066822.563049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.563056:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693824 00000100:00100000:1.0:1746066822.563058:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693824 00010000:00010000:1.0:1746066822.563065:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.563073:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84db expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.563075:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9701 00000100:00100000:1.0:1746066822.563079:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985693824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.563084:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066822.563087:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd87, atime: 0x6812dd86, ctime: 0x6812dd87, blocks: 0x800 00010000:00010000:1.0:1746066822.563087:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.563094:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 42 pid: 13370 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.563100:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.563102:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.563105:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.563107:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.563108:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.563113:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.563117:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066822.563122:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985693824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (72us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066822.563124:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8a00, rc 0) 00000100:00100000:1.0:1746066822.563126:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9701 00000100:00100000:1.0:1746066822.563178:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.563185:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693696 00000100:00100000:1.0:1746066822.563187:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693696 00010000:00010000:1.0:1746066822.563195:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.563204:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9702 00000100:00100000:1.0:1746066822.563208:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985693696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.563213:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.563216:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.563224:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 42 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.563231:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.563234:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.563239:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.563245:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066822.563269:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.563280:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985693696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.563284:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9702 00000100:00100000:2.0:1746066822.563340:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985692928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 328us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.563346:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20995 00010000:00010000:3.0:1746066822.563376:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07800/0xf1867c21abfb2955 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d82ab expref: 29 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.563385:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.563393:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6800/0xf1867c21abfb2901 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d826c expref: 28 pid: 13370 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.563400:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.563407:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfb28fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8265 expref: 41 pid: 13370 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.563407:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 20996 00000100:00100000:2.0:1746066822.563412:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985692544:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066822.563413:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212288:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.563419:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfb28f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d825e expref: 40 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.563419:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066822.563425:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985212416:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.563426:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84c6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066822.563437:0:13726:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd84, atime: 0x6812dd84, ctime: 0x6812dd84, blocks: 0x800 00010000:00010000:2.0:1746066822.563445:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.563446:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.563447:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.563450:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.563454:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.563459:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066822.563459:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.563465:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9c00, rc 0) 00000040:00080000:3.0:1746066822.563764:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1284, 88 off120584 00000004:00080000:3.0:1746066822.563771:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790774887140ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.563802:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1284, 88 off120496 00000004:00080000:3.0:1746066822.563806:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774922985ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563816:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1285, 88 off120584 00000004:00080000:3.0:1746066822.563819:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774935488ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563825:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1285, 88 off120672 00000004:00080000:3.0:1746066822.563828:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790774944588ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.563834:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1286, 88 off120760 00000004:00080000:3.0:1746066822.563836:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790774952887ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.563842:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1286, 88 off120672 00000004:00080000:3.0:1746066822.563844:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774960828ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563850:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1287, 88 off120760 00000004:00080000:3.0:1746066822.563853:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774969427ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563859:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1288, 88 off120848 00000004:00080000:3.0:1746066822.563861:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774977744ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563867:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1287, 88 off120848 00000004:00080000:3.0:1746066822.563869:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790774985694ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.563875:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1289, 88 off120936 00000004:00080000:3.0:1746066822.563877:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790774993619ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.563897:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1288, 88 off120936 00000004:00080000:3.0:1746066822.563900:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790775016812ns, next at 733263941116ns, rc = 0 00000100:00100000:2.0:1746066822.564064:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985692544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 649us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.564069:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 20996 00000040:00080000:3.0:1746066822.564154:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1290, 88 off121024 00000004:00080000:3.0:1746066822.564159:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790775275534ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.564172:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1289, 88 off121024 00000004:00080000:3.0:1746066822.564174:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790775290758ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.564863:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1290, 88 off121112 00000004:00080000:3.0:1746066822.564866:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790775983124ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.565292:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1291, 88 off121200 00000004:00080000:3.0:1746066822.565296:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790776412319ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.565304:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1292, 88 off121288 00000004:00080000:3.0:1746066822.565306:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790776422580ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.565316:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1291, 88 off121112 00000004:00080000:3.0:1746066822.565318:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790776435130ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066822.566636:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937900 is committed 00000004:00080000:0.0:1746066822.566644:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1265 committed 00000004:00080000:0.0:1746066822.566662:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1268 committed 00000004:00080000:0.0:1746066822.566674:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1267 committed 00000004:00080000:0.0:1746066822.566676:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1266 committed 00000004:00080000:0.0:1746066822.566678:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1265 committed 00000004:00080000:0.0:1746066822.566679:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1264 committed 00000004:00080000:0.0:1746066822.566681:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1264 committed 00000004:00080000:0.0:1746066822.566682:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1263 committed 00000004:00080000:0.0:1746066822.566683:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1263 committed 00000004:00080000:0.0:1746066822.566685:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1262 committed 00000004:00080000:0.0:1746066822.566687:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1261 committed 00000004:00080000:0.0:1746066822.566688:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1260 committed 00000004:00080000:0.0:1746066822.566690:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1262 committed 00000004:00080000:0.0:1746066822.566692:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1261 committed 00000004:00080000:0.0:1746066822.566693:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1259 committed 00000004:00080000:0.0:1746066822.566694:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1258 committed 00000004:00080000:0.0:1746066822.566696:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1260 committed 00000001:00080000:0.0:1746066822.566700:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937899 is committed 00000001:00080000:0.0:1746066822.566707:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937896 is committed 00000100:00100000:2.0:1746066822.566801:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985212800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.566859:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.566919:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985213312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.566936:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.566954:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746066822.566958:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985212672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.566971:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.566981:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985213184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.566993:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.567014:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985212800 00000100:00100000:2.0:1746066822.567020:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985212800 00000100:00100000:2.0:1746066822.567044:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213312 00000100:00100000:2.0:1746066822.567045:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213312 00000100:00100000:2.0:1746066822.567061:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985212672 00000100:00100000:2.0:1746066822.567063:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985212672 00000100:00100000:2.0:1746066822.567071:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213184 00000100:00100000:2.0:1746066822.567073:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213184 00000100:00100000:2.0:1746066822.567084:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20997 00000100:00100000:2.0:1746066822.567090:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985212800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066822.567202:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066822.567205:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.567207:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.567208:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.567210:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066822.567236:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882985212800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (376us total) trans 21474842834 rc 0/0 00000100:00100000:2.0:1746066822.567241:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20997 00000100:00100000:2.0:1746066822.567253:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20998 00000100:00100000:2.0:1746066822.567275:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985213312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.567331:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882985213312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (393us total) trans 21474842835 rc 0/0 00000100:00100000:2.0:1746066822.567335:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20998 00000100:00100000:2.0:1746066822.567346:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20999 00000100:00100000:2.0:1746066822.567350:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985212672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066822.567383:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066822.567386:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066822 -> 1746066822 00002000:00010000:2.0:1746066822.567387:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:2.0:1746066822.567389:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066822 -> 1746066822 00002000:00010000:2.0:1746066822.567391:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066822.567406:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882985212672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (434us total) trans 21474842836 rc 0/0 00000100:00100000:2.0:1746066822.567410:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20999 00000100:00100000:2.0:1746066822.567419:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21000 00000100:00100000:2.0:1746066822.567423:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882985213184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.567467:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882985213184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (472us total) trans 21474842837 rc 0/0 00000100:00100000:2.0:1746066822.567471:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21000 00000004:00080000:2.0:1746066822.567497:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8bb80/2, rc 0, transno 21474842836 00000100:00100000:2.0:1746066822.567502:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985212672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066822.567509:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89f80/2, rc 0, transno 21474842837 00000100:00100000:2.0:1746066822.567512:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985213184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066822.567518:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8a680/2, rc 0, transno 21474842834 00000100:00100000:2.0:1746066822.567520:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985212800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066822.567526:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a88e00/2, rc 0, transno 21474842835 00000100:00100000:2.0:1746066822.567528:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985213312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567600:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985212928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567624:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.567637:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567649:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.567659:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066822.567663:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985212544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567677:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.567685:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567705:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.567721:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985212928 00000100:00100000:1.0:1746066822.567724:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985212928 00000100:00100000:3.0:1746066822.567728:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213440 00000100:00100000:3.0:1746066822.567733:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213440 00000100:00100000:1.0:1746066822.567739:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985212544 00000100:00100000:1.0:1746066822.567741:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985212544 00000100:00100000:3.0:1746066822.567751:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213056 00000100:00100000:3.0:1746066822.567753:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213056 00000100:00100000:1.0:1746066822.567753:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21001 00000100:00100000:1.0:1746066822.567758:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882985212928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.567768:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21002 00000100:00100000:3.0:1746066822.567773:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882985213440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.567815:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882985212928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (190us total) trans 21474842838 rc 0/0 00000100:00100000:1.0:1746066822.567820:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21001 00000100:00100000:1.0:1746066822.567830:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21003 00000100:00100000:1.0:1746066822.567834:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985212544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.567842:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985213440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (191us total) trans 21474842839 rc 0/0 00000100:00100000:3.0:1746066822.567847:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21002 00000100:00100000:3.0:1746066822.567860:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21004 00000100:00100000:3.0:1746066822.567865:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985213056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066822.567869:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066822.567871:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:1.0:1746066822.567873:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00002000:00010000:1.0:1746066822.567875:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:1.0:1746066822.567877:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066822.567910:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985212544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (231us total) trans 21474842840 rc 0/0 00000100:00100000:1.0:1746066822.567915:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21003 00000100:00100000:3.0:1746066822.567934:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985213056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (227us total) trans 21474842841 rc 0/0 00000004:00080000:1.0:1746066822.567937:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89180/2, rc 0, transno 21474842840 00000100:00100000:3.0:1746066822.567939:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21004 00000100:00100000:1.0:1746066822.567940:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985212544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066822.567946:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8b800/2, rc 0, transno 21474842841 00000100:00100000:1.0:1746066822.567949:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213056:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066822.567954:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a88000/2, rc 0, transno 21474842838 00000100:00100000:1.0:1746066822.567956:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985212928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066822.567961:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a8a300/2, rc 0, transno 21474842839 00000100:00100000:1.0:1746066822.567963:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213440:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746066822.567984:0:10125:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800930e2d80 reply state ffff880096feb800 transno 8589937900 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.568001:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.568014:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.568017:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066822.568021:0:10125:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746066822.568038:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985213696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568054:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.568060:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.568074:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066822.568076:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568086:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985214464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.568091:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066822.568102:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066822.568102:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066822.568106:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985213824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568111:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066822.568115:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.568120:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.568130:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213696 00000100:00100000:1.0:1746066822.568133:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213696 00000100:00100000:3.0:1746066822.568136:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568145:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213952 00000100:00100000:1.0:1746066822.568147:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213952 00000100:00100000:3.0:1746066822.568149:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.568153:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214208 00000100:00100000:1.0:1746066822.568154:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214208 00000100:00100000:1.0:1746066822.568160:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214464 00000100:00100000:1.0:1746066822.568161:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214464 00000100:00100000:3.0:1746066822.568162:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213824 00000100:00100000:3.0:1746066822.568164:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213824 00000100:00100000:1.0:1746066822.568167:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214336 00000100:00100000:1.0:1746066822.568169:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214336 00000100:00100000:3.0:1746066822.568176:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21005 00000100:00100000:3.0:1746066822.568180:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882985213696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066822.568240:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066822.568242:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.568244:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00002000:00010000:3.0:1746066822.568246:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.568248:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066822.568282:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882985213696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (222us total) trans 17179875490 rc 0/0 00000100:00100000:1.0:1746066822.568527:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21006 00000100:00100000:1.0:1746066822.568534:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882985213952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568590:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882985213952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (515us total) trans 17179875491 rc 0/0 00000100:00100000:1.0:1746066822.568596:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21006 00000100:00100000:1.0:1746066822.568605:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21007 00000100:00100000:1.0:1746066822.568608:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882985214208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.568656:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882985214208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (564us total) trans 17179875492 rc 0/0 00000100:00100000:1.0:1746066822.568661:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21007 00000100:00100000:1.0:1746066822.568669:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21008 00000100:00100000:1.0:1746066822.568672:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882985214464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066822.568705:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066822.568707:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00000100:00100000:0.0:1746066822.568726:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21009 00000100:00100000:0.0:1746066822.568732:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882985213824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066822.568771:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:0.0:1746066822.568773:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:0.0:1746066822.568775:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00002000:00010000:0.0:1746066822.568777:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:0.0:1746066822.568779:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:0.0:1746066822.568798:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882985213824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (677us total) trans 17179875494 rc 0/0 00000100:00100000:0.0:1746066822.568803:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21009 00000100:00100000:0.0:1746066822.568812:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21010 00000100:00100000:0.0:1746066822.568816:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882985214336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.568860:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882985214336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (710us total) trans 17179875495 rc 0/0 00000100:00100000:0.0:1746066822.568865:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21010 00000100:00100000:0.0:1746066822.568944:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066822.569046:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066822.569048:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066822.569050:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066822.569068:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882985214464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 395us (965us total) trans 17179875493 rc 0/0 00000100:00100000:1.0:1746066822.569076:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21008 00000100:00100000:3.0:1746066822.569087:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21005 00000004:00080000:3.0:1746066822.569112:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0ea00/2, rc 0, transno 17179875494 00000100:00100000:3.0:1746066822.569119:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985213824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.569122:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985693952 00000100:00100000:0.0:1746066822.569125:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985693952 00000004:00080000:3.0:1746066822.569126:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0c380/2, rc 0, transno 17179875495 00000100:00100000:3.0:1746066822.569128:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066822.569134:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0f100/2, rc 0, transno 17179875492 00000100:00100000:3.0:1746066822.569136:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066822.569141:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0e680/2, rc 0, transno 17179875490 00000100:00100000:3.0:1746066822.569144:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985213696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.569150:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17383 00000100:00100000:0.0:1746066822.569155:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3731:x1830882985693952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066822.569168:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066822.569181:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfb2da0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84f0 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746066822.569208:0:10125:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066822.569218:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3725:x1830882985692416:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 13399us (13517us total) trans 8589937900 rc 0/0 00010000:00010000:0.0:1746066822.569218:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfb2da0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f0 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.569224:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17382 00010000:00010000:0.0:1746066822.569228:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfb2da0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f0 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.569241:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.569248:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.569253:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066822.569360:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985214592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.569379:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.569397:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214592 00000100:00100000:1.0:1746066822.569399:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214592 00000100:00100000:1.0:1746066822.569411:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21011 00000100:00100000:1.0:1746066822.569415:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985214592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.569468:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985214592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (88us total) trans 17179875496 rc 0/0 00000100:00100000:1.0:1746066822.569473:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21011 00000004:00080000:1.0:1746066822.569490:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165c00/2, rc 0, transno 17179875496 00000100:00100000:1.0:1746066822.569493:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985214592:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746066822.569573:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066822.569576:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066822.569579:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1e00, rc 0) 00000100:00100000:0.0:1746066822.569598:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3731:x1830882985693952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 442us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.569603:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17383 00000100:00100000:0.0:1746066822.569621:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066822.569633:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985214080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.569650:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066822.569664:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0df80/2, rc 0, transno 17179875491 00000100:00100000:0.0:1746066822.569667:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066822.569673:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0c700/2, rc 0, transno 17179875493 00000100:00100000:0.0:1746066822.569675:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985214464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.569686:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985213568 00000100:00100000:0.0:1746066822.569688:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985213568 00000100:00100000:0.0:1746066822.569698:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214080 00000100:00100000:0.0:1746066822.569700:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214080 00000100:00100000:0.0:1746066822.569710:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21012 00000100:00100000:0.0:1746066822.569714:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985213568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066822.569753:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066822.569755:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066822.569757:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066822.569759:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:0.0:1746066822.569761:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066822.569780:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882985213568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (159us total) trans 17179875497 rc 0/0 00000100:00100000:0.0:1746066822.569785:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21012 00000100:00100000:0.0:1746066822.569793:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21013 00000100:00100000:0.0:1746066822.569797:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882985214080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066822.569831:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066822.569833:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066822.569835:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066822.569837:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066822.569838:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:0.0:1746066822.569855:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882985214080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (203us total) trans 17179875498 rc 0/0 00000100:00100000:0.0:1746066822.569859:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21013 00000004:00080000:0.0:1746066822.569876:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0ed80/2, rc 0, transno 17179875497 00000100:00100000:0.0:1746066822.569879:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985213568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066822.569903:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d880/2, rc 0, transno 17179875498 00000100:00100000:0.0:1746066822.569906:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985214080:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066822.570033:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea5200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.570038:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.570045:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.570055:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.570057:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066822.570060:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066822.570065:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb2d6f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066822.573147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.573193:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.573266:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985694080 00000100:00100000:2.0:1746066822.573276:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985694080 00000100:00100000:2.0:1746066822.573482:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985694336 00000100:00100000:2.0:1746066822.573486:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985694336 00000100:00100000:1.0:1746066822.573746:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17384 00000100:00100000:1.0:1746066822.573755:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+7:3725:x1830882985694080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.573779:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.573798:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84f7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.573857:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.573871:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.573919:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.573923:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066822.573926:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326dc00, rc 0) 00000100:00100000:2.0:1746066822.574213:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17385 00000100:00100000:2.0:1746066822.574219:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3733:x1830882985694336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.574229:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.574238:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d84fe expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.574312:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574320:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574328:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574339:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574345:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574350:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574436:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574446:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.574452:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.574480:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.574496:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 8 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.574508:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985214720:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.574550:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+8:3725:x1830882985694080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 796us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.574556:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17384 00000100:00100000:2.0:1746066822.574565:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.575701:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985214720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.575718:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066822.576833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.576957:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.577128:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985694720 00000100:00100000:1.0:1746066822.577135:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985694720 00000100:00100000:2.0:1746066822.577136:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985694464 00000100:00100000:2.0:1746066822.577141:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985694464 00010000:00010000:2.0:1746066822.577167:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 9 pid: 10125 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.577190:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9703 00000100:00100000:1.0:1746066822.577191:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6582 00000100:00100000:2.0:1746066822.577197:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985694464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066822.577198:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3725:x1830882985694720:12345-192.168.204.16@tcp:35:lfs.0 00010000:00010000:2.0:1746066822.577209:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.577215:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 9 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.577225:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 9 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.577244:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06600/0xf1867c21abfb2d14 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84b8 expref: 9 pid: 10125 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.577272:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.577277:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577285:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577292:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577313:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.577348:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985694464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 151us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.577355:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9703 00010000:00010000:2.0:1746066822.577374:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.577379:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3725:x1830882985694720:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 181us (421us total) trans 8589937901 rc 0/0 00010000:00010000:2.0:1746066822.577381:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.577384:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6582 00000004:00200000:2.0:1746066822.577394:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.577437:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577444:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577450:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577456:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.577459:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577465:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577474:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.577476:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066822.577479:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577483:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfb2dc3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577499:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577504:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577509:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577513:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577516:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576b400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.577518:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577523:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577530:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.577532:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.577534:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577539:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577548:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577552:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577556:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577560:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.577563:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577567:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577573:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20a00) 00010000:00010000:2.0:1746066822.577575:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.577577:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577582:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.577620:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2dae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84fe expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.577627:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfb2dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84fe expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.577635:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2a00, rc 0) 00000100:00100000:2.0:1746066822.577657:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3733:x1830882985694336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3438us (4463us total) trans 8589937902 rc 301/301 00000100:00100000:2.0:1746066822.577663:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17385 00000100:00100000:0.0:1746066822.579983:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.580054:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985694976 00000100:00100000:3.0:1746066822.580062:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985694976 00000100:00100000:3.0:1746066822.580107:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6583 00000100:00100000:3.0:1746066822.580113:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+8:3725:x1830882985694976:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066822.580326:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31c94c27-8194-4112-9e80-db222abc766f+9:3725:x1830882985694976:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 212us (351us total) trans 8589937903 rc 0/0 00000100:00100000:3.0:1746066822.580332:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6583 00000100:00100000:0.0:1746066822.580667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.581193:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985695232 00000100:00100000:3.0:1746066822.581197:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985695232 00002000:00100000:3.0:1746066822.581226:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800930e3100 x1830882985695232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.581236:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e3100 with x1830882985695232 ext(0->1048575) 00002000:00010000:3.0:1746066822.581242:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e3100 00000100:00100000:3.0:1746066822.581273:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7994 00000100:00100000:3.0:1746066822.581279:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985695232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.582960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.583001:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.583022:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985695488 00000100:00100000:0.0:1746066822.583027:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985695488 00002000:00100000:0.0:1746066822.583061:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800930e0a80 x1830882985695488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.583070:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0a80 with x1830882985695488 ext(1048576->2097151) 00002000:00010000:0.0:1746066822.583076:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0a80 00000100:00100000:0.0:1746066822.583103:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985695616 00000100:00100000:0.0:1746066822.583106:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985695616 00002000:00100000:0.0:1746066822.583116:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88011f762d80 x1830882985695616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.583123:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762d80 with x1830882985695616 ext(1048576->2097151) 00002000:00010000:0.0:1746066822.583127:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f762d80 00000100:00100000:0.0:1746066822.583139:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7995 00000100:00100000:0.0:1746066822.583146:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985695488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066822.583197:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7996 00000100:00100000:2.0:1746066822.583206:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985695616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.583919:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.583938:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985696000 00000100:00100000:0.0:1746066822.583941:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985696000 00002000:00100000:0.0:1746066822.584391:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f760700 x1830882985696000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.584402:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760700 with x1830882985696000 ext(1048576->2097151) 00002000:00010000:0.0:1746066822.584408:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f760700 00000100:00100000:0.0:1746066822.584453:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7997 00000100:00100000:0.0:1746066822.584460:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985696000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.601166:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985695488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18009us (18201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.601166:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985695232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19875us (20488us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066822.601178:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7995 00000100:00100000:2.0:1746066822.601183:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7994 00002000:00100000:3.0:1746066822.601190:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800930e0a80 x1830882985695488/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.601191:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800930e3100 x1830882985695232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.601199:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0a80 with x1830882985695488 ext(1048576->2097151) 00002000:00100000:2.0:1746066822.601199:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e3100 with x1830882985695232 ext(0->1048575) 00002000:00010000:3.0:1746066822.601205:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0a80 00002000:00010000:2.0:1746066822.601205:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e3100 00000100:00100000:3.0:1746066822.608867:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985695616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25649us (25851us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066822.608879:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7996 00002000:00100000:3.0:1746066822.608910:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88011f762d80 x1830882985695616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.608919:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f762d80 with x1830882985695616 ext(1048576->2097151) 00002000:00010000:3.0:1746066822.608926:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f762d80 00000100:00100000:1.0:1746066822.609753:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985696000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25291us (25834us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066822.609760:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7997 00002000:00100000:1.0:1746066822.609767:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88011f760700 x1830882985696000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.609775:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760700 with x1830882985696000 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.609779:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f760700 00000100:00100000:0.0:1746066822.626930:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.627081:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985696256 00000100:00100000:2.0:1746066822.627092:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985696256 00000100:00100000:2.0:1746066822.627159:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17386 00000100:00100000:2.0:1746066822.627168:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3733:x1830882985696256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.627195:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.627199:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066822.627230:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfb2da0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f0 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.627266:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.627271:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.627285:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dd1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8505 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.627341:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.627354:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.627362:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.627391:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.627403:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 8 pid: 7243 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.627416:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985214848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.627504:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.629279:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.629351:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985696512 00000100:00100000:2.0:1746066822.629359:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985696512 00000100:00100000:2.0:1746066822.629407:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17387 00000100:00100000:2.0:1746066822.629414:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:3737:x1830882985696512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.629436:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.629451:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2ddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d850c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.629520:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629533:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629543:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629556:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629562:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629567:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629663:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629672:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629678:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066822.629688:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.629758:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629765:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629771:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629777:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095750400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.629781:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.629789:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066822.630413:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.630460:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985696640 00000100:00100000:3.0:1746066822.630464:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985696640 00000100:00100000:3.0:1746066822.630497:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17388 00000100:00100000:3.0:1746066822.630502:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3731:x1830882985696640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.630510:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.630518:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8513 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.630849:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.630853:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746066822.630858:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630864:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2df4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630878:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630897:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630902:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630906:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630910:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095778a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.630912:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630917:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630924:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.630926:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.630928:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630933:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfb2de6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630939:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630943:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630947:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630951:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.630953:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630956:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630960:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20e00) 00010000:00010000:2.0:1746066822.630962:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.630963:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.630966:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779400/0xf1867c21abfb2ded lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.631025:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.631036:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.631049:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.631058:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.631071:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.631073:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066822.631075:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.631081:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2800, rc 0) 00000100:00100000:3.0:1746066822.631122:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3731:x1830882985696640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 620us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.631128:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17388 00010000:00010000:2.0:1746066822.631691:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2ddf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d850c expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.631698:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xf1867c21abfb2ddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d850c expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.631708:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:2.0:1746066822.631735:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:3737:x1830882985696512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2322us (2462us total) trans 8589937904 rc 301/301 00000100:00100000:2.0:1746066822.631740:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17387 00000100:00100000:0.0:1746066822.633023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.633215:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985214848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.633238:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.633307:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985696768 00000100:00100000:1.0:1746066822.633315:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985696768 00010000:00010000:1.0:1746066822.633343:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 9 pid: 7243 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.633365:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9704 00000100:00100000:1.0:1746066822.633372:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985696768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.633387:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.633392:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 9 pid: 7243 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.633403:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 9 pid: 7243 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.633421:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326dc00/0xf1867c21abfb2da7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84f7 expref: 9 pid: 7243 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746066822.633436:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.633440:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.633449:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.633456:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.633464:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.633493:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.633522:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985696768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 149us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.633528:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9704 00010000:00010000:3.0:1746066822.633705:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.633716:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.634038:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.634060:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697024 00000100:00100000:1.0:1746066822.634063:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697024 00000100:00100000:1.0:1746066822.634095:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6584 00000100:00100000:1.0:1746066822.634100:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3737:x1830882985697024:12345-192.168.204.16@tcp:35:cat.0 00000040:00080000:3.0:1746066822.634617:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1293, 88 off121376 00000004:00080000:3.0:1746066822.634624:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790845740005ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.634662:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1292, 88 off121200 00000004:00080000:3.0:1746066822.634666:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790845782767ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635006:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1293, 88 off121288 00000004:00080000:3.0:1746066822.635011:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846127409ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635020:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1294, 88 off121464 00000004:00080000:3.0:1746066822.635023:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846139930ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635199:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1295, 88 off121552 00000004:00080000:3.0:1746066822.635203:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846320020ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635212:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1294, 88 off121376 00000004:00080000:3.0:1746066822.635215:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846331755ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635226:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1295, 88 off121464 00000004:00080000:3.0:1746066822.635229:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846345847ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635237:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1296, 88 off121552 00000004:00080000:3.0:1746066822.635239:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846356220ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635247:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1296, 88 off121640 00000004:00080000:3.0:1746066822.635249:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846365989ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635270:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1297, 88 off121640 00000004:00080000:3.0:1746066822.635274:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846390588ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635282:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1297, 88 off121728 00000004:00080000:3.0:1746066822.635284:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846400869ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635291:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1298, 88 off121728 00000004:00080000:3.0:1746066822.635293:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846410274ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066822.635299:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1298, 88 off121816 00000004:00080000:3.0:1746066822.635302:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846418555ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635308:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1299, 88 off121904 00000004:00080000:3.0:1746066822.635310:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846427128ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635316:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1300, 88 off121992 00000004:00080000:3.0:1746066822.635319:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846435422ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635336:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1301, 88 off122080 00000004:00080000:3.0:1746066822.635338:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 790846455199ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066822.635347:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1299, 88 off121816 00000004:00080000:3.0:1746066822.635349:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 790846465709ns, next at 733263917711ns, rc = 0 00000100:00100000:1.0:1746066822.636451:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3737:x1830882985697024:12345-192.168.204.16@tcp:35:cat.0 Request processed in 2344us (2407us total) trans 8589937906 rc 0/0 00000100:00100000:1.0:1746066822.636461:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6584 00000001:00080000:0.0:1746066822.637659:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937906 is committed 00000001:00080000:0.0:1746066822.637667:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937905 is committed 00000004:00080000:0.0:1746066822.637670:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1273 committed 00000004:00080000:0.0:1746066822.637686:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1277 committed 00000004:00080000:0.0:1746066822.637697:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1276 committed 00000004:00080000:0.0:1746066822.637698:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1275 committed 00000004:00080000:0.0:1746066822.637700:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1274 committed 00000004:00080000:0.0:1746066822.637701:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1272 committed 00000004:00080000:0.0:1746066822.637702:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1273 committed 00000004:00080000:0.0:1746066822.637704:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1271 committed 00000004:00080000:0.0:1746066822.637705:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1272 committed 00000004:00080000:0.0:1746066822.637707:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1270 committed 00000004:00080000:0.0:1746066822.637708:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1269 committed 00000004:00080000:0.0:1746066822.637709:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1268 committed 00000004:00080000:0.0:1746066822.637711:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1271 committed 00000004:00080000:0.0:1746066822.637712:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1270 committed 00000004:00080000:0.0:1746066822.637714:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1267 committed 00000004:00080000:0.0:1746066822.637715:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1266 committed 00000004:00080000:0.0:1746066822.637716:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1269 committed 00000001:00080000:0.0:1746066822.637722:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937903 is committed 00000100:00100000:2.0:1746066822.637842:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985215104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.637842:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985215360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.637904:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066822.638439:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985215232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.638506:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.638532:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638534:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985215872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.638554:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985215488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.638556:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638569:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985216384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.638573:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638590:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215360 00000100:00100000:2.0:1746066822.638594:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985216128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.638603:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215360 00000100:00100000:2.0:1746066822.638613:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.638626:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985216640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.638629:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638638:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215104 00000100:00100000:1.0:1746066822.638640:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215104 00000100:00100000:2.0:1746066822.638644:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066822.638649:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985215616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.638652:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215872 00000100:00100000:1.0:1746066822.638654:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215872 00000100:00100000:3.0:1746066822.638665:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638665:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215488 00000100:00100000:1.0:1746066822.638667:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215488 00000100:00100000:1.0:1746066822.638675:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216128 00000100:00100000:1.0:1746066822.638676:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216128 00000100:00100000:3.0:1746066822.638677:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985216000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066822.638677:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985214976 00000100:00100000:2.0:1746066822.638681:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985214976 00000100:00100000:1.0:1746066822.638685:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216640 00000100:00100000:1.0:1746066822.638687:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216640 00000100:00100000:3.0:1746066822.638690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066822.638693:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215616 00000100:00100000:1.0:1746066822.638694:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216000 00000100:00100000:2.0:1746066822.638695:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215616 00000100:00100000:1.0:1746066822.638696:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216000 00000100:00100000:3.0:1746066822.638698:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985216512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.638704:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21014 00000100:00100000:2.0:1746066822.638709:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21015 00000100:00100000:1.0:1746066822.638711:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985215360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066822.638714:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3777:x1830882985215104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.638716:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066822.638727:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216512 00000100:00100000:1.0:1746066822.638729:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216512 00000100:00100000:3.0:1746066822.638740:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21016 00000100:00100000:1.0:1746066822.638743:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21017 00000100:00100000:3.0:1746066822.638747:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985215872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066822.638748:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3777:x1830882985215488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.638761:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21018 00000100:00100000:3.0:1746066822.638765:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3777:x1830882985216128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.638820:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21019 00000100:00100000:3.0:1746066822.638825:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882985214976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066822.638835:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066822.638835:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066822.638838:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.638839:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066822.638840:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.638841:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066822.638842:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:2.0:1746066822.638843:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066820 -> 1746066820 00002000:00010000:1.0:1746066822.638843:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:2.0:1746066822.638845:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066822.638869:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3777:x1830882985215488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (295us total) trans 21474842842 rc 0/0 00002000:00010000:3.0:1746066822.638871:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746066822.638871:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3777:x1830882985215104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (339us total) trans 17179875499 rc 0/0 00002000:00010000:3.0:1746066822.638873:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.638874:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00000100:00100000:1.0:1746066822.638874:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21017 00002000:00010000:3.0:1746066822.638876:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.638878:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066822.638878:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21015 00000100:00100000:1.0:1746066822.638902:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21020 00000100:00100000:2.0:1746066822.638906:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21021 00000100:00100000:1.0:1746066822.638906:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3777:x1830882985216640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.638911:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882985216000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.638915:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882985214976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (286us total) trans 21474842844 rc 0/0 00000100:00100000:3.0:1746066822.638921:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21019 00000100:00100000:3.0:1746066822.638931:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21022 00000100:00100000:3.0:1746066822.638935:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882985215616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066822.638952:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3777:x1830882985216640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (308us total) trans 21474842845 rc 0/0 00000100:00100000:1.0:1746066822.638957:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21020 00002000:00010000:2.0:1746066822.638958:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066822.638960:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066822.638963:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066822.638964:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:1.0:1746066822.638964:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21023 00002000:00010000:2.0:1746066822.638966:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066822.638967:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985216512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066822.638976:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:3.0:1746066822.638979:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.638981:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00002000:00010000:3.0:1746066822.638982:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.638984:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:2.0:1746066822.638985:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985216000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (293us total) trans 17179875500 rc 0/0 00000100:00100000:2.0:1746066822.638990:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21021 00000100:00100000:3.0:1746066822.639002:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985215616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (335us total) trans 17179875501 rc 0/0 00000100:00100000:3.0:1746066822.639007:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21022 00000100:00100000:1.0:1746066822.639013:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882985216512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (296us total) trans 17179875502 rc 0/0 00000100:00100000:1.0:1746066822.639017:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21023 00000004:00080000:2.0:1746066822.639022:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b166680/2, rc 0, transno 17179875499 00000100:00100000:2.0:1746066822.639031:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985215104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066822.639041:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3480/2, rc 0, transno 21474842842 00000100:00100000:2.0:1746066822.639044:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985215488:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066822.639050:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3100/2, rc 0, transno 21474842845 00000100:00100000:2.0:1746066822.639053:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985216640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.639071:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985215872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (513us total) trans 21474842846 rc 0/0 00000100:00100000:3.0:1746066822.639076:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21016 00000100:00100000:2.0:1746066822.639083:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746066822.639089:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985217024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.639107:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3777:x1830882985216128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 341us (493us total) trans 21474842843 rc 0/0 00000100:00100000:2.0:1746066822.639108:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066822.639111:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21018 00000100:00100000:3.0:1746066822.639120:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985217024 00000100:00100000:3.0:1746066822.639123:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985217024 00000004:00080000:2.0:1746066822.639127:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1f80/2, rc 0, transno 21474842843 00000100:00100000:2.0:1746066822.639131:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985216128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.639137:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21024 00000100:00100000:3.0:1746066822.639141:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3777:x1830882985217024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.639208:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882985217024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (98us total) trans 17179875503 rc 0/0 00000100:00100000:3.0:1746066822.639213:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21024 00000004:00080000:3.0:1746066822.639236:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0e00/2, rc 0, transno 21474842844 00000100:00100000:3.0:1746066822.639240:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985214976:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066822.639247:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b166a00/2, rc 0, transno 17179875501 00000100:00100000:3.0:1746066822.639249:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985215616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066822.639270:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164a80/2, rc 0, transno 17179875500 00000100:00100000:3.0:1746066822.639273:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985216000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066822.639274:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d857b80/2, rc 0, transno 17179875503 00000100:00100000:2.0:1746066822.639278:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985217024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066822.639280:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164e00/2, rc 0, transno 17179875502 00000100:00100000:3.0:1746066822.639282:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985216512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.639329:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746066822.639339:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.639344:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985215744:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066822.639351:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.639354:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066822.639358:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.639360:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746066822.639370:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.639376:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985216256:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066822.639378:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066822.639389:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066822.639396:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985216768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.639407:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066822.639436:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215232 00000100:00100000:0.0:1746066822.639438:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215232 00000100:00100000:3.0:1746066822.639448:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985215744 00000100:00100000:0.0:1746066822.639450:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216256 00000100:00100000:3.0:1746066822.639451:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985215744 00000100:00100000:0.0:1746066822.639452:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216256 00000100:00100000:0.0:1746066822.639458:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216768 00000100:00100000:0.0:1746066822.639460:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216768 00000100:00100000:3.0:1746066822.639464:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21025 00000100:00100000:3.0:1746066822.639468:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3774:x1830882985215232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.639470:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21026 00000100:00100000:2.0:1746066822.639476:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882985216256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066822.639506:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066822.639508:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066822 -> 1746066822 00002000:00010000:3.0:1746066822.639515:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066820 -> 1746066820 00002000:00010000:3.0:1746066822.639517:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066822 -> 1746066822 00002000:00010000:3.0:1746066822.639519:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066822.639540:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985216256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (149us total) trans 17179875504 rc 0/0 00000100:00100000:3.0:1746066822.639541:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3774:x1830882985215232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (212us total) trans 21474842847 rc 0/0 00000100:00100000:0.0:1746066822.639690:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21027 00000100:00100000:2.0:1746066822.639695:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21026 00000100:00100000:0.0:1746066822.639696:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985215744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066822.639700:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21025 00000100:00100000:2.0:1746066822.639708:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21028 00000100:00100000:2.0:1746066822.639713:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882985216768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066822.639749:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882985215744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (389us total) trans 17179875505 rc 0/0 00002000:00010000:2.0:1746066822.639753:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00000100:00100000:0.0:1746066822.639754:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21027 00002000:00010000:2.0:1746066822.639756:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066822.639757:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066822.639759:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066822.639761:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000004:00080000:0.0:1746066822.639777:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0380/2, rc 0, transno 21474842847 00000100:00100000:2.0:1746066822.639780:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882985216768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (372us total) trans 17179875506 rc 0/0 00000100:00100000:0.0:1746066822.639780:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985215232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.639785:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21028 00000004:00080000:0.0:1746066822.639786:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165180/2, rc 0, transno 17179875505 00000100:00100000:0.0:1746066822.639788:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985215744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066822.639793:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b167480/2, rc 0, transno 17179875504 00000100:00100000:0.0:1746066822.639795:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985216256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066822.639799:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b167800/2, rc 0, transno 17179875506 00000100:00100000:0.0:1746066822.639801:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985216768:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066822.639865:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.639873:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985217152:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066822.639933:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.639972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.639989:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697152 00000100:00100000:2.0:1746066822.639993:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697152 00000100:00100000:2.0:1746066822.640023:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17389 00000100:00100000:2.0:1746066822.640028:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:3737:x1830882985697152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.640041:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.640053:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfb2e09 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d851a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066822.640088:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066822.640090:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.640092:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066822 -> 1746066822 00002000:00010000:3.0:1746066822.640093:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066823 -> 1746066823 00002000:00010000:3.0:1746066822.640094:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066822.640108:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3775:x1830882985215360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1398us (1604us total) trans 17179875507 rc 0/0 00000100:00100000:3.0:1746066822.640111:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21014 00010000:00010000:2.0:1746066822.640123:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.640128:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066822.640132:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.640140:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.640147:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985216896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.640159:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:2.0:1746066822.640161:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:2.0:1746066822.640164:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:3.0:1746066822.640172:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164000/2, rc 0, transno 17179875507 00000100:00100000:3.0:1746066822.640174:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985215360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066822.640178:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3800/2, rc 0, transno 21474842846 00000004:00010000:2.0:1746066822.640178:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.640179:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985215872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066822.640185:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216384 00000100:00100000:3.0:1746066822.640187:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216384 00000100:00100000:3.0:1746066822.640196:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985216896 00010000:00010000:2.0:1746066822.640196:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfb2e09 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.640197:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985216896 00000100:00100000:3.0:1746066822.640204:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21029 00000100:00100000:3.0:1746066822.640207:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3775:x1830882985216384:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066822.640209:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.640215:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.640217:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066822.640220:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac200, rc 0) 00000100:00100000:2.0:1746066822.640241:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:3737:x1830882985697152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 213us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.640247:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882985216384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (118us total) trans 21474842848 rc 0/0 00000100:00100000:2.0:1746066822.640247:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17389 00000100:00100000:3.0:1746066822.640251:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21029 00000100:00100000:2.0:1746066822.640277:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21030 00000100:00100000:2.0:1746066822.640282:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3775:x1830882985216896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066822.640342:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800986ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882985216896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (181us total) trans 21474842849 rc 0/0 00000100:00100000:2.0:1746066822.640347:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21030 00000004:00080000:3.0:1746066822.640382:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1180/2, rc 0, transno 21474842848 00000100:00100000:3.0:1746066822.640385:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985216384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066822.640391:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855180/2, rc 0, transno 21474842849 00000100:00100000:3.0:1746066822.640393:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985216896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066822.642398:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.642446:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985217152:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.642474:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697280 00000100:00100000:1.0:1746066822.642479:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697280 00010000:00010000:3.0:1746066822.642487:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfb2dd1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 12 pid: 7245 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1746066822.642507:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6585 00000100:00100000:1.0:1746066822.642513:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3731:x1830882985697280:12345-192.168.204.16@tcp:49:cat.0 00010000:00010000:3.0:1746066822.642524:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.642549:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b400, rc 0) 00000100:00100000:1.0:1746066822.642618:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3731:x1830882985697280:12345-192.168.204.16@tcp:49:cat.0 Request processed in 105us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.642624:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6585 00000100:00100000:3.0:1746066822.642663:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3733:x1830882985696256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 15496us (15782us total) trans 8589937905 rc 0/0 00000100:00100000:3.0:1746066822.642670:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17386 00000100:00100000:0.0:1746066822.643625:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.643654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.643679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.643704:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.643719:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.643770:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.643796:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697408 00000100:00100000:1.0:1746066822.643807:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697408 00000100:00100000:1.0:1746066822.643847:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697664 00000100:00100000:1.0:1746066822.643849:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697664 00000100:00100000:1.0:1746066822.643862:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697920 00000100:00100000:1.0:1746066822.643864:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697920 00000100:00100000:1.0:1746066822.643873:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697536 00000100:00100000:1.0:1746066822.643875:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697536 00000100:00100000:1.0:1746066822.643918:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985697792 00000100:00100000:2.0:1746066822.643919:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698048 00000100:00100000:1.0:1746066822.643920:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985697792 00000100:00100000:2.0:1746066822.643925:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698048 00000100:00100000:1.0:1746066822.643942:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21031 00000100:00100000:1.0:1746066822.643949:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985697408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.643965:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.643979:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8521 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.644000:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.644002:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.644010:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.644024:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066822.644029:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21032 00010000:00010000:1.0:1746066822.644034:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc200, rc 0) 00000100:00100000:2.0:1746066822.644036:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985697664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.644047:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.644060:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d852f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.644075:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.644077:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066822.644081:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985697408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (458us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066822.644083:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066822.644092:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21031 00010000:00010000:2.0:1746066822.644095:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.644103:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faca00, rc 0) 00000100:00100000:1.0:1746066822.644106:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21033 00000100:00100000:1.0:1746066822.644111:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882985697920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.644117:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.644123:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d853d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.644126:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985697664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 91us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.644131:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21032 00010000:00010000:1.0:1746066822.644134:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.644136:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066822.644139:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21034 00010000:00010000:1.0:1746066822.644140:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066822.644148:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985697536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.644149:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.644155:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.644156:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00010000:00010000:3.0:1746066822.644163:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8528 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.644172:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.644174:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066822.644174:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985697920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (495us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066822.644179:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.644192:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.644199:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541200, rc 0) 00000100:00100000:3.0:1746066822.644218:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985697536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 72us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.644329:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21035 00000100:00100000:2.0:1746066822.644336:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985697792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.644348:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.644356:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8536 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.644376:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.644378:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.644381:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.644389:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.644396:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac600, rc 0) 00000100:00100000:2.0:1746066822.644410:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985697792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.644416:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21035 00000100:00100000:0.0:1746066822.644434:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21036 00000100:00100000:0.0:1746066822.644441:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985698048:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066822.644444:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21033 00010000:00010000:0.0:1746066822.644447:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066822.644454:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21034 00010000:00010000:0.0:1746066822.644457:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8544 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066822.644467:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.644469:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066822.644473:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.644486:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066822.644492:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07800, rc 0) 00000100:00100000:0.0:1746066822.644505:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985698048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.644510:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21036 00000100:00100000:0.0:1746066822.650335:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.650401:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698176 00000100:00100000:2.0:1746066822.650410:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698176 00000100:00100000:2.0:1746066822.650445:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21037 00000100:00100000:2.0:1746066822.650451:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3733:x1830882985698176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.650473:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.650489:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d854b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.650518:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.650524:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.650532:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.650534:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.650536:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1294336->1843199] (req 1294336->1843199) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.650562:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.650570:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 26 pid: 12255 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.650580:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217280:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.650661:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.650666:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746066822.650671:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.650681:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.652046:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217280:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.652051:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.652061:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217408:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.652084:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1294336->1843199] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.652105:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fada00, rc 0) 00000100:00100000:2.0:1746066822.652144:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3733:x1830882985698176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1692us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.652152:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21037 00000100:00100000:3.0:1746066822.652222:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698304 00000100:00100000:3.0:1746066822.652228:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698304 00010000:00010000:3.0:1746066822.652251:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.652790:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9705 00000100:00100000:3.0:1746066822.652797:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985698304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.652807:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.652823:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.652833:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.652851:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfb2d7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84d4 expref: 19 pid: 12237 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.652878:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.654036:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985698304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1236us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.654044:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9705 00000100:00100000:0.0:1746066822.662831:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.662867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.662908:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698432 00000100:00100000:3.0:1746066822.662916:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698432 00000100:00100000:0.0:1746066822.662934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066822.662941:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746066822.662960:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9706 00000100:00100000:3.0:1746066822.662964:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985698432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.662973:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.662990:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.662998:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746066822.663012:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faca00/0xf1867c21abfb2e1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d852f expref: 27 pid: 12255 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746066822.663020:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698688 00000100:00100000:1.0:1746066822.663024:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698688 00010000:00010000:3.0:1746066822.663025:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.663027:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.663030:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.663036:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066822.663051:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095dd7800 x1830882985698688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066822.663060:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066822.663060:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7800 with x1830882985698688 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.663064:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7800 00000100:00100000:3.0:1746066822.663068:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985217536:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.663076:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985698944 00000100:00100000:1.0:1746066822.663079:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985698944 00002000:00100000:1.0:1746066822.663089:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f55f80 x1830882985698944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.663096:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55f80 with x1830882985698944 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.663099:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f55f80 00000100:00100000:1.0:1746066822.663109:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7998 00000100:00100000:1.0:1746066822.663114:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985698688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.663119:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.663133:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7999 00000100:00100000:3.0:1746066822.663136:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985698944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.666289:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.666337:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.666353:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.666477:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e435f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985217536:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066822.666495:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.666530:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985698432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3563us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.666539:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9706 00000100:00100000:3.0:1746066822.666579:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985699712 00000100:00100000:3.0:1746066822.666585:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985699712 00000100:00100000:3.0:1746066822.666612:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17390 00000100:00100000:3.0:1746066822.666618:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:3739:x1830882985699712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066822.666634:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.666648:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094540800/0xf1867c21abfb2e48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8552 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.666704:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666714:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666727:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666739:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666745:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666749:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666841:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfb2e5d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666849:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfb2e5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666855:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfb2e5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066822.666861:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:1.0:1746066822.666870:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985699328 00000100:00100000:1.0:1746066822.666874:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985699328 00002000:00100000:1.0:1746066822.666917:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098f55880 x1830882985699328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.666926:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55880 with x1830882985699328 ext(0->1048575) 00002000:00010000:1.0:1746066822.666929:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f55880 00000100:00100000:1.0:1746066822.666940:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985699456 00000100:00100000:1.0:1746066822.666942:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985699456 00010000:00010000:3.0:1746066822.666943:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666948:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00002000:00100000:1.0:1746066822.666951:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880094306a00 x1830882985699456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066822.666953:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666958:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00002000:00100000:1.0:1746066822.666958:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830882985699456 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.666960:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306a00 00010000:00010000:3.0:1746066822.666963:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094540200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.666966:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.666970:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8000 00010000:00010000:3.0:1746066822.666972:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066822.666975:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985699328:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066822.666980:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066822.666982:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.666985:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666989:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540200/0xf1867c21abfb2e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.666998:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667002:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667006:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667009:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094541c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.667011:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667015:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667019:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096922700) 00010000:00010000:3.0:1746066822.667021:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.667022:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667030:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541c00/0xf1867c21abfb2e56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066822.667056:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540800/0xf1867c21abfb2e48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8552 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.667064:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfb2e5d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8552 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.667069:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.667071:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066822.667072:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541600, rc 0) 00000100:00100000:3.0:1746066822.667091:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3739:x1830882985699712:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 473us (753us total) trans 8589937907 rc 0/0 00000100:00100000:3.0:1746066822.667096:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17390 00000100:00100000:3.0:1746066822.667114:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8001 00000100:00100000:3.0:1746066822.667119:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985699456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.667989:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.668584:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985699968 00000100:00100000:3.0:1746066822.668590:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985699968 00002000:00100000:3.0:1746066822.668614:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1298431) req@ffff880094305f80 x1830882985699968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.668622:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882985699968 ext(1294336->1298431) 00002000:00010000:3.0:1746066822.668627:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:3.0:1746066822.668650:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8002 00000100:00100000:3.0:1746066822.668656:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985699968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.668728:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985699968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 72us (742us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.668734:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8002 00002000:00100000:3.0:1746066822.668739:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1298431) req@ffff880094305f80 x1830882985699968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.668746:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882985699968 ext(1294336->1298431) 00002000:00010000:3.0:1746066822.668749:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305f80 00010000:00010000:2.0:1746066822.674004:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066822.675780:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985698944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12634us (12837us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066822.675792:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7999 00002000:00100000:3.0:1746066822.675804:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f55f80 x1830882985698944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.675814:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55f80 with x1830882985698944 ext(2097152->4194303) 00002000:00010000:3.0:1746066822.675820:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f55f80 00000100:00100000:1.0:1746066822.683356:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985698688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20233us (20480us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066822.683368:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7998 00002000:00100000:1.0:1746066822.683378:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095dd7800 x1830882985698688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.683388:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7800 with x1830882985698688 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.683393:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7800 00000100:00100000:2.0:1746066822.684285:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.684380:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985700096 00000100:00100000:3.0:1746066822.684389:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985700096 00000100:00100000:3.0:1746066822.684435:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 963 00000100:00100000:3.0:1746066822.684442:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985700096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.684453:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.684473:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfb2e5d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8552 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.684489:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.684493:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066822.684516:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985700096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.684522:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 963 00000100:00100000:2.0:1746066822.685433:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882985699328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18455us (19149us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.685439:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8000 00002000:00100000:2.0:1746066822.685446:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098f55880 x1830882985699328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.685454:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55880 with x1830882985699328 ext(0->1048575) 00002000:00010000:2.0:1746066822.685457:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f55880 00000100:00100000:3.0:1746066822.686171:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882985699456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19050us (19815us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066822.686179:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8001 00002000:00100000:3.0:1746066822.686184:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880094306a00 x1830882985699456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.686190:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830882985699456 ext(1048576->2097151) 00002000:00010000:3.0:1746066822.686194:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306a00 00000100:00100000:0.0:1746066822.690432:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.690511:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985700352 00000100:00100000:3.0:1746066822.690520:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985700352 00002000:00100000:3.0:1746066822.690559:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1839104->1843199) req@ffff880094306680 x1830882985700352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.690570:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830882985700352 ext(1839104->1843199) 00002000:00010000:3.0:1746066822.690574:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306680 00000100:00100000:3.0:1746066822.690603:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8003 00000100:00100000:3.0:1746066822.690611:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985700352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.690727:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985700352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 117us (303us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066822.690733:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8003 00002000:00100000:3.0:1746066822.690738:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1839104->1843199) req@ffff880094306680 x1830882985700352/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.690745:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830882985700352 ext(1839104->1843199) 00002000:00010000:3.0:1746066822.690748:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306680 00000100:00100000:0.0:1746066822.697446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.697501:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.697595:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985700864 00000100:00100000:1.0:1746066822.697604:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985700864 00000100:00100000:1.0:1746066822.697646:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6586 00000100:00100000:1.0:1746066822.697652:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3733:x1830882985700864:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066822.697875:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3733:x1830882985700864:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 222us (372us total) trans 8589937908 rc 0/0 00000100:00100000:1.0:1746066822.697908:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6586 00000100:00100000:3.0:1746066822.698098:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985700608 00000100:00100000:3.0:1746066822.698103:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985700608 00002000:00100000:3.0:1746066822.698131:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094307b80 x1830882985700608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.698141:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830882985700608 ext(4194304->5074943) 00002000:00010000:3.0:1746066822.698146:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:3.0:1746066822.698170:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8004 00000100:00100000:3.0:1746066822.698176:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985700608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.699442:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.699513:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985700992 00000100:00100000:2.0:1746066822.699524:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985700992 00000100:00100000:2.0:1746066822.699575:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17391 00000100:00100000:2.0:1746066822.699582:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+6:3740:x1830882985700992:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.699604:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.699619:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb2e6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8559 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.699667:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699678:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699687:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699697:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699702:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699708:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699767:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699774:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699779:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066822.699815:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:2.0:1746066822.699818:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066822.699828:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699836:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699843:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699848:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699856:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699861:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699866:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f6400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.699869:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699875:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699913:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.699916:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.699919:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699924:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699947:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699952:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699956:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699960:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f6200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.699962:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699969:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699975:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20300) 00010000:00010000:2.0:1746066822.699977:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.699979:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.699983:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2e79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.700005:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb2e6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.700015:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.700020:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.700022:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066822.700024:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6a00, rc 0) 00000100:00100000:2.0:1746066822.700643:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3740:x1830882985700992:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1059us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.700650:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17391 00000100:00100000:1.0:1746066822.701402:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.701736:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701120 00000100:00100000:2.0:1746066822.701743:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701120 00000100:00100000:2.0:1746066822.701789:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21038 00000100:00100000:2.0:1746066822.701795:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:3737:x1830882985701120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.701807:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.701822:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8560 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.701841:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.701848:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.701849:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066822.701853:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.701876:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.701908:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 17 pid: 12255 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.701918:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217664:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.702206:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.707525:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985700608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9336us (10078us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066822.707537:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8004 00002000:00100000:3.0:1746066822.707549:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094307b80 x1830882985700608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.707558:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830882985700608 ext(4194304->5074943) 00002000:00010000:3.0:1746066822.707564:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:0.0:1746066822.708027:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.708718:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.708746:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.708761:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6000, rc 0) 00000100:00100000:2.0:1746066822.708784:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:3737:x1830882985701120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6989us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.708790:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21038 00000100:00100000:2.0:1746066822.708805:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701248 00000100:00100000:2.0:1746066822.708810:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701248 00000100:00100000:2.0:1746066822.708830:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21039 00000100:00100000:2.0:1746066822.708835:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985701248:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.708849:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.708863:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8567 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.708880:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.708899:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.708909:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.708922:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.708929:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6e00, rc 0) 00000100:00100000:2.0:1746066822.708944:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985701248:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 109us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.708949:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21039 00000100:00100000:0.0:1746066822.711722:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.713094:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.713122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.713159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.713175:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.713336:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701504 00000100:00100000:2.0:1746066822.713345:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701504 00000100:00100000:2.0:1746066822.713387:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701632 00000100:00100000:2.0:1746066822.713389:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701632 00000100:00100000:2.0:1746066822.713399:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701760 00000100:00100000:2.0:1746066822.713400:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701760 00000100:00100000:1.0:1746066822.713415:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21040 00000100:00100000:2.0:1746066822.713424:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21041 00000100:00100000:1.0:1746066822.713425:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+6:2014:x1830882985701504:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066822.713430:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+6:2014:x1830882985701632:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066822.713445:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21042 00000100:00100000:2.0:1746066822.713450:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985701760:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.713464:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.713483:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d857c expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.713507:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.713508:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.713516:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.713529:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 9 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.713537:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.713540:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7600, rc 0) 00010000:00010000:1.0:1746066822.713548:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d856e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.713562:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.713563:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.713569:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.713580:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.713592:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cca00, rc 0) 00000100:00100000:3.0:1746066822.713607:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701376 00000100:00100000:3.0:1746066822.713613:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701376 00000100:00100000:3.0:1746066822.713635:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985701888 00000100:00100000:3.0:1746066822.713637:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985701888 00000100:00100000:3.0:1746066822.713664:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21043 00000100:00100000:3.0:1746066822.713669:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985701888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.713675:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.713682:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8583 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.713700:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.713701:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.713707:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.713715:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.713722:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbae00, rc 0) 00000100:00100000:2.0:1746066822.713790:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985701760:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 337us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.713790:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985701504:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 366us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.713795:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21042 00000100:00100000:1.0:1746066822.713799:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21040 00010000:00010000:1.0:1746066822.713814:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.713820:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2eaa lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8575 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.713848:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985701888:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 178us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.713853:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21043 00000100:00100000:1.0:1746066822.713860:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985217792:192.168.204.16@tcp:106: 00002000:00100000:3.0:1746066822.713915:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1843199) req@ffff8800958a7800 x1830882985701376/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.713923:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882985701376 ext(1294336->1843199) 00000100:00100000:1.0:1746066822.713925:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066822.713929:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 18 pid: 12255 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.713940:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 18 pid: 12255 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746066822.713945:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a7800 00000100:00100000:3.0:1746066822.713958:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2285 00000100:00100000:3.0:1746066822.713962:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985701376:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066822.714103:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.714113:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702016 00000100:00100000:3.0:1746066822.714115:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702016 00000100:00100000:3.0:1746066822.714129:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21044 00000100:00100000:3.0:1746066822.714133:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985702016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066822.714139:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066822.714143:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066822.714146:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d858a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.714154:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.714156:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.714160:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.714169:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.714175:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba000, rc 0) 00000100:00100000:3.0:1746066822.714189:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985702016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 56us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.714193:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21044 00000100:00100000:3.0:1746066822.714201:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702144 00000100:00100000:3.0:1746066822.714203:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702144 00000100:00100000:3.0:1746066822.714213:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21045 00000100:00100000:3.0:1746066822.714217:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985702144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.714221:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.714226:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb2eb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8591 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.714248:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217920:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066822.714277:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00002000:00010000:1.0:1746066822.719516:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066822 -> 1746066823 00002000:00010000:1.0:1746066822.719525:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066820 -> 1746066823 00002000:00010000:1.0:1746066822.719527:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066822 -> 1746066823 00000100:00100000:1.0:1746066822.719544:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985217792:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066822.719573:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2eaa lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8575 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.719585:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb2eaa lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8575 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.719604:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc000, rc 0) 00000100:00100000:2.0:1746066822.719662:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985217920:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066822.719696:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb2eb8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8591 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.719708:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb2eb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8591 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.719732:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb400, rc 0) 00000100:00100000:1.0:1746066822.719968:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985701632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6536us (6877us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.719969:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985702144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5748us (5824us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066822.719980:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21041 00000100:00100000:2.0:1746066822.719985:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21045 00000100:00100000:0.0:1746066822.724500:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985701376:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10524us (11327us total) trans 21474842850 rc 0/0 00000100:00100000:0.0:1746066822.724519:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2285 00002000:00100000:0.0:1746066822.724532:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1843199) req@ffff8800958a7800 x1830882985701376/t21474842850(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.724542:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882985701376 ext(1294336->1843199) 00010000:00010000:0.0:1746066822.724553:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 20 pid: 12255 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.724567:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 20 pid: 12255 timeout: 890 lvb_type: 0 00002000:00010000:0.0:1746066822.724574:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a7800 00000100:00100000:0.0:1746066822.724631:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.724666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.724725:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702400 00000100:00100000:1.0:1746066822.724732:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702400 00000100:00100000:1.0:1746066822.724773:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17392 00000100:00100000:1.0:1746066822.724779:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3740:x1830882985702400:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.724804:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.724823:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb2ebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8598 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.724959:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.724981:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.724988:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.724993:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066822.725019:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702528 00010000:00010000:1.0:1746066822.725024:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.725025:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702528 00010000:00010000:1.0:1746066822.725039:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 8 pid: 7245 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.725052:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.725064:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21046 00000100:00100000:3.0:1746066822.725070:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985702528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.725081:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.725092:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb2ecd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d859f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.725128:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985218176:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066822.728619:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.728694:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702656 00000100:00100000:3.0:1746066822.728705:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702656 00010000:00010000:3.0:1746066822.728739:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 22 pid: 12255 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746066822.728774:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9707 00000100:00100000:3.0:1746066822.728781:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985702656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066822.728792:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066822.728809:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 22 pid: 12255 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.728820:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 22 pid: 12255 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746066822.728846:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.728848:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.728854:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.728861:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.728902:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.728913:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985218304:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.728971:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.728983:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 28 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.729094:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218432:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.729356:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.729403:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.729450:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.729843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.729860:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702784 00000100:00100000:0.0:1746066822.729866:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702784 00010000:00010000:0.0:1746066822.729911:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 9 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.729923:0:12255:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff8800a5765500 x1830882985218176) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 22 pid: 12255 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746066822.729934:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9708 00000100:00100000:0.0:1746066822.729940:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985702784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.729941:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fada00/0xf1867c21abfb2e41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d854b expref: 22 pid: 12255 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.729952:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066822.729957:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 9 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.729970:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 9 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746066822.729996:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066822.730001:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066822.730008:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066822.730013:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.730030:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985218176:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066822.730047:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2013:x1830882985702784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066822.730054:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9708 00010000:00010000:2.0:1746066822.730058:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb2ecd lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d859f expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.730068:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb2ecd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d859f expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.730076:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba400, rc 0) 00010000:00010000:1.0:1746066822.730088:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6a00/0xf1867c21abfb2e80 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8559 expref: 8 pid: 7245 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.730101:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218048:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.730102:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985702528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5032us (5470us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.730110:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21046 00000100:00100000:2.0:1746066822.730157:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985218304:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066822.730166:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.730182:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985702656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1402us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.730190:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9707 00000100:00100000:0.0:1746066822.730744:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.730926:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218432:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.730945:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066822.730950:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985702912 00000100:00100000:2.0:1746066822.730955:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985702912 00010000:00010000:2.0:1746066822.730972:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 29 pid: 17253 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.731345:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9709 00000100:00100000:2.0:1746066822.731352:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985702912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.731361:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.731365:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 29 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.731374:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 29 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.731386:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb2e10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d851a expref: 29 pid: 17253 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.731396:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.731400:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.731406:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.731413:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.731476:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.731588:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985702912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 234us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.731595:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9709 00010000:00010000:1.0:1746066822.731640:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.731646:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066822.731664:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066822.731782:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb2ebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.731793:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.731803:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.731805:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066822.731807:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc800, rc 0) 00000100:00100000:1.0:1746066822.731841:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985702400:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7061us (7183us total) trans 8589937909 rc 0/0 00000100:00100000:1.0:1746066822.731846:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17392 00000100:00100000:0.0:1746066822.734854:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.735105:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985703040 00000100:00100000:1.0:1746066822.735114:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985703040 00000100:00100000:1.0:1746066822.735156:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17393 00000100:00100000:1.0:1746066822.735164:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985703040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066822.735189:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.735214:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2edb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85a6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.735316:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.735331:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.735337:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.735982:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.735997:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 9 pid: 7245 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746066822.736015:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.736299:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.736424:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.737089:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985703424 00000100:00100000:1.0:1746066822.737095:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985703424 00002000:00100000:1.0:1746066822.737130:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958ad500 x1830882985703424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.737140:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad500 with x1830882985703424 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.737145:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ad500 00000100:00100000:1.0:1746066822.737171:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8005 00000100:00100000:1.0:1746066822.737177:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985703424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.737465:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.737589:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985703552 00000100:00100000:2.0:1746066822.737593:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985703552 00002000:00100000:2.0:1746066822.737618:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958aea00 x1830882985703552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.737626:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aea00 with x1830882985703552 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.737630:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958aea00 00000100:00100000:2.0:1746066822.738260:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8006 00000100:00100000:2.0:1746066822.738268:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985703552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.741555:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985218560:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.741577:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066822.741691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.741777:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985703680 00000100:00100000:2.0:1746066822.741785:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985703680 00010000:00010000:2.0:1746066822.741813:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 10 pid: 7245 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746066822.742022:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9710 00000100:00100000:2.0:1746066822.742039:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985703680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.742054:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.742059:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 10 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.742069:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 10 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.742087:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb2ec6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8598 expref: 10 pid: 7245 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746066822.742099:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.742103:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.742111:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.742116:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066822.742138:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066822.742163:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.742170:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066822.742182:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985703680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 145us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.742189:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9710 00000004:00200000:1.0:1746066822.742213:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066822.742217:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066822.742230:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066822.742263:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb2edb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.742279:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.742288:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.742291:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066822.742293:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4359400, rc 0) 00000100:00100000:1.0:1746066822.742313:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985703040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7150us (7471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.742319:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17393 00000100:00100000:2.0:1746066822.750794:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985703552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12516us (13318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.750805:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8006 00002000:00100000:2.0:1746066822.750816:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800958aea00 x1830882985703552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.750825:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aea00 with x1830882985703552 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.750831:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958aea00 00000100:00100000:1.0:1746066822.752674:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985703424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15491us (16243us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066822.752683:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8005 00002000:00100000:1.0:1746066822.752691:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958ad500 x1830882985703424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.752699:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad500 with x1830882985703424 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.752704:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ad500 00000100:00100000:0.0:1746066822.754308:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.754522:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985703808 00000100:00100000:2.0:1746066822.754532:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985703808 00000100:00100000:2.0:1746066822.754581:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21047 00000100:00100000:2.0:1746066822.754589:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985703808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.754606:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.754625:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85ad expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.754648:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.754650:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.754660:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.754674:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.754685:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7c00, rc 0) 00000100:00100000:2.0:1746066822.754732:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985703808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.754737:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21047 00000100:00100000:0.0:1746066822.757497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.758027:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.758227:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985704064 00000100:00100000:2.0:1746066822.758236:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985704064 00000100:00100000:1.0:1746066822.758272:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985704192 00000100:00100000:1.0:1746066822.758276:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985704192 00000100:00100000:2.0:1746066822.758306:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17394 00000100:00100000:2.0:1746066822.758313:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985704064:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066822.758334:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.758352:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2ef0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85b4 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758447:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.758461:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.758467:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17395 00010000:00010000:2.0:1746066822.758472:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.758477:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3737:x1830882985704192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.758483:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.758487:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.758488:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.758494:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85bb expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758527:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.758529:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758540:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f7400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.758541:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758543:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.758550:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.758559:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.758561:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066822.758563:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.758564:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1c00, rc 0) 00010000:00010000:2.0:1746066822.758565:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066822.758567:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.758571:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2ef7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066822.758605:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3737:x1830882985704192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (579us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066822.758609:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2ef0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85b4 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758615:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2ef0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85b4 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.758622:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6400, rc 0) 00000100:00100000:2.0:1746066822.758638:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985704064:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 327us (1152us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.758771:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17395 00000100:00100000:2.0:1746066822.758775:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17394 00000100:00100000:0.0:1746066822.760184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.760283:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985704448 00000100:00100000:2.0:1746066822.760290:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985704448 00000100:00100000:2.0:1746066822.761185:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6587 00000100:00100000:2.0:1746066822.761195:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3740:x1830882985704448:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746066822.761388:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3740:x1830882985704448:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 195us (1207us total) trans 8589937910 rc 0/0 00000100:00100000:2.0:1746066822.761394:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6587 00000100:00100000:0.0:1746066822.771419:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.771475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.771516:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985704832 00000100:00100000:1.0:1746066822.771526:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985704832 00000100:00100000:2.0:1746066822.771567:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985704960 00000100:00100000:2.0:1746066822.771571:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985704960 00002000:00100000:1.0:1746066822.771574:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5962d80 x1830882985704832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.771584:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962d80 with x1830882985704832 ext(2097152->4194303) 00002000:00100000:2.0:1746066822.771587:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5963800 x1830882985704960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:1.0:1746066822.771589:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962d80 00002000:00100000:2.0:1746066822.771593:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5963800 with x1830882985704960 ext(2097152->4194303) 00002000:00010000:2.0:1746066822.771596:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5963800 00000100:00100000:1.0:1746066822.771607:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8007 00000100:00100000:1.0:1746066822.771615:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985704832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.771734:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8008 00000100:00100000:2.0:1746066822.771740:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985704960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.785880:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882985704960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14126us (14392us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066822.785923:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8008 00002000:00100000:2.0:1746066822.785935:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5963800 x1830882985704960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.785945:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5963800 with x1830882985704960 ext(2097152->4194303) 00002000:00010000:2.0:1746066822.785951:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5963800 00000100:00100000:1.0:1746066822.786304:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985704832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14686us (14893us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066822.786311:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8007 00002000:00100000:1.0:1746066822.786316:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5962d80 x1830882985704832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.786323:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962d80 with x1830882985704832 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.786326:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962d80 00000100:00100000:0.0:1746066822.790640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.790747:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705088 00000100:00100000:2.0:1746066822.790756:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705088 00000100:00100000:2.0:1746066822.790802:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21048 00000100:00100000:2.0:1746066822.790811:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:3739:x1830882985705088:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.790833:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.790852:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85c2 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.790913:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.790922:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.790929:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.790935:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.790937:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.790941:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.790971:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.790984:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.790996:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.791721:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 9 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.791735:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 9 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.791744:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.791774:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.791781:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 9 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.791789:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218944:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.791804:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.795086:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.795144:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705216 00000100:00100000:1.0:1746066822.795152:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705216 00000100:00100000:1.0:1746066822.795196:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21049 00000100:00100000:1.0:1746066822.795201:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985705216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.795218:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066822.795220:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.795229:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.795232:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39800/0xf1867c21abfb2f0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85c9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.795236:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985218944:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.795266:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.795352:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39800/0xf1867c21abfb2f0c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c9 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.795353:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.795362:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39800/0xf1867c21abfb2f0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c9 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.795364:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6600, rc 0) 00010000:00010000:1.0:1746066822.795381:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b39800, rc 0) 00000100:00100000:1.0:1746066822.795402:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985705216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 200us (327us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.795403:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:3739:x1830882985705088:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4593us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.795409:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21048 00000100:00100000:1.0:1746066822.795413:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21049 00000100:00100000:0.0:1746066822.795858:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.796006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.796049:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705472 00000100:00100000:2.0:1746066822.796052:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705472 00000100:00100000:1.0:1746066822.796062:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705344 00000100:00100000:1.0:1746066822.796066:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705344 00010000:00010000:2.0:1746066822.796068:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.796079:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 10 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.796085:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9711 00000100:00100000:2.0:1746066822.796090:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985705472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.796099:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066822.796106:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9712 00000100:00100000:1.0:1746066822.796111:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985705344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.796118:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.796118:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.796125:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 10 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.796127:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.796135:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 10 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.796344:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfb2e25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d853d expref: 34 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.796391:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbae00/0xf1867c21abfb2ea3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8583 expref: 10 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.796401:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.796420:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985705344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 310us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.796425:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9712 00010000:00010000:2.0:1746066822.797447:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.797477:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985705472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1385us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.797484:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9711 00000100:00100000:0.0:1746066822.798963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.799009:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705728 00000100:00100000:2.0:1746066822.799017:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705728 00000100:00100000:2.0:1746066822.799060:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21050 00000100:00100000:2.0:1746066822.799067:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:3737:x1830882985705728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.799083:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.799097:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85d0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.799117:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.799119:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.799127:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.799140:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.799150:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b600, rc 0) 00000100:00100000:2.0:1746066822.799191:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:3737:x1830882985705728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 124us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.799196:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21050 00000100:00100000:0.0:1746066822.800340:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.800409:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705600 00000100:00100000:2.0:1746066822.800414:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705600 00010000:00010000:2.0:1746066822.800434:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 10 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.800469:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9713 00000100:00100000:2.0:1746066822.800475:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985705600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.800486:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.800504:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 10 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.800515:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 10 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.800539:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb2d84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e2 expref: 10 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.800551:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.800553:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.800558:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.800566:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.800596:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.800610:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985219072:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066822.801166:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.803058:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.803218:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985219072:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.803232:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985705984 00010000:00010000:2.0:1746066822.803235:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.803238:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985705984 00002000:00100000:1.0:1746066822.803286:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4124671) req@ffff8800a5962300 x1830882985705984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066822.803292:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985705600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2817us (2954us total) trans 0 rc 0/0 00002000:00100000:1.0:1746066822.803300:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962300 with x1830882985705984 ext(4120576->4124671) 00000100:00100000:2.0:1746066822.803302:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9713 00002000:00010000:1.0:1746066822.803304:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962300 00000100:00100000:1.0:1746066822.803329:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8009 00000100:00100000:1.0:1746066822.803335:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985705984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.803448:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985705984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 113us (396us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.803454:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8009 00002000:00100000:1.0:1746066822.803458:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4124671) req@ffff8800a5962300 x1830882985705984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.803464:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962300 with x1830882985705984 ext(4120576->4124671) 00002000:00010000:1.0:1746066822.803467:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962300 00000100:00100000:0.0:1746066822.803973:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.804005:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706240 00000100:00100000:3.0:1746066822.804009:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706240 00002000:00100000:3.0:1746066822.804026:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5962a00 x1830882985706240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.804033:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962a00 with x1830882985706240 ext(4194304->5074943) 00002000:00010000:3.0:1746066822.804036:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962a00 00000100:00100000:3.0:1746066822.804089:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8010 00000100:00100000:3.0:1746066822.804095:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985706240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.807303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.807382:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706368 00000100:00100000:1.0:1746066822.807392:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706368 00000100:00100000:1.0:1746066822.807509:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21051 00000100:00100000:1.0:1746066822.807519:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:3739:x1830882985706368:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066822.807540:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.807558:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85d7 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.807587:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.807595:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.807606:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.807612:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.807614:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.807617:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->3846143] (req 3145728->3846143) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.807647:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.807658:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066822.807669:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.807978:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.807986:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 7 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066822.807993:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219328:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066822.808049:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.808061:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 18 pid: 9590 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066822.808069:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.808089:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.810558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.810617:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706496 00000100:00100000:2.0:1746066822.810624:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706496 00010000:00010000:2.0:1746066822.810653:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 8 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066822.810653:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.810661:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219328:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.810668:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985219456:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.810682:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9714 00000100:00100000:2.0:1746066822.810689:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985706496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.810692:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->3846143] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.810700:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.810706:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894800, rc 0) 00010000:00010000:2.0:1746066822.810719:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 8 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.810727:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 8 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.810748:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba000/0xf1867c21abfb2eb1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d858a expref: 8 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066822.810752:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3739:x1830882985706368:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3235us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.810758:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21051 00010000:00010000:2.0:1746066822.810761:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.810774:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2014:x1830882985706496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.810780:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9714 00000100:00100000:0.0:1746066822.812221:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.812266:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.812286:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706624 00000100:00100000:2.0:1746066822.812291:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706624 00000100:00100000:1.0:1746066822.812306:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706752 00000100:00100000:1.0:1746066822.812308:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706752 00010000:00010000:2.0:1746066822.812309:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.812319:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 19 pid: 9590 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066822.812327:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9715 00000100:00100000:2.0:1746066822.812333:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985706624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066822.812338:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9716 00010000:00010000:2.0:1746066822.812340:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066822.812342:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985706752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.812346:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.812351:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.812353:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 19 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.812360:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.812466:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 19 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066822.812482:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0c00/0xf1867c21abfb2d8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84e9 expref: 19 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.812505:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb2e3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8544 expref: 28 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066822.812516:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.812517:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.812524:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.812532:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.812559:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.812571:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985219584:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.812592:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.812679:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.812714:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2014:x1830882985706752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 368us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.812721:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9716 00000100:00100000:2.0:1746066822.813216:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985706240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9116us (9279us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066822.813225:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8010 00002000:00100000:2.0:1746066822.813233:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5962a00 x1830882985706240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.813248:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962a00 with x1830882985706240 ext(4194304->5074943) 00002000:00010000:2.0:1746066822.813262:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962a00 00000100:00100000:0.0:1746066822.818065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.818140:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985219584:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066822.818161:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.818263:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985706880 00000100:00100000:1.0:1746066822.818273:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985706880 00000100:00100000:1.0:1746066822.818310:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21052 00000100:00100000:1.0:1746066822.818316:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985706880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066822.818331:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066822.818345:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575ba00/0xf1867c21abfb2f21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85de expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.818374:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575ba00/0xf1867c21abfb2f21 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85de expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.818383:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575ba00/0xf1867c21abfb2f21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85de expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.818394:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ba00, rc 0) 00000100:00100000:2.0:1746066822.818401:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985706624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6067us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.818410:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9715 00000100:00100000:1.0:1746066822.818413:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985706880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (360us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066822.818417:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21052 00000100:00100000:2.0:1746066822.818982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.819028:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985707136 00000100:00100000:0.0:1746066822.819032:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985707136 00002000:00100000:0.0:1746066822.819058:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3842048->3846143) req@ffff88011d857800 x1830882985707136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.819067:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857800 with x1830882985707136 ext(3842048->3846143) 00002000:00010000:0.0:1746066822.819071:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d857800 00000100:00100000:0.0:1746066822.819476:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8011 00000100:00100000:0.0:1746066822.819483:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985707136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.819609:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985707136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 126us (626us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066822.819618:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8011 00002000:00100000:0.0:1746066822.819623:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3842048->3846143) req@ffff88011d857800 x1830882985707136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.819629:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d857800 with x1830882985707136 ext(3842048->3846143) 00002000:00010000:0.0:1746066822.819632:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d857800 00000100:00100000:0.0:1746066822.820379:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.820523:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985707264 00000100:00100000:2.0:1746066822.820528:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985707264 00000100:00100000:2.0:1746066822.820562:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21053 00000100:00100000:2.0:1746066822.820568:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985707264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.820578:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.820593:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f7200/0xf1867c21abfb2f28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85e5 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.820614:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7200/0xf1867c21abfb2f28 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85e5 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.820623:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7200/0xf1867c21abfb2f28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85e5 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.820635:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7200, rc 0) 00000100:00100000:2.0:1746066822.820668:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985707264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 100us (289us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.820676:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21053 00000100:00100000:0.0:1746066822.823630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.823722:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985707520 00000100:00100000:1.0:1746066822.823730:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985707520 00000100:00100000:1.0:1746066822.823790:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6588 00000100:00100000:1.0:1746066822.823873:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:3739:x1830882985707520:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066822.824117:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:3739:x1830882985707520:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 320us (497us total) trans 8589937911 rc 0/0 00000100:00100000:1.0:1746066822.824124:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6588 00000100:00100000:0.0:1746066822.848525:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.848628:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985707776 00000100:00100000:2.0:1746066822.848637:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985707776 00000100:00100000:2.0:1746066822.848801:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17396 00000100:00100000:2.0:1746066822.848809:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3748:x1830882985707776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.848830:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.848849:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb2f2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85ec expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.848939:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.848999:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849010:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849025:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849030:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849035:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849113:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849119:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849123:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066822.849129:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066822.849174:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849177:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849180:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849184:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849187:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f6400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.849189:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849193:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849198:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066822.849200:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.849202:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849204:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6400/0xf1867c21abfb2f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849223:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849234:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849238:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849242:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801310f7400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066822.849244:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849249:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849266:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ea20800) 00010000:00010000:2.0:1746066822.849268:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066822.849270:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849274:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7400/0xf1867c21abfb2f3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.849305:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6c00/0xf1867c21abfb2f2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.849314:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.849320:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.849322:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066822.849324:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6200, rc 0) 00000100:00100000:2.0:1746066822.849366:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3748:x1830882985707776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 558us (849us total) trans 8589937912 rc 0/0 00000100:00100000:2.0:1746066822.849372:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17396 00000100:00100000:0.0:1746066822.851044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.851143:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985708032 00000100:00100000:1.0:1746066822.851152:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985708032 00000100:00100000:1.0:1746066822.851203:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6589 00000100:00100000:1.0:1746066822.851211:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3748:x1830882985708032:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066822.851415:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3748:x1830882985708032:12345-192.168.204.16@tcp:35:cat.0 Request processed in 205us (378us total) trans 8589937913 rc 0/0 00000100:00100000:1.0:1746066822.851422:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6589 00000100:00100000:0.0:1746066822.855645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.855683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.855721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.855740:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985708160 00000100:00100000:1.0:1746066822.855750:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985708160 00000100:00100000:2.0:1746066822.855772:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985708288 00000100:00100000:2.0:1746066822.855782:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985708288 00000100:00100000:2.0:1746066822.855838:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985708416 00000100:00100000:2.0:1746066822.855840:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985708416 00000100:00100000:1.0:1746066822.855849:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21054 00000100:00100000:1.0:1746066822.855858:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985708288:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066822.855862:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21055 00000100:00100000:3.0:1746066822.855872:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985708160:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066822.855873:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21056 00010000:00010000:1.0:1746066822.855876:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.855898:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066822.855907:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985708416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.855911:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85f3 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.855911:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb2f52 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d85fa expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.855924:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.855935:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.855939:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c200/0xf1867c21abfb2f60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8601 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.855942:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb2f52 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85fa expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.855946:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.855953:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb2f52 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85fa expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.855955:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066822.855965:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575aa00, rc 0) 00010000:00010000:3.0:1746066822.855974:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.855983:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0600, rc 0) 00000100:00100000:2.0:1746066822.856168:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985219712:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066822.856439:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985708288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 581us (754us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066822.856446:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21054 00000100:00100000:3.0:1746066822.856820:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985708160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 949us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.856825:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21055 00000100:00100000:2.0:1746066822.856945:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.858173:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985219712:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066822.858199:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c200/0xf1867c21abfb2f60 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8601 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.858211:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c200/0xf1867c21abfb2f60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8601 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.858221:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c200, rc 0) 00000100:00100000:2.0:1746066822.858248:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2014:x1830882985708416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2368us (2526us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.858265:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21056 00000100:00100000:0.0:1746066822.871872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.871952:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.872615:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985708672 00000100:00100000:1.0:1746066822.872617:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709056 00000100:00100000:2.0:1746066822.872625:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985708672 00000100:00100000:1.0:1746066822.872628:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709056 00002000:00100000:2.0:1746066822.872672:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009666d500 x1830882985708672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.872673:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009666df80 x1830882985709056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.872681:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d500 with x1830882985708672 ext(0->1048575) 00002000:00100000:1.0:1746066822.872683:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666df80 with x1830882985709056 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.872686:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666d500 00002000:00010000:1.0:1746066822.872688:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666df80 00000100:00100000:0.0:1746066822.872727:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.873198:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709184 00000100:00100000:2.0:1746066822.873201:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709184 00000100:00100000:1.0:1746066822.873206:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8012 00000100:00100000:1.0:1746066822.873214:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2016:x1830882985708672:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066822.873218:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89fb80 x1830882985709184/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.873225:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89fb80 with x1830882985709184 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.873229:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89fb80 00000100:00100000:2.0:1746066822.873257:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8013 00000100:00100000:2.0:1746066822.873264:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985709056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.873283:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8014 00000100:00100000:1.0:1746066822.873289:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985709184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.874016:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.874036:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709312 00000100:00100000:0.0:1746066822.874039:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709312 00002000:00100000:0.0:1746066822.874056:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89d880 x1830882985709312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.874064:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985709312 ext(1048576->2097151) 00002000:00010000:0.0:1746066822.874068:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:0.0:1746066822.874085:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8015 00000100:00100000:0.0:1746066822.874090:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985709312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066822.885265:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985709184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11959us (12663us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066822.885277:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8014 00002000:00100000:1.0:1746066822.885287:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009d89fb80 x1830882985709184/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.885302:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89fb80 with x1830882985709184 ext(1048576->2097151) 00002000:00010000:1.0:1746066822.885307:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89fb80 00000100:00100000:1.0:1746066822.887695:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985708672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14474us (15828us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066822.887705:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8012 00002000:00100000:1.0:1746066822.887715:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff88009666d500 x1830882985708672/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.887722:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d500 with x1830882985708672 ext(0->1048575) 00002000:00010000:1.0:1746066822.887726:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666d500 00000100:00100000:0.0:1746066822.889280:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985709312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15185us (15261us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066822.889287:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8015 00002000:00100000:0.0:1746066822.889294:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009d89d880 x1830882985709312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.889302:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985709312 ext(1048576->2097151) 00002000:00010000:0.0:1746066822.889306:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:2.0:1746066822.891000:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985709056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17732us (19043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.891008:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8013 00002000:00100000:2.0:1746066822.891015:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009666df80 x1830882985709056/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.891023:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666df80 with x1830882985709056 ext(1048576->2097151) 00002000:00010000:2.0:1746066822.891026:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666df80 00000100:00100000:0.0:1746066822.900120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.900172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.900217:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709568 00000100:00100000:2.0:1746066822.900228:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709568 00000100:00100000:3.0:1746066822.900234:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709696 00000100:00100000:3.0:1746066822.900242:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709696 00000100:00100000:2.0:1746066822.900317:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21057 00000100:00100000:3.0:1746066822.900325:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21058 00000100:00100000:2.0:1746066822.900326:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985709568:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066822.900332:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985709696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.900342:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.900345:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.900360:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfb2f6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d860f expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.900360:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2f67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8608 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.900394:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2f67 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8608 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.900404:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfb2f67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8608 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066822.900417:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985219840:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066822.900430:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2de00, rc 0) 00000100:00100000:3.0:1746066822.900502:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.900557:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2016:x1830882985709568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 232us (449us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.900563:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21057 00000100:00100000:3.0:1746066822.902982:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985219840:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066822.903018:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfb2f6e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d860f expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.903029:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfb2f6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d860f expref: 20 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066822.903060:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0200, rc 0) 00000100:00100000:3.0:1746066822.903103:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985709696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2772us (2930us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066822.903111:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21058 00000100:00100000:0.0:1746066822.906235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.906665:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985709824 00000100:00100000:3.0:1746066822.906676:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985709824 00000100:00100000:3.0:1746066822.906734:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21059 00000100:00100000:3.0:1746066822.906742:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3748:x1830882985709824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.906761:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.906779:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8616 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.906807:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.906808:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066822.906816:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.906830:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.906841:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0400, rc 0) 00000100:00100000:3.0:1746066822.906931:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3748:x1830882985709824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 189us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.906938:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21059 00000100:00100000:0.0:1746066822.909941:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.909997:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710080 00000100:00100000:2.0:1746066822.910006:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710080 00002000:00100000:2.0:1746066822.910044:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5884700 x1830882985710080/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.910057:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884700 with x1830882985710080 ext(2097152->3145727) 00002000:00010000:2.0:1746066822.910061:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884700 00000100:00100000:2.0:1746066822.910089:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8016 00000100:00100000:2.0:1746066822.910095:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985710080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066822.916968:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985710080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6865us (7085us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.916978:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8016 00002000:00100000:2.0:1746066822.916988:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5884700 x1830882985710080/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.917002:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884700 with x1830882985710080 ext(2097152->3145727) 00002000:00010000:2.0:1746066822.917008:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884700 00000100:00100000:0.0:1746066822.921107:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.921228:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710208 00000100:00100000:3.0:1746066822.921236:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710208 00000100:00100000:3.0:1746066822.921300:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21060 00000100:00100000:3.0:1746066822.921308:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3748:x1830882985710208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.921322:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.921335:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d861d expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.921357:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.921363:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.921364:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.921368:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.921391:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.921403:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 26 pid: 9590 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066822.921414:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985219968:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.921493:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.922784:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985219968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.922802:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.922813:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0800, rc 0) 00000100:00100000:3.0:1746066822.922845:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3748:x1830882985710208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1538us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.922851:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21060 00000100:00100000:0.0:1746066822.923397:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.923469:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710336 00000100:00100000:2.0:1746066822.923474:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710336 00002000:00100000:2.0:1746066822.923503:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3846143) req@ffff8800a5885f80 x1830882985710336/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.923511:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885f80 with x1830882985710336 ext(3145728->3846143) 00010000:00010000:2.0:1746066822.923516:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 27 pid: 9590 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.923528:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 27 pid: 9590 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066822.923533:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5885f80 00000100:00100000:2.0:1746066822.923545:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2286 00000100:00100000:2.0:1746066822.923550:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985710336:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066822.931705:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985710336:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8146us (8300us total) trans 21474842851 rc 0/0 00000100:00100000:2.0:1746066822.931715:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2286 00002000:00100000:2.0:1746066822.931724:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->3846143) req@ffff8800a5885f80 x1830882985710336/t21474842851(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.931732:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885f80 with x1830882985710336 ext(3145728->3846143) 00010000:00010000:2.0:1746066822.931741:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.931758:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066822.931765:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5885f80 00000100:00100000:0.0:1746066822.932573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.932640:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710592 00000100:00100000:2.0:1746066822.932647:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710592 00000100:00100000:2.0:1746066822.932693:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17397 00000100:00100000:2.0:1746066822.932699:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3751:x1830882985710592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066822.932716:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.932730:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb2f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8624 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.932813:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.932825:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.932832:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 15 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.932836:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.932859:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 15 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.932869:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 15 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.932879:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985220096:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.932978:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.932985:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 8 pid: 7245 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.932992:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985220224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.933010:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.933858:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985220096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.934392:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.934440:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.934468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.934482:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985220224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066822.934542:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710720 00000100:00100000:1.0:1746066822.934546:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710720 00010000:00010000:1.0:1746066822.934569:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066822.934587:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710848 00000100:00100000:1.0:1746066822.934590:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710848 00010000:00010000:1.0:1746066822.934598:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 16 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.934602:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985710976 00000100:00100000:2.0:1746066822.934606:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985710976 00000100:00100000:1.0:1746066822.934611:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9717 00000100:00100000:1.0:1746066822.934617:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985710720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.934619:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 9 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.934627:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066822.934641:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9718 00010000:00010000:1.0:1746066822.934642:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.934652:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985710848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.934655:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934659:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.934663:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 16 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934670:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 16 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.934671:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfb2f1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3846143) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d7 expref: 29 pid: 9590 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934682:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f6200/0xf1867c21abfb2f44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ec expref: 16 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.934688:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.934689:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.934695:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066822.934695:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.934699:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.934705:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.934709:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066822.934721:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066822.934731:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985710848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.934737:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9718 00000100:00100000:2.0:1746066822.934751:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9719 00000100:00100000:2.0:1746066822.934756:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985710976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066822.934761:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.934764:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 9 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934772:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 9 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934781:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfb2ee2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85a6 expref: 9 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.934788:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066822.934791:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.934796:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.934801:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066822.934813:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066822.934819:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.934824:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066822.934829:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985710976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.934834:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9719 00000004:00200000:3.0:1746066822.934837:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066822.935349:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.935373:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.935383:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985220352:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.935437:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066822.935510:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb2f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.935525:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 15 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.935531:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.935534:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066822.935536:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2ca00, rc 0) 00000100:00100000:3.0:1746066822.935559:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3751:x1830882985710592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2860us (2987us total) trans 8589937914 rc 0/0 00000100:00100000:3.0:1746066822.935565:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17397 00000100:00100000:1.0:1746066822.938003:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985220352:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.938018:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066822.938057:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985710720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3439us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.938065:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9717 00000100:00100000:0.0:1746066822.939803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.939875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.939962:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985711360 00000100:00100000:2.0:1746066822.939969:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985711360 00000100:00100000:3.0:1746066822.939973:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985711104 00000100:00100000:3.0:1746066822.939977:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985711104 00002000:00100000:2.0:1746066822.940004:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88011f712680 x1830882985711360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066822.940011:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21061 00002000:00100000:2.0:1746066822.940013:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712680 with x1830882985711360 ext(2097152->3145727) 00000100:00100000:3.0:1746066822.940017:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3751:x1830882985711104:12345-192.168.204.16@tcp:101:multiop.0 00002000:00010000:2.0:1746066822.940018:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712680 00010000:00010000:3.0:1746066822.940030:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.940043:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d862b expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.940050:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8017 00000100:00100000:2.0:1746066822.940055:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985711360:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746066822.940065:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.940072:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.940073:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.940076:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->2670591] (req 2654208->2670591) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.940097:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.940108:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066822.940117:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985220480:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066822.940174:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066822.941540:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985220480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.941557:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->2670591] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 11 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.941565:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0000, rc 0) 00000100:00100000:2.0:1746066822.941583:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3751:x1830882985711104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1567us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.941587:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21061 00000100:00100000:2.0:1746066822.943939:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.943966:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.943989:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985711488 00000100:00100000:1.0:1746066822.943997:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985711488 00010000:00010000:1.0:1746066822.944024:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066822.944051:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9720 00000100:00100000:1.0:1746066822.944058:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985711488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.944070:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066822.944087:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.944097:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066822.944100:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985711744 00000100:00100000:3.0:1746066822.944104:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985711744 00010000:00010000:1.0:1746066822.944114:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0400/0xf1867c21abfb2f75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8616 expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.944128:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.944129:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066822.944135:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.944142:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066822.944145:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17398 00010000:00010000:1.0:1746066822.944164:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 10 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066822.944176:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985220608:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.944232:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066822.944325:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:3754:x1830882985711744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.944340:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.944352:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2f9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8632 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.944407:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944653:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944662:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944672:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944677:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944681:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944753:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944759:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944763:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066822.944770:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066822.944824:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944829:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944837:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944842:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944846:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f6a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.944849:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944854:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944860:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066822.944862:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.944865:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944870:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6a00/0xf1867c21abfb2fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944909:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944915:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944919:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944923:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f6000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066822.944925:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944933:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944939:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb500) 00010000:00010000:3.0:1746066822.944940:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066822.944942:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944946:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f6000/0xf1867c21abfb2fad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066822.944976:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7200/0xf1867c21abfb2f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.944984:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.944990:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066822.944992:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066822.944994:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7800, rc 0) 00000100:00100000:3.0:1746066822.945024:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:3754:x1830882985711744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 874us (1058us total) trans 8589937915 rc 0/0 00000100:00100000:3.0:1746066822.945030:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17398 00000100:00100000:1.0:1746066822.947032:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882985220608:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066822.947049:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066822.947049:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.947077:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2014:x1830882985711488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3019us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.947085:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9720 00000100:00100000:1.0:1746066822.947112:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985712000 00000100:00100000:1.0:1746066822.947116:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985712000 00002000:00100000:1.0:1746066822.947139:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2658303) req@ffff88011f710a80 x1830882985712000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.947147:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710a80 with x1830882985712000 ext(2654208->2658303) 00002000:00010000:1.0:1746066822.947151:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710a80 00000100:00100000:1.0:1746066822.947165:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8018 00000100:00100000:1.0:1746066822.947170:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985712000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066822.947279:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985712000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 108us (229us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066822.947285:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8018 00002000:00100000:1.0:1746066822.947290:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2658303) req@ffff88011f710a80 x1830882985712000/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.947297:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710a80 with x1830882985712000 ext(2654208->2658303) 00002000:00010000:1.0:1746066822.947299:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710a80 00000100:00100000:2.0:1746066822.947422:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2014:x1830882985711360:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7365us (7546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066822.947429:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8017 00002000:00100000:2.0:1746066822.947433:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff88011f712680 x1830882985711360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.947439:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712680 with x1830882985711360 ext(2097152->3145727) 00002000:00010000:2.0:1746066822.947442:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712680 00000100:00100000:0.0:1746066822.948061:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.948146:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985712256 00000100:00100000:2.0:1746066822.948149:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985712256 00000100:00100000:2.0:1746066822.948223:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6590 00000100:00100000:2.0:1746066822.948229:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3754:x1830882985712256:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066822.948603:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:3754:x1830882985712256:12345-192.168.204.16@tcp:35:cat.0 Request processed in 373us (541us total) trans 8589937916 rc 0/0 00000100:00100000:2.0:1746066822.948609:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6590 00000100:00100000:0.0:1746066822.951581:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.951621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.951653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.951680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.951815:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985712640 00000100:00100000:2.0:1746066822.951822:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985712640 00000100:00100000:2.0:1746066822.951851:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985712768 00000100:00100000:2.0:1746066822.951853:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985712768 00000100:00100000:2.0:1746066822.951874:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21062 00000100:00100000:2.0:1746066822.951880:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985712640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.951914:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.951931:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb2fc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8639 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.951956:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb2fc2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8639 expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.951970:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb2fc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8639 expref: 35 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.951978:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c200, rc 0) 00000100:00100000:2.0:1746066822.952012:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985712640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 132us (391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066822.952018:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21062 00000100:00100000:2.0:1746066822.952031:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21063 00000100:00100000:2.0:1746066822.952035:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985712768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.952042:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.952050:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8640 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.952063:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.952064:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.952070:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.952081:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066822.952096:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:2.0:1746066822.952111:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985712768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.952116:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21063 00000100:00100000:2.0:1746066822.952521:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985712512 00000100:00100000:2.0:1746066822.952525:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985712512 00002000:00100000:2.0:1746066822.952545:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2666496->2670591) req@ffff88011f710380 x1830882985712512/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746066822.952545:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713024 00000100:00100000:1.0:1746066822.952550:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713024 00002000:00100000:2.0:1746066822.952552:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985712512 ext(2666496->2670591) 00002000:00010000:2.0:1746066822.952555:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710380 00002000:00100000:1.0:1746066822.952566:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4112383) req@ffff88011f713100 x1830882985713024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066822.952572:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8019 00000100:00100000:2.0:1746066822.952577:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985712512:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:1.0:1746066822.952579:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713100 with x1830882985713024 ext(3145728->4112383) 00002000:00010000:1.0:1746066822.952582:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f713100 00000100:00100000:1.0:1746066822.952599:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8020 00000100:00100000:1.0:1746066822.952604:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985713024:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.952654:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2016:x1830882985712512:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 77us (1080us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066822.952659:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8019 00002000:00100000:2.0:1746066822.952663:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2666496->2670591) req@ffff88011f710380 x1830882985712512/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066822.952670:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985712512 ext(2666496->2670591) 00002000:00010000:2.0:1746066822.952672:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f710380 00000100:00100000:3.0:1746066822.956072:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.956202:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713152 00000100:00100000:2.0:1746066822.956211:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713152 00000100:00100000:2.0:1746066822.956246:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21064 00000100:00100000:2.0:1746066822.956266:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3748:x1830882985713152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066822.956279:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066822.956295:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8647 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956318:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956330:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956335:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066822.956336:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066822.956339:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956362:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956372:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.956381:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985220736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066822.956465:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.956472:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066822.956479:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985220864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066822.956739:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066822.959626:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2014:x1830882985713024:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7013us (7937us total) trans 0 rc 966656/966656 00000100:00100000:1.0:1746066822.959637:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8020 00002000:00100000:1.0:1746066822.959647:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4112383) req@ffff88011f713100 x1830882985713024/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 966656/966656 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.959657:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713100 with x1830882985713024 ext(3145728->4112383) 00010000:00010000:1.0:1746066822.959665:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 12 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.959677:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 12 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066822.959684:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f713100 00000100:00100000:3.0:1746066822.959707:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985220736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066822.961502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.962258:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.962540:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985220864:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066822.962567:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.962586:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2cc00, rc 0) 00000100:00100000:3.0:1746066822.962621:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3748:x1830882985713152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6356us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.962628:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21064 00000100:00100000:3.0:1746066822.962725:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713408 00000100:00100000:3.0:1746066822.962731:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713408 00000100:00100000:1.0:1746066822.962746:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713280 00000100:00100000:1.0:1746066822.962751:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713280 00002000:00100000:3.0:1746066822.962759:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2670591) req@ffff88009ea81c50 x1830882985713408/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 16872/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066822.962766:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea81c50 with x1830882985713408 ext(2654208->2670591) 00002000:00100000:1.0:1746066822.962769:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4194303) req@ffff88011d855500 x1830882985713280/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066822.962772:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00002000:00100000:1.0:1746066822.962777:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855500 with x1830882985713280 ext(4120576->4194303) 00010000:00010000:3.0:1746066822.962780:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 11 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.962783:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 34 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746066822.962786:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea81c50 00010000:00010000:1.0:1746066822.962800:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 34 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066822.962805:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011d855500 00000100:00100000:3.0:1746066822.962813:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2287 00000100:00100000:3.0:1746066822.962819:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:2014:x1830882985713408:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066822.962995:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2288 00000100:00100000:1.0:1746066822.963001:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985713280:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066822.964662:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985713408:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1839us (3160us total) trans 17179875508 rc 0/0 00000100:00100000:0.0:1746066822.964670:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2287 00002000:00100000:0.0:1746066822.964676:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2670591) req@ffff88009ea81c50 x1830882985713408/t17179875508(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 16872/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.964684:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea81c50 with x1830882985713408 ext(2654208->2670591) 00010000:00010000:0.0:1746066822.964690:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066822.964703:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746066822.964708:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea81c50 00000100:00100000:2.0:1746066822.965443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066822.965469:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713536 00000100:00100000:3.0:1746066822.965474:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713536 00000100:00100000:3.0:1746066822.965500:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21065 00000100:00100000:3.0:1746066822.965505:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:3754:x1830882985713536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066822.965516:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066822.965529:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d864e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.965548:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.965551:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066822.965554:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 37 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.965563:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 37 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066822.965571:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bda00, rc 0) 00000100:00100000:3.0:1746066822.965591:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:3754:x1830882985713536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 85us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066822.965595:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21065 00000100:00100000:1.0:1746066822.968845:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985713280:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5836us (6590us total) trans 17179875509 rc 0/0 00000100:00100000:1.0:1746066822.968855:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2288 00002000:00100000:1.0:1746066822.968865:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4120576->4194303) req@ffff88011d855500 x1830882985713280/t17179875509(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/448 e 0 to 0 dl 1746066833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.968874:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d855500 with x1830882985713280 ext(4120576->4194303) 00010000:00010000:1.0:1746066822.969146:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.969159:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066822.969167:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011d855500 00000100:00100000:0.0:1746066822.973753:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.973803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066822.974098:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713664 00000100:00100000:1.0:1746066822.974105:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985713792 00000100:00100000:2.0:1746066822.974108:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713664 00000100:00100000:1.0:1746066822.974108:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985713792 00010000:00010000:2.0:1746066822.974140:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.974140:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066822.974164:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9721 00000100:00100000:1.0:1746066822.974170:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2015:x1830882985713792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066822.974177:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9722 00000100:00100000:2.0:1746066822.974181:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882985713664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066822.974181:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.974186:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066822.974195:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.974195:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.974204:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.974270:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.974289:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6600/0xf1867c21abfb2f05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 8 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85c2 expref: 37 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066822.974292:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0000/0xf1867c21abfb2f98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [2654208->4112383] (req 2654208->2670591) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d862b expref: 13 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066822.974313:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.974315:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.974321:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 12 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.974328:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 12 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.974335:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.974336:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066822.974339:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066822.974345:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066822.974354:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066822.974369:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.974378:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985220992:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066822.974387:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985713792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 217us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066822.974392:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9721 00010000:00010000:2.0:1746066822.974427:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066822.974435:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985221120:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066822.974451:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066822.980991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.981065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.981148:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985714176 00000100:00100000:1.0:1746066822.981156:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985714176 00002000:00100000:1.0:1746066822.981195:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f711180 x1830882985714176/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.981204:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711180 with x1830882985714176 ext(3145728->4194303) 00002000:00010000:1.0:1746066822.981208:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711180 00000100:00100000:1.0:1746066822.981236:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985714304 00000100:00100000:1.0:1746066822.981239:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985714304 00002000:00100000:1.0:1746066822.981261:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011f712a00 x1830882985714304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.981267:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712a00 with x1830882985714304 ext(3145728->4194303) 00002000:00010000:1.0:1746066822.981271:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712a00 00000100:00100000:1.0:1746066822.981283:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8021 00000100:00100000:1.0:1746066822.981289:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985714176:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066822.981329:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8022 00000100:00100000:3.0:1746066822.981337:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985714304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066822.982730:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985220992:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066822.982742:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985221120:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066822.982756:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066822.982782:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985713664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8600us (9037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066822.982790:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9722 00000100:00100000:0.0:1746066822.990556:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066822.990592:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066822.990624:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985714816 00000100:00100000:1.0:1746066822.990643:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985714816 00002000:00100000:1.0:1746066822.990679:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f713b80 x1830882985714816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.990689:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713b80 with x1830882985714816 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.990694:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713b80 00000100:00100000:1.0:1746066822.990719:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985714688 00000100:00100000:1.0:1746066822.990721:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985714688 00002000:00100000:1.0:1746066822.990732:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88011f711f80 x1830882985714688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/0 e 0 to 0 dl 1746066833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066822.990739:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711f80 with x1830882985714688 ext(2097152->4194303) 00002000:00010000:1.0:1746066822.990742:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711f80 00000100:00100000:1.0:1746066822.990752:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8023 00000100:00100000:1.0:1746066822.990758:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985714816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066822.990918:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8024 00000100:00100000:3.0:1746066822.990926:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985714688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066822.990940:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985714176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9650us (9956us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066822.990947:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8021 00002000:00100000:0.0:1746066822.990953:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88011f711180 x1830882985714176/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.990961:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711180 with x1830882985714176 ext(3145728->4194303) 00002000:00010000:0.0:1746066822.990964:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711180 00000100:00100000:0.0:1746066822.991065:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985714304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9729us (9999us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066822.991071:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8022 00002000:00100000:0.0:1746066822.991075:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88011f712a00 x1830882985714304/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066822.991082:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f712a00 with x1830882985714304 ext(3145728->4194303) 00002000:00010000:0.0:1746066822.991085:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f712a00 00000100:00100000:0.0:1746066823.006196:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.007342:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715072 00000100:00100000:2.0:1746066823.007351:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715072 00002000:00100000:2.0:1746066823.007387:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88011f711c00 x1830882985715072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.007396:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711c00 with x1830882985715072 ext(4194304->5074943) 00002000:00010000:2.0:1746066823.007402:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711c00 00000100:00100000:2.0:1746066823.007420:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8025 00000100:00100000:2.0:1746066823.007426:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985715072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066823.007545:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985714816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16786us (16995us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066823.007551:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8023 00002000:00100000:0.0:1746066823.007556:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88011f713b80 x1830882985714816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.007563:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713b80 with x1830882985714816 ext(2097152->4194303) 00002000:00010000:0.0:1746066823.007566:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713b80 00000100:00100000:3.0:1746066823.013310:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985714688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22376us (22707us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066823.013321:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8024 00002000:00100000:3.0:1746066823.013330:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88011f711f80 x1830882985714688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:228/0 lens 488/440 e 0 to 0 dl 1746066833 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.013339:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711f80 with x1830882985714688 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.013344:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711f80 00000100:00100000:2.0:1746066823.014072:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985715072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6644us (7883us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066823.014079:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8025 00002000:00100000:2.0:1746066823.014084:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88011f711c00 x1830882985715072/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.014091:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f711c00 with x1830882985715072 ext(4194304->5074943) 00002000:00010000:2.0:1746066823.014095:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f711c00 00000100:00100000:0.0:1746066823.039037:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.039118:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715328 00000100:00100000:3.0:1746066823.039126:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715328 00000100:00080000:0.0:1746066823.039166:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066823.039190:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17399 00000100:00100000:3.0:1746066823.039197:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:3759:x1830882985715328:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.039216:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.039230:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb2fde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8655 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.039302:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039313:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039322:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039332:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039337:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039342:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039421:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2ff3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039429:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039434:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.039441:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.039523:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039528:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039533:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039539:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039544:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.039547:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039552:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039561:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.039563:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.039566:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039571:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb2fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039599:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039605:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039613:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039616:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7cc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.039618:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039622:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039628:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb000) 00010000:00010000:3.0:1746066823.039630:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.039632:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039636:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb2fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.039664:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb2fde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8655 expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.039673:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8655 expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.039679:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.039681:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.039682:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7ce00, rc 0) 00000100:00100000:3.0:1746066823.039735:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:3759:x1830882985715328:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 538us (704us total) trans 8589937917 rc 0/0 00000100:00100000:3.0:1746066823.039741:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17399 00000100:00100000:0.0:1746066823.041425:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.041470:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715456 00000100:00100000:2.0:1746066823.041476:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715456 00000100:00100000:2.0:1746066823.041519:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 964 00000100:00100000:2.0:1746066823.041524:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985715456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.041533:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.041545:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb2ff3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8655 expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.041572:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.041575:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.041612:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985715456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.041617:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 964 00000100:00100000:0.0:1746066823.041809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.041832:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715584 00000100:00100000:2.0:1746066823.041835:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715584 00000100:00080000:0.0:1746066823.041854:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066823.041870:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21066 00000100:00100000:2.0:1746066823.041875:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:3759:x1830882985715584:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.041910:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.041921:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d865c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.041938:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.041945:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.041951:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.041957:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.041958:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.041961:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1265664->1323007] (req 1265664->1323007) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.041979:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.041986:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.041994:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.042058:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 6 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.042065:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 6 pid: 1893 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.042073:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.042098:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.042105:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 19 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.042112:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.042127:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.042826:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.042838:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221376:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.043137:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.043171:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715712 00000100:00100000:2.0:1746066823.043175:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715712 00010000:00010000:2.0:1746066823.043200:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.043217:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9723 00000100:00100000:2.0:1746066823.043223:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985715712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.043229:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.043243:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.043261:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.043272:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb2e9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d856e expref: 7 pid: 1893 timeout: 891 lvb_type: 1 00000100:00080000:1.0:1746066823.043272:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746066823.043280:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.043301:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985221504:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.043306:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985715712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.043311:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9723 00010000:00010000:3.0:1746066823.043322:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1265664->1323007] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.043332:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76c00, rc 0) 00000100:00100000:3.0:1746066823.043354:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:3759:x1830882985715584:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1479us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.043359:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21066 00000100:00100000:0.0:1746066823.044424:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.044455:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715840 00000100:00100000:2.0:1746066823.044458:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715840 00010000:00010000:2.0:1746066823.044469:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.044485:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9724 00000100:00100000:2.0:1746066823.044488:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985715840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.044493:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.044498:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044503:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044514:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfb2e2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8528 expref: 30 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044521:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.044543:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985715840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.044548:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9724 00000100:00100000:0.0:1746066823.044855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.044904:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985715968 00000100:00100000:2.0:1746066823.044907:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985715968 00010000:00010000:2.0:1746066823.044918:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 20 pid: 12237 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.044930:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9725 00000100:00100000:2.0:1746066823.044934:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985715968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.044940:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.044945:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 20 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044953:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 20 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044962:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e363600/0xf1867c21abfb2d76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84cd expref: 20 pid: 12237 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.044969:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.044970:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.044974:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.044980:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.044999:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.045006:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985221632:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.045046:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.046035:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985221632:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.046044:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.046071:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985715968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1135us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.046077:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9725 00000100:00100000:0.0:1746066823.046209:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.046300:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985716224 00000100:00100000:3.0:1746066823.046304:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985716224 00002000:00100000:3.0:1746066823.046327:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1269759) req@ffff88011f710380 x1830882985716224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.046336:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985716224 ext(1265664->1269759) 00002000:00010000:3.0:1746066823.046339:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f710380 00000100:00100000:3.0:1746066823.046357:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8026 00000100:00100000:3.0:1746066823.046362:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985716224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.046593:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985716224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 230us (384us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.046599:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8026 00002000:00100000:3.0:1746066823.046604:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1269759) req@ffff88011f710380 x1830882985716224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.046609:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f710380 with x1830882985716224 ext(1265664->1269759) 00002000:00010000:3.0:1746066823.046612:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f710380 00000100:00100000:0.0:1746066823.048235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.048281:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985716480 00000100:00100000:3.0:1746066823.048288:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985716480 00002000:00100000:3.0:1746066823.048308:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1318912->1323007) req@ffff88011f713100 x1830882985716480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.048316:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713100 with x1830882985716480 ext(1318912->1323007) 00002000:00010000:3.0:1746066823.048320:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713100 00000100:00100000:3.0:1746066823.048339:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8027 00000100:00100000:3.0:1746066823.048344:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985716480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.048423:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985716480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 78us (194us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.048429:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8027 00002000:00100000:3.0:1746066823.048434:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1318912->1323007) req@ffff88011f713100 x1830882985716480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.048441:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f713100 with x1830882985716480 ext(1318912->1323007) 00002000:00010000:3.0:1746066823.048444:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f713100 00000100:00100000:0.0:1746066823.050371:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.050548:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985716736 00000100:00100000:2.0:1746066823.050553:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985716736 00000100:00100000:2.0:1746066823.050610:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6591 00000100:00100000:2.0:1746066823.050614:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3759:x1830882985716736:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066823.050827:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3759:x1830882985716736:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 211us (482us total) trans 8589937918 rc 0/0 00000100:00100000:2.0:1746066823.050833:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6591 00000100:00100000:0.0:1746066823.073816:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.073923:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985716992 00000100:00100000:3.0:1746066823.073935:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985716992 00000100:00100000:3.0:1746066823.074031:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17400 00000100:00100000:3.0:1746066823.074043:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3762:x1830882985716992:12345-192.168.204.16@tcp:101:multiop.0 00000100:00080000:1.0:1746066823.074043:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746066823.074061:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.074079:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8663 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.074137:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074148:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074156:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074166:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074170:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074174:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074264:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074271:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074276:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.074284:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.074336:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074341:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074345:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074349:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074354:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.074358:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074364:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074372:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.074375:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.074378:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074383:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb300f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074407:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074411:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074415:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074419:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.074421:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074425:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074429:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb000) 00010000:00010000:3.0:1746066823.074431:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.074432:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074440:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3016 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.074467:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.074476:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.074482:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.074483:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.074485:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d200, rc 0) 00000100:00100000:3.0:1746066823.074544:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3762:x1830882985716992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 505us (738us total) trans 8589937919 rc 0/0 00000100:00100000:3.0:1746066823.074550:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17400 00000100:00100000:0.0:1746066823.076606:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.077006:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985717248 00000100:00100000:1.0:1746066823.077014:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985717248 00000100:00100000:1.0:1746066823.077057:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6592 00000100:00100000:1.0:1746066823.077064:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3762:x1830882985717248:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066823.078753:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3762:x1830882985717248:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1682us (2144us total) trans 8589937920 rc 0/0 00000100:00100000:1.0:1746066823.078765:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6592 00000100:00100000:0.0:1746066823.092528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.092614:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985717376 00000100:00100000:3.0:1746066823.092626:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985717376 00000100:00100000:3.0:1746066823.092695:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21067 00000100:00100000:3.0:1746066823.092703:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3762:x1830882985717376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.092723:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.092741:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d866a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.092771:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.092780:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.092790:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.092796:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.092799:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.092802:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [1019904->1048575] (req 1019904->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.092835:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.092847:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 35 pid: 3528 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.092860:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985221760:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.093008:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 8 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.093017:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 8 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.093026:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985221888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.093060:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.093074:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.093082:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985222016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.093424:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.096157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.096332:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985221760:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.096344:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985221888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.096352:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985222016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.096392:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [1019904->1048575] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.096410:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7dc00, rc 0) 00000100:00100000:3.0:1746066823.096467:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3762:x1830882985717376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3764us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.096477:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21067 00000100:00100000:2.0:1746066823.096561:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985717504 00000100:00100000:2.0:1746066823.096568:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985717504 00010000:00010000:2.0:1746066823.096593:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 9 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.096627:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9726 00000100:00100000:2.0:1746066823.096634:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985717504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066823.096634:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.096647:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.096666:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 9 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.096674:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.096676:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 9 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.096706:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6e00/0xf1867c21abfb2e8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8567 expref: 9 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.096719:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985717632 00010000:00010000:2.0:1746066823.096723:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.096726:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985717632 00000100:00100000:2.0:1746066823.096747:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2014:x1830882985717504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 114us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.096753:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9726 00010000:00010000:1.0:1746066823.096755:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.096765:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985717760 00000100:00100000:2.0:1746066823.096768:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985717760 00000100:00100000:1.0:1746066823.096783:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9727 00010000:00010000:2.0:1746066823.096789:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 36 pid: 3528 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.096789:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2013:x1830882985717632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.096800:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066823.096803:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9728 00000100:00100000:2.0:1746066823.096808:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985717760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.096814:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.096816:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.096820:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 36 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.096827:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 891 lvb_type: 1 00000100:00080000:0.0:1746066823.097048:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746066823.097116:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 36 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.097138:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfb2d99 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84c6 expref: 13 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.097271:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc200/0xf1867c21abfb2e17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8521 expref: 36 pid: 3528 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.097271:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.097273:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.097280:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.097287:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.097301:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066823.097320:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.097323:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985717760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 514us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.097329:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9728 00000100:00100000:1.0:1746066823.097331:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985222144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.097391:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.099568:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985222144:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066823.099584:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.099630:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2013:x1830882985717632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2840us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.099638:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9727 00000100:00100000:0.0:1746066823.101536:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.101943:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718016 00000100:00100000:3.0:1746066823.101952:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718016 00002000:00100000:3.0:1746066823.102024:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1023999) req@ffff880093c4f100 x1830882985718016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.102033:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f100 with x1830882985718016 ext(1019904->1023999) 00002000:00010000:3.0:1746066823.102038:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f100 00000100:00100000:3.0:1746066823.102070:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8028 00000100:00100000:3.0:1746066823.102077:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985718016:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.102233:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985718016:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.102240:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8028 00002000:00100000:3.0:1746066823.102257:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1023999) req@ffff880093c4f100 x1830882985718016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.102263:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4f100 with x1830882985718016 ext(1019904->1023999) 00002000:00010000:3.0:1746066823.102266:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c4f100 00000100:00100000:0.0:1746066823.105812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.106095:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718144 00000100:00100000:3.0:1746066823.106104:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718144 00000100:00100000:3.0:1746066823.106148:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21068 00000100:00100000:3.0:1746066823.106156:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3762:x1830882985718144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.106178:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.106195:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8671 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.106229:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.106236:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.106238:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.106241:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.106287:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.106305:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 28 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.106318:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.107203:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.109139:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222272:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.109178:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.109197:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d800, rc 0) 00000100:00100000:3.0:1746066823.109259:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3762:x1830882985718144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3089us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.109267:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21068 00000100:00100000:0.0:1746066823.109866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.110041:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718272 00000100:00100000:2.0:1746066823.110048:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718272 00002000:00100000:2.0:1746066823.110088:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1323007) req@ffff880093c4ed80 x1830882985718272/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.110097:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ed80 with x1830882985718272 ext(1265664->1323007) 00010000:00010000:2.0:1746066823.110104:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 29 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.110117:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 29 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.110123:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4ed80 00000100:00100000:2.0:1746066823.110149:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2289 00000100:00100000:2.0:1746066823.110156:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985718272:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066823.112906:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985718272:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2723us (3014us total) trans 21474842852 rc 0/0 00000100:00100000:2.0:1746066823.112918:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2289 00002000:00100000:2.0:1746066823.112933:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1265664->1323007) req@ffff880093c4ed80 x1830882985718272/t21474842852(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.112941:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4ed80 with x1830882985718272 ext(1265664->1323007) 00010000:00010000:2.0:1746066823.112951:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.112963:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.112970:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4ed80 00000100:00100000:0.0:1746066823.115590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.115709:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718400 00000100:00100000:1.0:1746066823.115721:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718400 00010000:00010000:1.0:1746066823.115762:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.115806:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9729 00000100:00100000:1.0:1746066823.115813:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985718400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.115827:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066823.115843:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066823 -> 1746066824 00002000:00010000:1.0:1746066823.115846:0:7232:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066823 -> 1746066824 00010000:00010000:1.0:1746066823.115852:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.115863:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.115926:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76c00/0xf1867c21abfb3001 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1323007) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d865c expref: 31 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.115949:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.115951:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.115959:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.115967:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.115999:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.116011:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985222400:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.116260:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.117751:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985222400:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066823.117768:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.118030:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985718400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2214us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.118040:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9729 00000100:00100000:2.0:1746066823.119733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.119834:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718656 00000100:00100000:0.0:1746066823.119843:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718656 00002000:00100000:0.0:1746066823.119900:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1363968->1368063) req@ffff88011d856300 x1830882985718656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.119909:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856300 with x1830882985718656 ext(1363968->1368063) 00002000:00010000:0.0:1746066823.119915:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d856300 00000100:00100000:0.0:1746066823.119945:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8029 00000100:00100000:0.0:1746066823.119954:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985718656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066823.120216:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985718656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 261us (486us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066823.120222:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8029 00002000:00100000:0.0:1746066823.120228:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1363968->1368063) req@ffff88011d856300 x1830882985718656/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.120233:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d856300 with x1830882985718656 ext(1363968->1368063) 00002000:00010000:0.0:1746066823.120236:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011d856300 00000100:00100000:0.0:1746066823.164129:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066823.164150:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985222528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066823.164214:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.164361:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985222528 00000100:00100000:2.0:1746066823.164370:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985222528 00000100:00100000:2.0:1746066823.164425:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1746066823.164432:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985222528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746066823.164455:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1195817408 pending 4112384 free 3909910528 avail 3678388224 00000100:00080000:0.0:1746066823.164899:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066823.164932:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985222528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 499us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.164937:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1746066823.164947:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985222528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066823.175977:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.176217:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985718912 00000100:00100000:3.0:1746066823.176226:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985718912 00000100:00100000:3.0:1746066823.176296:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17401 00000100:00100000:3.0:1746066823.176305:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:3765:x1830882985718912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.176331:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.176351:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8678 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.176429:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176443:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176454:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176467:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176472:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176477:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176571:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb304e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176580:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb304e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176585:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb304e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.176593:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.176659:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176665:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176670:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176676:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176682:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.176686:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176692:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176702:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.176704:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.176708:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176713:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176729:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176734:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176738:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176743:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.176745:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176750:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176756:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb000) 00010000:00010000:3.0:1746066823.176758:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.176760:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176767:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfb3047 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.176800:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8678 expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.176811:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb304e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8678 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.177314:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.177316:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.177318:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c200, rc 0) 00000100:00100000:3.0:1746066823.178053:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:3765:x1830882985718912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1747us (2083us total) trans 8589937921 rc 0/0 00000100:00100000:3.0:1746066823.178061:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17401 00000100:00100000:2.0:1746066823.181437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.181509:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719040 00000100:00100000:1.0:1746066823.181519:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719040 00000100:00100000:1.0:1746066823.183395:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 965 00000100:00100000:1.0:1746066823.183410:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985719040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.183431:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.183461:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb304e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8678 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.183498:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.183502:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.183553:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985719040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.183559:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 965 00000100:00100000:0.0:1746066823.187863:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.188195:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719168 00000100:00100000:3.0:1746066823.188204:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719168 00000100:00100000:3.0:1746066823.188264:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21069 00000100:00100000:3.0:1746066823.188273:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:3765:x1830882985719168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.188292:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.188310:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d867f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.188339:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.188346:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.188354:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.188355:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.188358:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3354624->3604479] (req 3354624->3604479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.188389:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.188399:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.188409:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.188498:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.188505:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 19 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.188511:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222784:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.188525:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.190086:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.190097:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985222784:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.190131:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3354624->3604479] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.190209:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c000, rc 0) 00000100:00100000:3.0:1746066823.190261:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:3765:x1830882985719168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1988us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.190269:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21069 00000100:00100000:0.0:1746066823.192100:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.192174:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719296 00000100:00100000:3.0:1746066823.192182:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719296 00010000:00010000:3.0:1746066823.192212:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.192256:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9730 00000100:00100000:3.0:1746066823.192264:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985719296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.192275:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.192295:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.192305:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.192326:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb2fc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8640 expref: 31 pid: 11630 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.192350:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.192381:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985719296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.192387:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9730 00000100:00100000:0.0:1746066823.194530:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.194664:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719424 00000100:00100000:1.0:1746066823.194672:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719424 00010000:00010000:1.0:1746066823.194703:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.194742:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9731 00000100:00100000:1.0:1746066823.194749:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985719424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.194761:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.194778:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.194788:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.194811:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0800/0xf1867c21abfb2f7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d861d expref: 20 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.194844:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.194846:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.194852:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.194860:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.195170:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.195184:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985222912:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.196228:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.197399:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985222912:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066823.197415:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.197827:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985719424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3075us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.197837:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9731 00000100:00100000:0.0:1746066823.198355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.198420:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719680 00000100:00100000:2.0:1746066823.198426:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719680 00002000:00100000:2.0:1746066823.198465:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880093c4d500 x1830882985719680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.198481:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d500 with x1830882985719680 ext(3354624->3358719) 00002000:00010000:2.0:1746066823.198486:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d500 00000100:00100000:2.0:1746066823.198511:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8030 00000100:00100000:2.0:1746066823.198519:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985719680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.198634:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985719680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 115us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.198639:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8030 00002000:00100000:2.0:1746066823.198644:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3358719) req@ffff880093c4d500 x1830882985719680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.198649:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d500 with x1830882985719680 ext(3354624->3358719) 00002000:00010000:2.0:1746066823.198652:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4d500 00000100:00100000:0.0:1746066823.202107:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.202642:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985719936 00000100:00100000:3.0:1746066823.202652:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985719936 00002000:00100000:3.0:1746066823.202700:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3600384->3604479) req@ffff880093c4e680 x1830882985719936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.202711:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e680 with x1830882985719936 ext(3600384->3604479) 00002000:00010000:3.0:1746066823.202716:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4e680 00000100:00100000:3.0:1746066823.202749:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8031 00000100:00100000:3.0:1746066823.202757:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985719936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.202928:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985719936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 171us (830us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.202934:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8031 00002000:00100000:3.0:1746066823.202940:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3600384->3604479) req@ffff880093c4e680 x1830882985719936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.202947:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4e680 with x1830882985719936 ext(3600384->3604479) 00002000:00010000:3.0:1746066823.202949:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c4e680 00000100:00100000:0.0:1746066823.204981:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.205046:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985720192 00000100:00100000:1.0:1746066823.205053:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985720192 00000100:00100000:1.0:1746066823.205103:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6593 00000100:00100000:1.0:1746066823.205110:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:3765:x1830882985720192:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066823.205344:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:3765:x1830882985720192:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 234us (370us total) trans 8589937922 rc 0/0 00000100:00100000:1.0:1746066823.205355:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6593 00000100:00100000:0.0:1746066823.241579:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.241715:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985720448 00000100:00100000:3.0:1746066823.241724:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985720448 00000100:00100000:3.0:1746066823.241776:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17402 00000100:00100000:3.0:1746066823.241783:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3773:x1830882985720448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.241802:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.241816:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb3063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8686 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.241873:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.241911:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.241919:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.241929:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.241934:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.241938:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242021:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3078 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242028:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3078 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242033:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3078 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.242040:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.242098:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242105:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242109:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242114:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242121:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.242124:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242130:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242139:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.242142:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.242145:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242150:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb306a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242178:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242182:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242187:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242190:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.242192:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242196:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242200:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb800) 00010000:00010000:3.0:1746066823.242202:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.242204:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242208:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3071 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.242253:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfb3063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8686 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.242266:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3078 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8686 expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.242272:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.242274:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.242276:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d000, rc 0) 00000100:00100000:3.0:1746066823.242319:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3773:x1830882985720448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 536us (747us total) trans 8589937923 rc 0/0 00000100:00100000:3.0:1746066823.242325:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17402 00000100:00100000:0.0:1746066823.246121:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.246179:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985720704 00000100:00100000:1.0:1746066823.246186:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985720704 00000100:00100000:0.0:1746066823.246201:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.246281:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985720832 00000100:00100000:2.0:1746066823.246286:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985720832 00000100:00100000:2.0:1746066823.246331:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 966 00000100:00100000:2.0:1746066823.246338:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985720832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.246348:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066823.246354:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6594 00000100:00100000:3.0:1746066823.246362:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3773:x1830882985720704:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:2.0:1746066823.246366:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb3078 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8686 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.246386:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.246389:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.246445:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985720832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.246452:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 966 00000100:00100000:3.0:1746066823.246508:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3773:x1830882985720704:12345-192.168.204.16@tcp:35:cat.0 Request processed in 147us (431us total) trans 8589937924 rc 0/0 00000100:00100000:3.0:1746066823.246514:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6594 00000100:00100000:0.0:1746066823.248587:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.248655:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721088 00000100:00100000:3.0:1746066823.248662:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721088 00000100:00100000:3.0:1746066823.248714:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17403 00000100:00100000:3.0:1746066823.248720:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:3774:x1830882985721088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.248736:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.248750:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d868d expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.248803:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248814:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248822:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248835:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248839:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248844:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248960:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfb309b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248969:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfb309b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.248975:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfb309b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.248982:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.249026:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249032:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249092:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249098:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249102:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.249105:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249111:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249120:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.249122:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.249125:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249129:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb308d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249140:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249144:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249148:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249151:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa44400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.249153:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249161:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249166:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb500) 00010000:00010000:3.0:1746066823.249168:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.249170:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249174:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44400/0xf1867c21abfb3094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249202:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d868d expref: 40 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.249211:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfb309b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d868d expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.249217:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.249219:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.249220:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44800, rc 0) 00000100:00100000:3.0:1746066823.249276:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3774:x1830882985721088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 555us (698us total) trans 8589937925 rc 0/0 00000100:00100000:3.0:1746066823.249281:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17403 00000100:00100000:0.0:1746066823.249358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.249378:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721344 00000100:00100000:3.0:1746066823.249381:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721344 00000100:00100000:3.0:1746066823.249410:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17404 00000100:00100000:3.0:1746066823.249416:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3772:x1830882985721344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.249425:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.249431:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb30a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8694 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.249626:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249634:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249639:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249646:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249651:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249655:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249691:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249697:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249702:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.249708:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.249733:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249738:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249743:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249746:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249750:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.249752:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249756:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249762:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.249763:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.249765:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249769:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45200/0xf1867c21abfb30b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249776:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249780:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249784:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249788:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.249789:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249796:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249801:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5feb800) 00010000:00010000:3.0:1746066823.249802:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.249804:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249808:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45800/0xf1867c21abfb30b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.249828:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44e00/0xf1867c21abfb30a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8694 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.249835:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8694 expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.249840:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.249841:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.249843:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:3.0:1746066823.249871:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3772:x1830882985721344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 455us (513us total) trans 8589937926 rc 0/0 00000100:00100000:3.0:1746066823.249876:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17404 00000100:00100000:0.0:1746066823.250942:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.251009:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721472 00000100:00100000:3.0:1746066823.251013:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721472 00000100:00100000:3.0:1746066823.251085:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21070 00000100:00100000:3.0:1746066823.251260:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985721472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.251271:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.251281:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44600/0xf1867c21abfb30cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d869b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.251317:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985223040:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.251388:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.251986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.252018:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.252043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.252093:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721728 00000100:00100000:1.0:1746066823.252097:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721728 00000100:00100000:2.0:1746066823.252210:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721856 00000100:00100000:2.0:1746066823.252214:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721856 00000100:00100000:1.0:1746066823.252270:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6595 00000100:00100000:1.0:1746066823.252276:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:3774:x1830882985721728:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066823.252341:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985721984 00000100:00100000:2.0:1746066823.252343:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985721984 00000100:00100000:3.0:1746066823.252352:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 967 00000100:00100000:3.0:1746066823.252357:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985721856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066823.252361:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 968 00010000:00010000:3.0:1746066823.252365:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066823.252366:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985721984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.252372:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.252379:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfb309b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d868d expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.252384:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8694 expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.252389:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.252393:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066823.252398:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:1.0:1746066823.252398:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:3774:x1830882985721728:12345-192.168.204.16@tcp:35:cat.0 Request processed in 122us (413us total) trans 8589937927 rc 0/0 00010000:00010000:2.0:1746066823.252400:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.252404:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985721856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.252404:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6595 00000100:00100000:3.0:1746066823.252408:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 967 00000100:00100000:2.0:1746066823.252417:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985721984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.252423:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 968 00000100:00100000:1.0:1746066823.252593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746066823.252670:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066823 -> 1746066824 00002000:00010000:2.0:1746066823.252673:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066823 -> 1746066824 00002000:00010000:2.0:1746066823.252675:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066823 -> 1746066824 00000100:00100000:3.0:1746066823.252686:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985722240 00000100:00100000:2.0:1746066823.252687:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985223040:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.252690:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985722240 00010000:00010000:2.0:1746066823.252704:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44600/0xf1867c21abfb30cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d869b expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.252706:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6596 00000100:00100000:3.0:1746066823.252710:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3772:x1830882985722240:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:2.0:1746066823.252713:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44600/0xf1867c21abfb30cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d869b expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.252719:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44600, rc 0) 00000100:00100000:2.0:1746066823.252749:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985721472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1658us (1808us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.252755:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21070 00000100:00100000:3.0:1746066823.252781:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3772:x1830882985722240:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 67us (186us total) trans 8589937928 rc 0/0 00000100:00100000:3.0:1746066823.252786:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6596 00000100:00100000:0.0:1746066823.257282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.257631:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.257742:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985722368 00000100:00100000:2.0:1746066823.257751:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985722368 00000100:00100000:2.0:1746066823.257796:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985722496 00000100:00100000:2.0:1746066823.257799:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985722496 00000100:00100000:2.0:1746066823.257821:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21071 00000100:00100000:2.0:1746066823.257827:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985722368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.257842:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.257856:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb30d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86a2 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.257925:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985223168:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.257952:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21072 00000100:00100000:3.0:1746066823.257959:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985722496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.257969:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.257978:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30da lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86a9 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.257985:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.257999:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223296:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.258021:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00002000:00010000:3.0:1746066823.260388:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066822 -> 1746066824 00002000:00010000:2.0:1746066823.260389:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066820 -> 1746066824 00002000:00010000:2.0:1746066823.260393:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066820 -> 1746066824 00002000:00010000:2.0:1746066823.260394:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066820 -> 1746066824 00000100:00100000:3.0:1746066823.260407:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223296:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.260407:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985223168:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.260431:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30da lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86a9 expref: 31 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.260431:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb30d3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86a2 expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.260442:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfb30da lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86a9 expref: 31 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.260445:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb30d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86a2 expref: 36 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.260454:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76c00, rc 0) 00010000:00010000:3.0:1746066823.260461:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:2.0:1746066823.260501:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985722368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2673us (3281us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.260511:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21071 00000100:00100000:3.0:1746066823.260576:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882985722496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2616us (2945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.260582:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21072 00000100:00100000:0.0:1746066823.261964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.261996:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.262123:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985722880 00000100:00100000:3.0:1746066823.262130:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723008 00000100:00100000:2.0:1746066823.262130:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985722880 00000100:00100000:3.0:1746066823.262133:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723008 00002000:00100000:3.0:1746066823.262159:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1368064->2097151) req@ffff880097a8aa00 x1830882985723008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.262159:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1019903) req@ffff8801310f1880 x1830882985722880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.262168:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8aa00 with x1830882985723008 ext(1368064->2097151) 00002000:00100000:2.0:1746066823.262168:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1880 with x1830882985722880 ext(0->1019903) 00002000:00010000:3.0:1746066823.262173:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8aa00 00002000:00010000:2.0:1746066823.262173:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f1880 00000100:00100000:3.0:1746066823.262263:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8032 00000100:00100000:2.0:1746066823.262268:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8033 00000100:00100000:3.0:1746066823.262271:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985723008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.262272:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985722880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066823.266411:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.266599:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723136 00000100:00100000:3.0:1746066823.266607:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723136 00000100:00100000:3.0:1746066823.266695:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21073 00000100:00100000:3.0:1746066823.266702:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:3774:x1830882985723136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.266716:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.266730:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86b0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.266753:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.266759:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.266761:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.266763:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.266785:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.266795:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 13 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.266804:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985223424:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.267188:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.278631:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2015:x1830882985722880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16346us (16657us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746066823.278643:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8033 00002000:00100000:0.0:1746066823.278655:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1019903) req@ffff8801310f1880 x1830882985722880/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.278665:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1880 with x1830882985722880 ext(0->1019903) 00010000:00010000:0.0:1746066823.278676:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.278691:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746066823.278699:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801310f1880 00000100:00100000:2.0:1746066823.279003:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985223424:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.279032:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.279049:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8c00, rc 0) 00000100:00100000:2.0:1746066823.279073:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3774:x1830882985723136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12371us (12669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.279080:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21073 00000100:00100000:3.0:1746066823.279207:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985723008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16936us (17209us total) trans 0 rc 729088/729088 00000100:00100000:3.0:1746066823.279218:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8032 00002000:00100000:3.0:1746066823.279223:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1368064->2097151) req@ffff880097a8aa00 x1830882985723008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.279230:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8aa00 with x1830882985723008 ext(1368064->2097151) 00002000:00010000:3.0:1746066823.279233:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8aa00 00000100:00100000:0.0:1746066823.280207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.280347:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723264 00000100:00100000:3.0:1746066823.280354:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723264 00002000:00100000:3.0:1746066823.280388:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1048575) req@ffff880097a88380 x1830882985723264/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.280396:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88380 with x1830882985723264 ext(1019904->1048575) 00010000:00010000:3.0:1746066823.280402:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.280412:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 12 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746066823.280418:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a88380 00000100:00100000:3.0:1746066823.280433:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2290 00000100:00100000:3.0:1746066823.280439:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985723264:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066823.283075:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985723264:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2624us (2859us total) trans 17179875510 rc 0/0 00000100:00100000:3.0:1746066823.283089:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2290 00002000:00100000:3.0:1746066823.283101:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1048575) req@ffff880097a88380 x1830882985723264/t17179875510(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.283116:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88380 with x1830882985723264 ext(1019904->1048575) 00010000:00010000:3.0:1746066823.283125:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 14 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.283141:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 14 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746066823.283148:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a88380 00000100:00100000:1.0:1746066823.293567:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.294030:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723392 00000100:00100000:3.0:1746066823.294038:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723392 00010000:00010000:3.0:1746066823.294067:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 14 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.294358:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.294622:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723648 00000100:00100000:0.0:1746066823.294629:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723648 00002000:00100000:0.0:1746066823.294669:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880097a88700 x1830882985723648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.294679:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88700 with x1830882985723648 ext(2097152->3145727) 00002000:00010000:0.0:1746066823.294683:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88700 00000100:00100000:3.0:1746066823.294765:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9732 00000100:00100000:3.0:1746066823.294773:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985723392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.294785:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.294802:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 15 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.294813:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 15 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.294833:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7dc00/0xf1867c21abfb302b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d866a expref: 15 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.294864:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8034 00000100:00100000:0.0:1746066823.294871:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985723648:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066823.294978:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.294981:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.294990:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.294998:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.295144:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.295154:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985223552:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.295223:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.299302:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985223552:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.299326:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.299391:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985723392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4618us (5830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.299401:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9732 00000100:00100000:0.0:1746066823.301723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.302283:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985723904 00000100:00100000:1.0:1746066823.302295:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985723904 00002000:00100000:1.0:1746066823.302342:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880097a8b100 x1830882985723904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.302352:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882985723904 ext(0->1048575) 00002000:00010000:1.0:1746066823.302357:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b100 00000100:00100000:1.0:1746066823.302397:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8035 00000100:00100000:1.0:1746066823.302404:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985723904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066823.305032:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985723648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10151us (10669us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.305043:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8034 00002000:00100000:1.0:1746066823.305052:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880097a88700 x1830882985723648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.305067:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88700 with x1830882985723648 ext(2097152->3145727) 00002000:00010000:1.0:1746066823.305072:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88700 00000100:00100000:0.0:1746066823.314383:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.314453:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985723904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12046us (12732us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.314465:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8035 00002000:00100000:1.0:1746066823.314478:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880097a8b100 x1830882985723904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066823.314484:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724032 00002000:00100000:1.0:1746066823.314488:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882985723904 ext(0->1048575) 00000100:00100000:3.0:1746066823.314494:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724032 00002000:00010000:1.0:1746066823.314495:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b100 00000100:00100000:3.0:1746066823.315137:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21074 00000100:00100000:3.0:1746066823.315145:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3773:x1830882985724032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.315159:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.315174:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86b7 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.315200:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.315213:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.315214:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.315218:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.315252:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.315263:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 29 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.315273:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.315354:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.318810:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223680:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.318845:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.318862:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8400, rc 0) 00000100:00100000:0.0:1746066823.319840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.319918:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724160 00000100:00100000:1.0:1746066823.319929:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724160 00000100:00100000:3.0:1746066823.319944:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3773:x1830882985724032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4798us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.319954:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21074 00002000:00100000:1.0:1746066823.319974:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3604479) req@ffff880098f56d80 x1830882985724160/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.319983:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56d80 with x1830882985724160 ext(3354624->3604479) 00010000:00010000:1.0:1746066823.319991:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 30 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.320004:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 30 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.320011:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f56d80 00000100:00100000:1.0:1746066823.320035:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2291 00000100:00100000:1.0:1746066823.320040:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985724160:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066823.320667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.320770:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724288 00000100:00100000:3.0:1746066823.320776:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724288 00000100:00100000:3.0:1746066823.320801:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21075 00000100:00100000:3.0:1746066823.320806:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+32:3774:x1830882985724288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.320821:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.320836:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86be expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.320860:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.320867:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.320869:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.320872:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.320922:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.320933:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 19 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.320944:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223808:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.321992:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.323128:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985724160:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3080us (3283us total) trans 21474842853 rc 0/0 00000100:00100000:1.0:1746066823.323138:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2291 00002000:00100000:1.0:1746066823.323147:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3354624->3604479) req@ffff880098f56d80 x1830882985724160/t21474842853(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.323156:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56d80 with x1830882985724160 ext(3354624->3604479) 00010000:00010000:1.0:1746066823.323163:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 34 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.323174:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 34 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.323181:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f56d80 00000100:00100000:0.0:1746066823.324160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.324867:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724544 00000100:00100000:3.0:1746066823.324874:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724544 00000100:00100000:3.0:1746066823.324927:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17405 00000100:00100000:0.0:1746066823.324928:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.324933:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3776:x1830882985724544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.324949:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.324962:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb30f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86c5 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.324974:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066823.325024:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325035:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.325041:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985223808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.325043:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325052:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325057:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325061:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.325064:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.325075:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9600, rc 0) 00000100:00100000:2.0:1746066823.325105:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+33:3774:x1830882985724288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4298us (4438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.325114:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21075 00000100:00100000:1.0:1746066823.325128:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724672 00000100:00100000:1.0:1746066823.325132:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724672 00002000:00100000:1.0:1746066823.325152:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1368063) req@ffff880098f55500 x1830882985724672/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.325160:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882985724672 ext(1048576->1368063) 00010000:00010000:1.0:1746066823.325166:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 20 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.325174:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 20 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.325180:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f55500 00000100:00100000:1.0:1746066823.325193:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2292 00010000:00010000:3.0:1746066823.325196:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb310b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066823.325197:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985724672:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066823.325206:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb310b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325212:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb310b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.325219:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.325281:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325287:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325296:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325301:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325306:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.325309:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325315:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325323:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.325325:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.325329:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325333:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfb30fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325360:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325365:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325370:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325374:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.325377:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325384:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325391:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfdc00) 00010000:00010000:3.0:1746066823.325392:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.325394:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325398:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9400/0xf1867c21abfb3104 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.325431:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfb30f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86c5 expref: 42 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.325440:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb310b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86c5 expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.325445:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.325447:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.325449:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8a00, rc 0) 00000100:00100000:3.0:1746066823.325469:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:3776:x1830882985724544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 537us (1312us total) trans 8589937929 rc 0/0 00000100:00100000:3.0:1746066823.325475:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17405 00000100:00100000:3.0:1746066823.325494:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724800 00000100:00100000:3.0:1746066823.325496:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724800 00010000:00010000:3.0:1746066823.325507:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.325523:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9733 00000100:00100000:3.0:1746066823.325529:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985724800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.325536:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.325607:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.325617:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.325630:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb305c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3604479) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d867f expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.325639:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.325641:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.325645:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.325652:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.325674:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.325685:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985223936:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.326072:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.331612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.331635:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.331703:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725056 00000100:00100000:3.0:1746066823.331711:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725056 00000100:00100000:3.0:1746066823.331748:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21076 00000100:00100000:3.0:1746066823.331755:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+33:3776:x1830882985725056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.331769:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.331782:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86cc expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.331792:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985724928 00000100:00100000:2.0:1746066823.331795:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985724928 00010000:00010000:3.0:1746066823.331807:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.331814:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.331816:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.331819:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.331821:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 969 00000100:00100000:2.0:1746066823.331825:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985724928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.331832:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.331841:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.331847:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfb310b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86c5 expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.331850:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.331859:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985224064:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.331868:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.331871:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.331930:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.331997:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985724928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 169us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.332003:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 969 00000100:00100000:3.0:1746066823.332286:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985223936:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.332298:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.332327:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985724800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6797us (7398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.332333:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9733 00000100:00100000:1.0:1746066823.332631:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985724672:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7433us (7655us total) trans 21474842854 rc 0/0 00000100:00100000:1.0:1746066823.332639:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2292 00002000:00100000:1.0:1746066823.332646:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1368063) req@ffff880098f55500 x1830882985724672/t21474842854(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.332654:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55500 with x1830882985724672 ext(1048576->1368063) 00010000:00010000:1.0:1746066823.332660:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 22 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.332668:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 22 pid: 12255 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.332674:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f55500 00000100:00100000:3.0:1746066823.333164:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985224064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.333177:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.333187:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14a00, rc 0) 00000100:00100000:3.0:1746066823.333203:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+33:3776:x1830882985725056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1449us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.333209:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21076 00000100:00100000:0.0:1746066823.334966:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.335012:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725312 00000100:00100000:1.0:1746066823.335021:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725312 00002000:00100000:1.0:1746066823.335049:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f57800 x1830882985725312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.335058:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57800 with x1830882985725312 ext(2097152->4194303) 00010000:00010000:1.0:1746066823.335064:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 22 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.335073:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 22 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.335078:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f57800 00000100:00100000:1.0:1746066823.335107:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2293 00000100:00100000:1.0:1746066823.335114:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985725312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066823.336253:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.336350:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725440 00000100:00100000:3.0:1746066823.336354:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725440 00010000:00010000:3.0:1746066823.336373:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 24 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.336403:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9734 00000100:00100000:3.0:1746066823.336408:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985725440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.336415:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.336427:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 24 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.336435:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 24 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.336450:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8671 expref: 24 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.336472:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.336475:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.336480:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.336487:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.336813:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 32 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.336825:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224192:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.336900:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.342876:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224192:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.342931:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.342979:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985725440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6569us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.342987:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985725312:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7873us (8028us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066823.342991:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9734 00000100:00100000:1.0:1746066823.342995:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2293 00002000:00100000:1.0:1746066823.343004:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880098f57800 x1830882985725312/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.343012:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f57800 with x1830882985725312 ext(2097152->4194303) 00010000:00010000:1.0:1746066823.343020:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.343031:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 21 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.343037:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f57800 00000100:00100000:0.0:1746066823.350046:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.350124:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725696 00000100:00100000:1.0:1746066823.350133:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725696 00002000:00100000:1.0:1746066823.350170:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098f56680 x1830882985725696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.350180:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56680 with x1830882985725696 ext(1048576->2097151) 00002000:00010000:1.0:1746066823.350184:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f56680 00000100:00100000:1.0:1746066823.350210:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8036 00000100:00100000:1.0:1746066823.350217:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985725696:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066823.352988:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.353053:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725824 00000100:00100000:3.0:1746066823.353061:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725824 00000100:00100000:0.0:1746066823.353079:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.353106:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21077 00000100:00100000:3.0:1746066823.353112:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3773:x1830882985725824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.353123:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.353136:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86d3 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.353155:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.353161:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.353172:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.353175:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.353204:0:13726:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3940352->3948543] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.353215:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 22 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.353223:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14000, rc 0) 00000100:00100000:2.0:1746066823.353545:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985725952 00000100:00100000:2.0:1746066823.353550:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985725952 00010000:00010000:2.0:1746066823.353566:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 23 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.353586:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9735 00000100:00100000:2.0:1746066823.353591:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985725952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.353598:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.353613:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 23 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.353623:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 23 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.353638:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfb30e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b7 expref: 23 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.353664:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.353666:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.353670:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.353677:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.353681:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3773:x1830882985725824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 568us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.353688:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21077 00010000:00010000:2.0:1746066823.353694:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.353703:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.353712:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224448:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.353766:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.355134:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882985725696:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 4916us (5094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.355141:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8036 00002000:00100000:1.0:1746066823.355147:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098f56680 x1830882985725696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.355153:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56680 with x1830882985725696 ext(1048576->2097151) 00002000:00010000:1.0:1746066823.355156:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f56680 00000100:00100000:2.0:1746066823.355483:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224448:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.355495:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.355513:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985725952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1922us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.355520:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9735 00000100:00100000:0.0:1746066823.361632:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.361694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.361741:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985726208 00000100:00100000:1.0:1746066823.361753:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985726208 00000100:00100000:3.0:1746066823.361790:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985726336 00000100:00100000:3.0:1746066823.361797:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985726336 00002000:00100000:1.0:1746066823.361799:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3944447) req@ffff880098f55880 x1830882985726208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.361808:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55880 with x1830882985726208 ext(3940352->3944447) 00010000:00010000:1.0:1746066823.361815:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.361828:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.361834:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f55880 00000100:00100000:3.0:1746066823.361844:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21078 00000100:00100000:3.0:1746066823.361852:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+34:3774:x1830882985726336:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066823.361856:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2294 00000100:00100000:1.0:1746066823.361863:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985726208:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746066823.361869:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.361909:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86da expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.361933:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.361935:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.361939:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.361953:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.361963:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14c00, rc 0) 00000100:00100000:3.0:1746066823.362004:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:3774:x1830882985726336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 153us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.362010:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21078 00000100:00100000:1.0:1746066823.362026:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985726208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 162us (403us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066823.362037:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2294 00002000:00100000:1.0:1746066823.362042:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3944447) req@ffff880098f55880 x1830882985726208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.362068:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55880 with x1830882985726208 ext(3940352->3944447) 00010000:00010000:1.0:1746066823.362073:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.362082:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.362088:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098f55880 00000100:00100000:0.0:1746066823.363256:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.363311:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985726592 00000100:00100000:2.0:1746066823.363317:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985726592 00002000:00100000:2.0:1746066823.363336:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3944448->3948543) req@ffff8800967aa680 x1830882985726592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.363342:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882985726592 ext(3944448->3948543) 00010000:00010000:2.0:1746066823.363346:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.363354:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.363359:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:2.0:1746066823.363376:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2295 00000100:00100000:2.0:1746066823.363380:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985726592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.363460:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985726592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 78us (218us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.363467:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2295 00002000:00100000:2.0:1746066823.363471:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3944448->3948543) req@ffff8800967aa680 x1830882985726592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.363478:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882985726592 ext(3944448->3948543) 00010000:00010000:2.0:1746066823.363483:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.363492:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.363498:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066823.364774:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.364810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.364855:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985726976 00000100:00100000:3.0:1746066823.364862:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985726976 00000100:00100000:0.0:1746066823.364872:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985727104 00000100:00100000:0.0:1746066823.364876:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985727104 00000100:00100000:3.0:1746066823.364919:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6597 00000100:00100000:3.0:1746066823.364926:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3776:x1830882985726976:12345-192.168.204.16@tcp:35:multiop.0 00002000:00100000:0.0:1746066823.364928:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3948543) req@ffff88011d854380 x1830882985727104/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 8680/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.364935:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854380 with x1830882985727104 ext(3940352->3948543) 00010000:00010000:0.0:1746066823.364942:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.364952:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746066823.364958:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d854380 00000100:00100000:0.0:1746066823.364969:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2296 00000100:00100000:0.0:1746066823.364973:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985727104:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066823.365128:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:3776:x1830882985726976:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 201us (355us total) trans 8589937930 rc 0/0 00000100:00100000:3.0:1746066823.365134:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6597 00000100:00100000:1.0:1746066823.365630:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985727104:12345-192.168.204.16@tcp:4:cat.0 Request processed in 655us (819us total) trans 21474842855 rc 0/0 00000100:00100000:1.0:1746066823.365637:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2296 00002000:00100000:1.0:1746066823.365642:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3940352->3948543) req@ffff88011d854380 x1830882985727104/t21474842855(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 8680/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.365649:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011d854380 with x1830882985727104 ext(3940352->3948543) 00010000:00010000:1.0:1746066823.365654:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.365664:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.365669:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011d854380 00000100:00100000:0.0:1746066823.369079:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.369133:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.369201:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985727232 00000100:00100000:2.0:1746066823.369211:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985727232 00000100:00100000:3.0:1746066823.369218:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985727360 00000100:00100000:3.0:1746066823.369225:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985727360 00010000:00010000:2.0:1746066823.369253:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.369286:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9736 00000100:00100000:2.0:1746066823.369293:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985727232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.369306:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.369323:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.369335:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.369356:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb3119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3940352->3948543) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86cc expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.369391:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.369393:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.369399:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.369407:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21079 00010000:00010000:2.0:1746066823.369407:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.369414:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3772:x1830882985727360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.369415:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.369416:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.369419:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.369425:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.369431:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.369446:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86e1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.369454:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.369464:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224576:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.369474:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.369486:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.369488:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.369491:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [503808->1048575] (req 503808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.369516:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.369554:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 20 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.369562:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224832:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.369580:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebe40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066823.369598:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 35 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.369610:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985224704:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.369653:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.371467:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.371560:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985224832:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.371575:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.371610:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985224704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.371627:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985727232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2333us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.371637:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9736 00010000:00010000:3.0:1746066823.371644:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [503808->1048575] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.371658:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15000, rc 0) 00000100:00100000:3.0:1746066823.371688:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:3772:x1830882985727360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2275us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.371696:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21079 00000100:00100000:0.0:1746066823.372721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.372791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.372868:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985727488 00000100:00100000:2.0:1746066823.372875:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985727488 00000100:00100000:1.0:1746066823.372910:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985727744 00000100:00100000:1.0:1746066823.372914:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985727744 00010000:00010000:2.0:1746066823.372926:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00002000:00100000:1.0:1746066823.372942:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800967abb80 x1830882985727744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.372957:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882985727744 ext(3145728->4194303) 00002000:00010000:1.0:1746066823.372961:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:1.0:1746066823.372979:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8037 00000100:00100000:1.0:1746066823.372985:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985727744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.373392:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9737 00000100:00100000:2.0:1746066823.373398:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985727488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.373407:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.373422:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.373434:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.373455:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8c00/0xf1867c21abfb30e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86b0 expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.373626:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.373639:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728000 00000100:00100000:0.0:1746066823.373642:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728000 00002000:00100000:0.0:1746066823.373660:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800967a9f80 x1830882985728000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.373667:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882985728000 ext(2097152->4194303) 00002000:00010000:0.0:1746066823.373672:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9f80 00010000:00010000:2.0:1746066823.373723:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.373726:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.373733:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.373742:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.373797:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.373799:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8038 00000100:00100000:3.0:1746066823.373807:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985728000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.373810:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985224960:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.373858:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.380343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.380726:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728128 00000100:00100000:3.0:1746066823.380736:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728128 00000100:00100000:3.0:1746066823.380796:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17406 00000100:00100000:3.0:1746066823.380805:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3778:x1830882985728128:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066823.380833:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.380851:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece800/0xf1867c21abfb3135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86e8 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.380946:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.380959:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.380970:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.380984:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.380990:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.380994:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.381061:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.381072:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.381079:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.381113:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.381125:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 21 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.381137:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985225088:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.381239:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.383792:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985224960:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.383811:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.384440:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985727488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11039us (11718us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.384451:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9737 00000100:00100000:2.0:1746066823.385335:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.385353:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728256 00000100:00100000:2.0:1746066823.385360:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728256 00010000:00010000:2.0:1746066823.385394:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 22 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.385416:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9738 00000100:00100000:2.0:1746066823.385546:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985728256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.385561:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.385567:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 22 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.385578:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 22 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.385600:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.385604:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.385613:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.385619:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.385637:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.385677:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985728256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.385683:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9738 00010000:00010000:3.0:1746066823.385793:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfb2f8a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8624 expref: 21 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.385810:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985225088:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.385825:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385832:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385838:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.385904:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:3.0:1746066823.385907:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066823.385923:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385933:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385945:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385951:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385957:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385962:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385967:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecfe00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.385971:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385977:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385985:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.385987:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.385991:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.385995:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfb313c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386005:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386010:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386015:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386019:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecee00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.386021:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386026:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386032:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfdb00) 00010000:00010000:3.0:1746066823.386034:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.386036:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386040:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfb3143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.386070:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece800/0xf1867c21abfb3135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.386083:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.386089:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.386092:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066823.386094:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece200, rc 0) 00000100:00100000:3.0:1746066823.386132:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3778:x1830882985728128:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5328us (5801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.386138:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17406 00000100:00100000:0.0:1746066823.388552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.388612:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985727744:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15626us (15820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.388620:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8037 00002000:00100000:1.0:1746066823.388629:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800967abb80 x1830882985727744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.388636:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882985727744 ext(3145728->4194303) 00002000:00010000:1.0:1746066823.388641:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:3.0:1746066823.388755:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728384 00000100:00100000:3.0:1746066823.388763:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728384 00000100:00100000:3.0:1746066823.388811:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21080 00000100:00100000:3.0:1746066823.388818:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3772:x1830882985728384:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.388836:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.388851:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86ef expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.388878:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.388912:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.388913:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.388917:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.388948:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.388960:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 36 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.388971:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985225216:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.390295:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.390336:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.390379:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.390928:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985728000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17120us (17300us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066823.390938:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8038 00002000:00100000:2.0:1746066823.390948:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800967a9f80 x1830882985728000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.390956:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882985728000 ext(2097152->4194303) 00002000:00010000:2.0:1746066823.390961:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9f80 00000100:00100000:3.0:1746066823.391301:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728512 00000100:00100000:3.0:1746066823.391307:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728512 00000100:00100000:3.0:1746066823.391332:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728640 00000100:00100000:3.0:1746066823.391333:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728640 00000100:00100000:3.0:1746066823.391354:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21081 00000100:00100000:3.0:1746066823.391361:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985728512:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066823.391373:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.391391:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3158 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86f6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.391447:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225344:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.391600:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21082 00000100:00100000:2.0:1746066823.391607:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985728640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066823.391615:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.391623:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb315f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d86fd expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.391636:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.391644:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb315f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86fd expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.391653:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb315f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86fd expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.391665:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945200, rc 0) 00000100:00100000:2.0:1746066823.391681:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985728640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 75us (1344us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.391685:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21082 00000100:00100000:0.0:1746066823.391776:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.391834:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728768 00000100:00100000:0.0:1746066823.391838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.391839:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728768 00000100:00100000:1.0:1746066823.391855:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985728896 00000100:00100000:1.0:1746066823.391857:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985728896 00000100:00100000:0.0:1746066823.391858:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21083 00000100:00100000:0.0:1746066823.391864:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985728768:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066823.391871:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21084 00010000:00010000:0.0:1746066823.391871:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066823.391877:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+6:2015:x1830882985728896:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066823.391878:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8704 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.391898:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.391904:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.391905:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.391906:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d870b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.391913:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.391918:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.391919:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.391925:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 7 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.391926:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.391934:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00010000:00010000:1.0:1746066823.391935:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 7 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.391943:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba800, rc 0) 00000100:00100000:0.0:1746066823.391950:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985728768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 86us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.391955:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21083 00000100:00100000:1.0:1746066823.391960:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+7:2015:x1830882985728896:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 85us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.391967:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21084 00000100:00100000:3.0:1746066823.392081:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.394869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.394923:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.394955:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985225216:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.394987:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.395004:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece000, rc 0) 00000100:00100000:1.0:1746066823.395049:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729152 00000100:00100000:3.0:1746066823.395057:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3772:x1830882985728384:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6239us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.395057:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729152 00000100:00100000:3.0:1746066823.395065:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21080 00010000:00010000:1.0:1746066823.395088:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 35 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.395091:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729024 00000100:00100000:3.0:1746066823.395095:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729024 00000100:00100000:3.0:1746066823.395116:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21085 00000100:00100000:1.0:1746066823.395118:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9739 00000100:00100000:3.0:1746066823.395121:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985729024:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066823.395124:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985729152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.395134:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.395136:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.395147:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb3174 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8712 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.395154:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 35 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.395162:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.395169:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 35 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.395754:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb3174 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8712 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.395766:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb3174 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8712 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.395768:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb30ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86be expref: 35 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.395785:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8800, rc 0) 00010000:00010000:1.0:1746066823.395804:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.395806:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066823.395810:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985729024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 688us (949us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066823.395812:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.395816:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21085 00010000:00010000:1.0:1746066823.395819:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.395849:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.395860:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985225472:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.395863:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225344:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.395881:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3158 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86f6 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.395914:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3158 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86f6 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.395922:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8e00, rc 0) 00000100:00100000:3.0:1746066823.395941:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985728512:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4581us (5649us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066823.395941:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.395946:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21081 00000100:00100000:0.0:1746066823.398192:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.398270:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.398348:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729280 00000100:00100000:2.0:1746066823.398355:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729280 00000100:00100000:2.0:1746066823.398388:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729408 00000100:00100000:2.0:1746066823.398390:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729408 00000100:00100000:3.0:1746066823.398404:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21086 00000100:00100000:3.0:1746066823.398418:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985729280:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066823.398423:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985225472:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.398436:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.398440:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.398452:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21087 00010000:00010000:3.0:1746066823.398453:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb317b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8719 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.398459:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985729408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.398473:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066823.398475:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985729152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3350us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.398483:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9739 00010000:00010000:2.0:1746066823.398487:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb3182 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8720 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.398505:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225600:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.398574:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.398607:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985225728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.398728:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.399613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.399710:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985225728:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.399729:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb3182 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8720 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.399736:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b945200/0xf1867c21abfb3182 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8720 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.399742:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945200, rc 0) 00000100:00100000:2.0:1746066823.399744:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729664 00000100:00100000:2.0:1746066823.399748:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729664 00000100:00100000:3.0:1746066823.399758:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985729408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1301us (1489us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.399762:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21087 00002000:00100000:2.0:1746066823.399770:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1286144->1290239) req@ffff88012c490380 x1830882985729664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.399778:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882985729664 ext(1286144->1290239) 00002000:00010000:2.0:1746066823.399781:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490380 00000100:00100000:2.0:1746066823.399805:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8039 00000100:00100000:2.0:1746066823.399810:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985729664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.399918:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985729664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 107us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.399923:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8039 00002000:00100000:2.0:1746066823.399928:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1286144->1290239) req@ffff88012c490380 x1830882985729664/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.399934:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882985729664 ext(1286144->1290239) 00002000:00010000:2.0:1746066823.399937:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490380 00000100:00100000:2.0:1746066823.400858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.400952:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985729920 00000100:00100000:0.0:1746066823.400960:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985729920 00000100:00100000:0.0:1746066823.401001:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17407 00000100:00100000:0.0:1746066823.401009:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3778:x1830882985729920:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066823.401023:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.401039:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7800/0xf1867c21abfb3189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8727 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.401076:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225600:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.401094:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb317b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8719 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.401103:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfb317b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8719 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.401111:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9e00, rc 0) 00010000:00010000:0.0:1746066823.401130:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.401141:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985729280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2727us (2954us total) trans 0 rc 301/301 00010000:00010000:0.0:1746066823.401142:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.401146:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21086 00010000:00010000:0.0:1746066823.401148:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.401256:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.401268:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 10 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.401280:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985225856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.401338:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136962780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.403464:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.404021:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730176 00000100:00100000:3.0:1746066823.404029:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730176 00000100:00100000:3.0:1746066823.404073:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6598 00000100:00100000:3.0:1746066823.404081:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3772:x1830882985730176:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066823.404268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.404303:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3772:x1830882985730176:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 222us (845us total) trans 8589937931 rc 0/0 00000100:00100000:3.0:1746066823.404311:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6598 00000100:00100000:1.0:1746066823.404316:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985225856:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.404342:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.404398:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730432 00000100:00100000:2.0:1746066823.404405:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730432 00000100:00100000:2.0:1746066823.404445:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21088 00000100:00100000:2.0:1746066823.404452:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985730432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.404467:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.404621:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfb3197 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d872e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.404663:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225984:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.404855:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.405431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.405561:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730304 00000100:00100000:1.0:1746066823.405565:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730304 00010000:00010000:1.0:1746066823.405585:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.405625:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9740 00000100:00100000:1.0:1746066823.405631:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985730304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.405644:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.405649:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.405660:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.405801:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece200/0xf1867c21abfb314a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e8 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.405930:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.405979:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730560 00000100:00100000:3.0:1746066823.405983:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730560 00010000:00010000:1.0:1746066823.406010:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:3.0:1746066823.406037:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21089 00000100:00100000:3.0:1746066823.406042:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985730560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.406049:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.406056:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb319e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8735 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.406059:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.406069:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.406075:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.406078:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985226112:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066823.406089:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.406106:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.406110:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985730304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 478us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.406115:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9740 00010000:00010000:0.0:1746066823.406540:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.407034:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985225984:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066823.407053:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfb3197 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d872e expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.407062:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfb3197 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d872e expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.407078:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944a00, rc 0) 00000100:00100000:2.0:1746066823.407094:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985730432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2644us (2828us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.407099:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21088 00010000:00010000:0.0:1746066823.407109:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066823.407132:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:0.0:1746066823.407264:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7800/0xf1867c21abfb3189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.407291:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.407298:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066823.407300:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066823.407303:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7e00, rc 0) 00000100:00100000:0.0:1746066823.407345:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985729920:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6336us (6487us total) trans 8589937932 rc 0/0 00000100:00100000:0.0:1746066823.407353:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17407 00000100:00100000:3.0:1746066823.409820:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985226112:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.409845:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb319e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8735 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.409856:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb319e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8735 expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.409866:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9600, rc 0) 00000100:00100000:3.0:1746066823.409959:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985730560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3916us (4028us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.409966:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21089 00000100:00100000:0.0:1746066823.410880:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.411447:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730688 00000100:00100000:1.0:1746066823.411455:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730688 00000100:00100000:1.0:1746066823.411492:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17408 00000100:00100000:1.0:1746066823.411498:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985730688:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066823.411514:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.411526:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb31ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d873c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.411682:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.411695:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.411701:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.411725:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.411736:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.411746:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985226240:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.411966:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.412069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.412107:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730944 00000100:00100000:3.0:1746066823.412111:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730944 00000100:00100000:0.0:1746066823.412133:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.412139:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985730816 00000100:00100000:3.0:1746066823.412142:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985730816 00000100:00100000:3.0:1746066823.412158:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21090 00000100:00100000:3.0:1746066823.412163:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985730944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.412170:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.412178:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d874a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.412204:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985226368:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.412247:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.412262:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21091 00000100:00100000:3.0:1746066823.412271:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985730816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.412278:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.412286:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb31c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8743 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.412309:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985226496:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.412327:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.413988:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985226240:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.414004:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066823.414025:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.414152:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985226368:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.414171:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31ba lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d874a expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.414182:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d874a expref: 35 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.414191:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8800, rc 0) 00000100:00100000:3.0:1746066823.414231:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985730944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2067us (2161us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.414238:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21090 00000100:00100000:3.0:1746066823.414290:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985226496:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.414305:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb31c1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8743 expref: 36 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.414314:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9400/0xf1867c21abfb31c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8743 expref: 36 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.414321:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9400, rc 0) 00000100:00100000:3.0:1746066823.414335:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985730816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2068us (2202us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.414340:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21091 00000100:00100000:2.0:1746066823.414407:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731072 00000100:00100000:2.0:1746066823.414412:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731072 00010000:00010000:2.0:1746066823.414431:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 12 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.414466:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9741 00000100:00100000:2.0:1746066823.414473:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985731072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.414481:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.414486:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 12 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.414495:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 12 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.414510:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7e00/0xf1867c21abfb3190 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8727 expref: 12 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.414521:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.414524:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.414532:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.414539:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.414565:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.414592:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985731072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.414600:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9741 00010000:00010000:1.0:1746066823.414699:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.414706:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066823.414744:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066823.414747:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066823.414760:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.414782:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb31ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d873c expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.414795:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d873c expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.414802:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.414805:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066823.414806:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb400, rc 0) 00000100:00100000:1.0:1746066823.414839:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985730688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3342us (3965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.414846:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17408 00000100:00100000:1.0:1746066823.417462:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.417513:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731328 00000100:00100000:3.0:1746066823.417520:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731328 00000100:00100000:3.0:1746066823.417555:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21092 00000100:00100000:3.0:1746066823.417560:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985731328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066823.417570:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.417580:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb31c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8758 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.417614:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985226624:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.417693:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.417933:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.417995:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731200 00000100:00100000:0.0:1746066823.417999:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731200 00000100:00100000:0.0:1746066823.418022:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21093 00000100:00100000:0.0:1746066823.418028:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985731200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066823.418035:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.418045:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb31cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8751 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.418070:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985226752:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066823.418302:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.422226:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985226752:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066823.422266:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb31cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8751 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.422278:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfb31cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8751 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.422306:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0cc00, rc 0) 00000100:00100000:1.0:1746066823.422343:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985731200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4314us (4410us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066823.422350:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21093 00000100:00100000:3.0:1746066823.422440:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985226624:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.422461:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb31c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8758 expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.422474:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfb31c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8758 expref: 8 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.422483:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14a00, rc 0) 00000100:00100000:3.0:1746066823.422511:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985731328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4944us (5051us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.422517:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21092 00000100:00100000:0.0:1746066823.426404:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.426464:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731584 00000100:00100000:1.0:1746066823.426473:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731584 00000100:00100000:1.0:1746066823.426521:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17409 00000100:00100000:1.0:1746066823.426528:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985731584:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066823.426543:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.426558:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb31d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d875f expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.426638:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.426649:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.426658:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066823.426668:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066823.426740:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfb31d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.426752:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.426765:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.426767:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066823.426770:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bba00, rc 0) 00000100:00100000:1.0:1746066823.427130:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+12:3778:x1830882985731584:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 600us (731us total) trans 8589937933 rc 0/0 00000100:00100000:1.0:1746066823.427136:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17409 00000100:00100000:0.0:1746066823.428602:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.428671:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731840 00000100:00100000:3.0:1746066823.428677:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731840 00000100:00100000:3.0:1746066823.428714:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21094 00000100:00100000:3.0:1746066823.428720:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985731840:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066823.428746:0:13726:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.428761:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.428767:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.428769:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.428771:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.428795:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.428806:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 21 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.428818:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985226880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.428879:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.429255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.429298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.429314:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.429319:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732096 00000100:00100000:2.0:1746066823.429323:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732096 00000100:00100000:0.0:1746066823.429326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.429339:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732352 00000100:00100000:2.0:1746066823.429341:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732352 00000100:00100000:0.0:1746066823.429343:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.429350:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731712 00000100:00100000:2.0:1746066823.429352:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731712 00000100:00100000:0.0:1746066823.429355:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985731968 00000100:00100000:0.0:1746066823.429357:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985731968 00000100:00100000:2.0:1746066823.429359:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732224 00000100:00100000:2.0:1746066823.429360:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732224 00000100:00100000:2.0:1746066823.429370:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21095 00000100:00100000:2.0:1746066823.429375:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985732096:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066823.429394:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.429404:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429412:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429418:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429423:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.429425:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.429427:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.429447:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429455:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.429464:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.429497:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429504:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 11 pid: 11630 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.429511:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.429528:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.429534:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 13 pid: 20361 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.429540:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.429551:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.429720:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21096 00000100:00100000:0.0:1746066823.429726:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985732352:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066823.429742:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429752:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429757:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.429764:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429773:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.429774:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.429776:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429791:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 33 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429799:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 33 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.429806:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227392:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066823.429831:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.429837:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746066823.429843:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227520:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066823.429860:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 21 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.429866:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 21 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.429877:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.429914:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.430201:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21097 00000100:00100000:3.0:1746066823.430208:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985731712:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066823.430223:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430231:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430236:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.430237:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.430248:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430261:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430267:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.430274:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985227776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.430292:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.430304:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21098 00000100:00100000:3.0:1746066823.430308:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985732224:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066823.430320:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430328:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430334:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.430340:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430345:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430349:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.430350:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.430351:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 7/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430362:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430368:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 34 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.430434:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21099 00000100:00100000:1.0:1746066823.430442:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985731968:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066823.430457:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.430466:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.430473:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.430480:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.430485:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.430486:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.430488:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.430504:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.430512:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 9 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.430519:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228032:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.430552:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 21 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.430559:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 21 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.430571:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.430594:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.430601:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.430607:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228288:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.430621:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.430831:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985227904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.430859:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430866:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 34 pid: 12233 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.430872:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.430913:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 11 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.430920:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 11 pid: 1893 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.430927:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.430943:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 13 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.430950:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 13 pid: 12233 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.430957:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.430969:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.431344:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985226880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.431358:0:13726:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.436568:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.436605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.436686:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.436693:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985227776:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.436693:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.436702:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227520:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.436702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.436708:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985227648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.436709:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.436717:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066823.436726:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.436729:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732608 00000100:00100000:0.0:1746066823.436732:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732992 00000100:00100000:3.0:1746066823.436733:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732608 00000100:00100000:0.0:1746066823.436735:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732992 00000100:00100000:1.0:1746066823.436746:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.436754:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 12 pid: 11630 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.436776:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733376 00000100:00100000:3.0:1746066823.436779:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733376 00000100:00100000:2.0:1746066823.436794:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732480 00000100:00100000:2.0:1746066823.436798:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732480 00002000:00100000:2.0:1746066823.436828:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1290239) req@ffff8800a5d80a80 x1830882985732480/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.436837:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830882985732480 ext(1048576->1290239) 00010000:00010000:2.0:1746066823.436843:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.436853:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.436858:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80a80 00010000:00010000:3.0:1746066823.436913:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 11 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.436916:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 11 pid: 12233 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.436928:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732864 00000100:00100000:3.0:1746066823.436930:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732864 00000100:00100000:0.0:1746066823.436931:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9742 00000100:00100000:0.0:1746066823.436937:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985732608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.436939:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 35 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.436946:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066823.436948:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9743 00000100:00100000:3.0:1746066823.436953:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985733376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.436959:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.436962:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 12 pid: 11630 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.436970:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 11 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.436977:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 11 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.436980:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 12 pid: 11630 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.436995:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfb2ee9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85ad expref: 11 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.436999:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066823.437007:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.437034:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985733376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.437034:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2014:x1830882985732608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.437039:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9743 00000100:00100000:0.0:1746066823.437048:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9742 00000100:00100000:3.0:1746066823.437054:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9744 00000100:00100000:3.0:1746066823.437059:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985732992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066823.437062:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9745 00010000:00010000:3.0:1746066823.437064:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066823.437066:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985732864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.437073:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.437073:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.437079:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.437079:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 35 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.437087:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfb316d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d870b expref: 9 pid: 12233 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.437087:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 35 pid: 12255 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.437094:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066823.437102:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.437105:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985732992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.437110:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9744 00000100:00100000:0.0:1746066823.437117:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985732864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.437122:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9745 00010000:00010000:3.0:1746066823.437167:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfb2e33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8536 expref: 34 pid: 12255 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.437179:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.437182:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2297 00010000:00010000:3.0:1746066823.437187:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7600/0xf1867c21abfb2e95 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d857c expref: 11 pid: 11630 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.437191:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985732480:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066823.437193:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.437200:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985227264:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.437215:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.437295:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.437561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.437588:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733248 00000100:00100000:3.0:1746066823.437591:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733248 00010000:00010000:3.0:1746066823.437603:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 24 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.437704:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985732736 00000100:00100000:3.0:1746066823.437706:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985732736 00010000:00010000:3.0:1746066823.437719:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 14 pid: 20361 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.437729:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9746 00000100:00100000:3.0:1746066823.437733:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985733248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.437738:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.437744:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 24 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.437756:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 24 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.437766:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14000/0xf1867c21abfb3120 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86d3 expref: 24 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.437773:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.437788:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985733248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.437793:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9746 00000100:00100000:3.0:1746066823.437803:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9747 00000100:00100000:3.0:1746066823.437807:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985732736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.437813:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.437819:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 14 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.437827:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 14 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.437837:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb8a00/0xf1867c21abfb2d92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d84db expref: 14 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.437846:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.437847:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.437851:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.437857:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066823.437858:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.437872:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066823.437879:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.437905:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985732736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.437910:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9747 00000100:00100000:3.0:1746066823.437918:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733504 00000100:00100000:3.0:1746066823.437920:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733504 00000100:00100000:1.0:1746066823.437926:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733120 00010000:00010000:3.0:1746066823.437929:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.437929:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733120 00000100:00100000:3.0:1746066823.437947:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9748 00000100:00100000:1.0:1746066823.437949:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.437952:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985733504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.437957:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.437963:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00100000:1.0:1746066823.437964:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (503808->1048575) req@ffff8800a5d82a00 x1830882985733120/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.437969:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830882985733120 ext(503808->1048575) 00010000:00010000:3.0:1746066823.437970:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.437973:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.437979:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 13 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.437981:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfb3127 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86da expref: 34 pid: 13726 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.437983:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82a00 00010000:00010000:3.0:1746066823.437988:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.437990:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.437992:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.437995:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2298 00010000:00010000:3.0:1746066823.437998:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.437999:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2014:x1830882985733120:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066823.438009:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.438023:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985733504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.438028:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9748 00010000:00010000:3.0:1746066823.438044:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438050:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438061:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438063:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438068:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438068:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438074:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438078:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438079:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066823.438081:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438082:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438085:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438087:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0da00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066823.438089:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438092:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438092:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438098:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438100:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.438101:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfb31f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.438106:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfb31f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.438124:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985732352:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8400us (8826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.438128:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21096 00000100:00100000:3.0:1746066823.438137:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985732096:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8761us (8882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.438143:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21095 00000100:00100000:1.0:1746066823.438145:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985228288:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.438155:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.438205:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.438275:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734016 00000100:00100000:1.0:1746066823.438278:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734016 00010000:00010000:1.0:1746066823.438287:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.438311:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9749 00000100:00100000:1.0:1746066823.438315:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882985734016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.438321:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.438327:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.438333:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.438342:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f6000/0xf1867c21abfb2e87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8560 expref: 33 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.438350:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.438362:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882985734016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.438366:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9749 00000100:00100000:2.0:1746066823.438461:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985227904:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.438469:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228416:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.438475:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228544:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.438481:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985228672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.438499:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.439596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.439621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.439647:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.439810:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734144 00000100:00100000:1.0:1746066823.439810:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733760 00000100:00100000:3.0:1746066823.439814:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734144 00000100:00100000:1.0:1746066823.439814:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733760 00010000:00010000:1.0:1746066823.439829:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 23 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746066823.439830:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.439854:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733632 00000100:00100000:1.0:1746066823.439856:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733632 00010000:00010000:1.0:1746066823.439863:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 35 pid: 12255 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.439873:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985733888 00000100:00100000:1.0:1746066823.439875:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985733888 00000100:00100000:2.0:1746066823.439903:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9750 00000100:00100000:2.0:1746066823.439915:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985733760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.439923:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.439933:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 23 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.439939:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 35 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.439943:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 23 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746066823.439947:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9751 00010000:00010000:2.0:1746066823.439956:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfb2f59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85f3 expref: 23 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746066823.439956:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985733632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066823.439961:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9752 00010000:00010000:0.0:1746066823.439964:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066823.439965:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985734144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.439970:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.439970:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.439972:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.439974:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 35 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.439975:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 35 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.439975:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.439981:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.439982:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 35 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.439995:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066823.440007:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 35 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.440017:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 10 pid: 1893 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.440020:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985733760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.440026:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9750 00000100:00100000:1.0:1746066823.440041:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9753 00000100:00100000:1.0:1746066823.440045:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985733888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.440050:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.440073:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfb2f13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->5074943) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85d0 expref: 35 pid: 12255 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.440075:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bda00/0xf1867c21abfb2fd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d864e expref: 35 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.440083:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066823.440084:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.440098:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985734144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.440104:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9752 00010000:00010000:0.0:1746066823.440104:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440110:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440121:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440128:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440133:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440141:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ba000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066823.440144:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.440157:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.440160:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 10 pid: 1893 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.440165:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.440168:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 10 pid: 1893 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746066823.440171:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfb320e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.440177:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfb3166 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8704 expref: 10 pid: 1893 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.440185:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.440198:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985733888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.440202:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985731968:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 9763us (10875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.440203:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9753 00000100:00100000:0.0:1746066823.440208:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21099 00000100:00100000:0.0:1746066823.440227:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882985733632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 276us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.440232:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9751 00000100:00100000:2.0:1746066823.442300:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.442524:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985732480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5332us (5916us total) trans 21474842856 rc 0/0 00000100:00100000:0.0:1746066823.442532:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2297 00002000:00100000:0.0:1746066823.442541:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1290239) req@ffff8800a5d80a80 x1830882985732480/t21474842856(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.442548:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830882985732480 ext(1048576->1290239) 00010000:00010000:0.0:1746066823.442555:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.442569:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746066823.442575:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80a80 00000100:00100000:0.0:1746066823.442599:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734272 00000100:00100000:0.0:1746066823.442604:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734272 00010000:00010000:0.0:1746066823.442618:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 15 pid: 12233 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.442641:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9754 00000100:00100000:0.0:1746066823.442646:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2016:x1830882985734272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066823.442654:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.442664:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 15 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.442672:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 15 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.442686:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb2fd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8647 expref: 15 pid: 12233 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.442695:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.442696:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.442699:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.442709:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.442729:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066823.442743:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985734272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.442748:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9754 00010000:00010000:2.0:1746066823.442779:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442787:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442800:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442806:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442811:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442816:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066823.442819:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442824:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442833:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.442838:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8400/0xf1867c21abfb3207 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.442877:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985732224:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12567us (13533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.442901:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21098 00000100:00100000:1.0:1746066823.443564:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2014:x1830882985733120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5562us (5682us total) trans 17179875511 rc 0/0 00000100:00100000:1.0:1746066823.443571:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2298 00002000:00100000:1.0:1746066823.443576:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (503808->1048575) req@ffff8800a5d82a00 x1830882985733120/t17179875511(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.443583:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830882985733120 ext(503808->1048575) 00010000:00010000:1.0:1746066823.443588:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.443596:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746066823.443601:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746066823.444975:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.445021:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734400 00000100:00100000:2.0:1746066823.445027:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734400 00010000:00010000:2.0:1746066823.445045:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.445084:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9755 00000100:00100000:2.0:1746066823.445090:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985734400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.445099:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.445110:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.445118:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.445133:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86ef expref: 22 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.445149:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.445151:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.445153:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.445160:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.445191:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.445221:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985734400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.445227:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9755 00010000:00010000:3.0:1746066823.445298:0:13726:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445307:0:13726:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445321:0:13726:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445390:0:13726:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445406:0:13726:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445413:0:13726:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066823.445416:0:13726:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445433:0:13726:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445453:0:13726:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.445458:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfb31eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.445548:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985731840:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 16825us (16945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.445557:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21094 00000100:00100000:0.0:1746066823.445987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.446026:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734528 00000100:00100000:2.0:1746066823.446030:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734528 00010000:00010000:2.0:1746066823.446044:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.446072:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9756 00000100:00100000:2.0:1746066823.446077:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+14:2016:x1830882985734528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.446084:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.446093:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.446101:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.446112:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c15000/0xf1867c21abfb312e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d86e1 expref: 14 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.446122:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.446123:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.446125:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.446131:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.446157:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.446187:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985734528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.446193:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9756 00010000:00010000:3.0:1746066823.446271:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446279:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446291:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446297:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446304:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446315:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066823.446318:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446350:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446361:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.446367:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfb3200 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.446446:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985731712:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 16238us (17129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.446453:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21097 00000100:00100000:0.0:1746066823.447832:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.447875:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734784 00000100:00100000:1.0:1746066823.447880:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734784 00000100:00100000:1.0:1746066823.447927:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17410 00000100:00100000:1.0:1746066823.447932:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+12:3778:x1830882985734784:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066823.447966:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.447981:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb400/0xf1867c21abfb31b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d873c expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448006:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.448009:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066823.448028:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.448042:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448049:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448055:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448061:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 40 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448065:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448071:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.448092:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448101:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 21 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.448113:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985228800:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.448189:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 40 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448197:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 40 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.448208:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985228928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.448229:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448235:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.448259:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229056:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.448279:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448286:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 21 pid: 10125 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.448292:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229184:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.448307:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.448313:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 21 pid: 7245 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.448319:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.448330:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.450207:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985228800:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.450217:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985228928:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.450225:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.450751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.450820:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735040 00000100:00100000:2.0:1746066823.450826:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735040 00010000:00010000:2.0:1746066823.450847:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 41 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.451066:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9757 00000100:00100000:2.0:1746066823.451073:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985735040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.451083:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.451088:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 41 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.451097:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 41 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.451112:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7800/0xf1867c21abfb2fb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8632 expref: 41 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.451123:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.451126:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.451134:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.451362:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985735040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 288us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.451369:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9757 00000100:00100000:0.0:1746066823.452394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.452407:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.452414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.452432:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.452442:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985734912 00000100:00100000:0.0:1746066823.452445:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985734912 00010000:00010000:0.0:1746066823.452457:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 22 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.452467:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735168 00000100:00100000:0.0:1746066823.452469:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735168 00010000:00010000:0.0:1746066823.452473:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.452478:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735296 00000100:00100000:0.0:1746066823.452479:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735296 00010000:00010000:0.0:1746066823.452484:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 23 pid: 7245 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.452488:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735424 00000100:00100000:0.0:1746066823.452489:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735424 00010000:00010000:0.0:1746066823.452493:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 24 pid: 10125 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.452497:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9758 00000100:00100000:0.0:1746066823.452500:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985734912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066823.452505:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.452507:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 24 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452512:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 24 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452520:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfb301d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8663 expref: 24 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452529:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066823.452531:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.452534:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066823.452552:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985734912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.452555:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9758 00000100:00100000:0.0:1746066823.452567:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9759 00000100:00100000:0.0:1746066823.452570:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985735168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066823.452573:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.452575:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452580:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452586:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfb2efe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d85bb expref: 40 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452591:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066823.452593:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.452596:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.452600:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229184:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.452602:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985735168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.452605:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9759 00000100:00100000:1.0:1746066823.452610:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985229312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.452612:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9760 00000100:00100000:0.0:1746066823.452615:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985735296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066823.452618:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066823.452620:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 22 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746066823.452624:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 22 pid: 7245 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.452628:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9761 00010000:00010000:0.0:1746066823.452632:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b400/0xf1867c21abfb2dd8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8505 expref: 22 pid: 7245 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.452633:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.452637:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066823.452639:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.452642:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.452643:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985735424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066823.452648:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985735296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.452651:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9760 00010000:00010000:3.0:1746066823.452656:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.452665:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 20 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.452677:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 20 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.452694:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2800/0xf1867c21abfb2e02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8513 expref: 20 pid: 10125 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.452706:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.452710:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.452718:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.452725:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.452765:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066823.452791:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.452797:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.452815:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985735424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.452821:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9761 00000040:00080000:1.0:1746066823.453001:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1302, 88 off122168 00000004:00080000:1.0:1746066823.453007:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664123449ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453045:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1300, 88 off121904 00000004:00080000:1.0:1746066823.453050:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664166639ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453069:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1301, 88 off121992 00000004:00080000:1.0:1746066823.453073:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664189852ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453081:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1303, 88 off122256 00000004:00080000:1.0:1746066823.453083:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664199592ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453089:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1304, 88 off122344 00000004:00080000:1.0:1746066823.453092:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664208834ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453099:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1302, 88 off122080 00000004:00080000:1.0:1746066823.453101:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664218154ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453108:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1303, 88 off122168 00000004:00080000:1.0:1746066823.453111:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664227884ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453117:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1304, 88 off122256 00000004:00080000:1.0:1746066823.453121:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664237874ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453128:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1305, 88 off122432 00000004:00080000:1.0:1746066823.453130:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664246984ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453137:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1305, 88 off122344 00000004:00080000:1.0:1746066823.453139:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664256004ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453146:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1306, 88 off122520 00000004:00080000:1.0:1746066823.453148:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664264830ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453558:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1306, 88 off122432 00000004:00080000:1.0:1746066823.453562:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664679164ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066823.453591:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1307, 88 off122608 00000004:00080000:1.0:1746066823.453594:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664711187ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453616:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1308, 88 off122696 00000004:00080000:1.0:1746066823.453620:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664736390ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453627:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1309, 88 off122784 00000004:00080000:1.0:1746066823.453629:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664746269ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453728:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1311, 88 off122968 00000004:00080000:1.0:1746066823.453732:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791664849035ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066823.453744:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1307, 88 off122520 00000004:00080000:1.0:1746066823.453747:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791664863392ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066823.456277:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937934 is committed 00000004:00080000:0.0:1746066823.456285:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1281 committed 00000004:00080000:0.0:1746066823.456299:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1286 committed 00000004:00080000:0.0:1746066823.456316:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1285 committed 00000004:00080000:0.0:1746066823.456318:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1284 committed 00000004:00080000:0.0:1746066823.456319:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1283 committed 00000004:00080000:0.0:1746066823.456321:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1280 committed 00000004:00080000:0.0:1746066823.456322:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1282 committed 00000004:00080000:0.0:1746066823.456323:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1279 committed 00000004:00080000:0.0:1746066823.456325:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1281 committed 00000004:00080000:0.0:1746066823.456327:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1278 committed 00000004:00080000:0.0:1746066823.456328:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1277 committed 00000004:00080000:0.0:1746066823.456330:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1276 committed 00000004:00080000:0.0:1746066823.456332:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1280 committed 00000004:00080000:0.0:1746066823.456333:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1279 committed 00000004:00080000:0.0:1746066823.456334:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1275 committed 00000004:00080000:0.0:1746066823.456336:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1274 committed 00000004:00080000:0.0:1746066823.456337:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1278 committed 00000001:00080000:0.0:1746066823.456345:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937931 is committed 00000001:00080000:0.0:1746066823.456351:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937930 is committed 00000100:00100000:3.0:1746066823.456498:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985229568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.456533:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985229824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.456562:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.456593:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985230080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.456609:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985229696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.456621:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985229568 00000100:00100000:3.0:1746066823.456627:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985229568 00000100:00100000:1.0:1746066823.456671:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985229440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.456675:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21100 00000100:00100000:3.0:1746066823.456682:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882985229568:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746066823.456721:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093c6b800 reply state ffff8800962e1800 transno 8589937934 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.456736:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00080000:0.0:1746066823.456738:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746066823.456742:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.456744:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066823.456747:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066823.456761:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.456794:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985230336:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746066823.456809:0:17253:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066823.456818:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.456821:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3778:x1830882985734784:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 8886us (9062us total) trans 8589937934 rc 0/0 00000100:00100000:3.0:1746066823.456823:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882985229568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (262us total) trans 21474842857 rc 0/0 00000100:00100000:1.0:1746066823.456828:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17410 00000100:00100000:3.0:1746066823.456830:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21100 00000100:00100000:2.0:1746066823.456830:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985230848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.456845:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985229824 00000100:00100000:2.0:1746066823.456845:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.456848:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985229824 00010000:00010000:1.0:1746066823.456851:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.456855:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985231360:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066823.456857:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.456863:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230336 00010000:00010000:1.0:1746066823.456863:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.456865:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230336 00000100:00100000:2.0:1746066823.456867:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066823.456868:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0153000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066823.456871:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.456877:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.456899:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230848 00000100:00100000:3.0:1746066823.456902:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230848 00010000:00010000:1.0:1746066823.456904:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.456905:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066823.456908:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.456909:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231360 00010000:00010000:1.0:1746066823.456913:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfb3215 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066823.456914:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231360 00000100:00100000:3.0:1746066823.456916:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21101 00000100:00100000:3.0:1746066823.456920:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3777:x1830882985229824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066823.456934:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21102 00000100:00100000:2.0:1746066823.456939:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21103 00000100:00100000:1.0:1746066823.456940:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3777:x1830882985230336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.456944:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3777:x1830882985230848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.456983:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3777:x1830882985229824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (400us total) trans 21474842858 rc 0/0 00000100:00100000:3.0:1746066823.456988:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21101 00000100:00100000:3.0:1746066823.456998:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21104 00000100:00100000:3.0:1746066823.457003:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3777:x1830882985231360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.457023:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066823.457031:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764e00/2, rc 0, transno 21474842858 00000100:00100000:2.0:1746066823.457036:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985229824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.457041:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985230592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457045:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3777:x1830882985230336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (226us total) trans 17179875512 rc 0/0 00000004:00080000:2.0:1746066823.457046:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d854700/2, rc 0, transno 17179875512 00000100:00100000:2.0:1746066823.457051:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985230336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457051:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21102 00000100:00100000:1.0:1746066823.457061:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230080 00000100:00100000:3.0:1746066823.457063:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.457063:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230080 00000100:00100000:1.0:1746066823.457073:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230592 00000100:00100000:1.0:1746066823.457075:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230592 00000100:00100000:3.0:1746066823.457079:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985231104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457082:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21105 00000100:00100000:1.0:1746066823.457084:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882985230080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.457096:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3777:x1830882985230848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (250us total) trans 17179875513 rc 0/0 00000100:00100000:3.0:1746066823.457098:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.457102:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21103 00000100:00100000:2.0:1746066823.457112:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231104 00000100:00100000:2.0:1746066823.457115:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231104 00000004:00080000:3.0:1746066823.457123:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5767b80/2, rc 0, transno 21474842857 00000100:00100000:2.0:1746066823.457126:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21106 00000100:00100000:3.0:1746066823.457128:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985229568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.457130:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882985230592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457137:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3775:x1830882985230080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (113us total) trans 21474842859 rc 0/0 00000004:00080000:3.0:1746066823.457138:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5767800/2, rc 0, transno 21474842859 00000100:00100000:3.0:1746066823.457141:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985230080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066823.457141:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21105 00000100:00100000:1.0:1746066823.457146:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21107 00000100:00100000:1.0:1746066823.457149:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882985231104:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.457178:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d854a80/2, rc 0, transno 17179875513 00000100:00100000:2.0:1746066823.457182:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985230848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457196:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882985231104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (97us total) trans 17179875515 rc 0/0 00000100:00100000:1.0:1746066823.457201:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21107 00002000:00010000:3.0:1746066823.457221:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:3.0:1746066823.457224:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066823.457226:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066823.457228:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066823.457229:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:3.0:1746066823.457275:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3777:x1830882985231360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 270us (406us total) trans 17179875516 rc 0/0 00000100:00100000:0.0:1746066823.457280:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.457284:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21104 00000100:00100000:3.0:1746066823.457295:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985229696 00000100:00100000:3.0:1746066823.457298:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985229696 00000100:00100000:0.0:1746066823.457304:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985230208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.457311:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21108 00000100:00100000:3.0:1746066823.457316:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3776:x1830882985229696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.457320:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.457332:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985230720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066823.457338:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230208 00000100:00100000:1.0:1746066823.457341:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230208 00000100:00100000:0.0:1746066823.457344:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.457352:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985231232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457355:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230720 00000100:00100000:1.0:1746066823.457357:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230720 00000100:00100000:0.0:1746066823.457364:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.457374:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231232 00000100:00100000:1.0:1746066823.457376:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231232 00000100:00100000:3.0:1746066823.457384:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3776:x1830882985229696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (103us total) trans 21474842860 rc 0/0 00000100:00100000:1.0:1746066823.457389:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21109 00000100:00100000:1.0:1746066823.457393:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985230208:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.457398:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764a80/2, rc 0, transno 21474842860 00000100:00100000:3.0:1746066823.457400:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21108 00000100:00100000:0.0:1746066823.457402:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985229696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.457413:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21110 00000100:00080000:0.0:1746066823.457413:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066823.457417:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3776:x1830882985230720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.457422:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.457435:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985229952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.457451:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.457453:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882985230208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (131us total) trans 17179875517 rc 0/0 00000100:00100000:1.0:1746066823.457458:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21109 00000100:00100000:0.0:1746066823.457459:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985230464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066823.457466:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985229440 00000100:00100000:1.0:1746066823.457469:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985229440 00000100:00100000:0.0:1746066823.457476:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.457477:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882985230720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (131us total) trans 21474842861 rc 0/0 00000100:00100000:1.0:1746066823.457477:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985229952 00000100:00100000:1.0:1746066823.457478:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985229952 00000100:00100000:3.0:1746066823.457483:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21110 00000100:00100000:0.0:1746066823.457484:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985230976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457487:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230464 00000100:00100000:1.0:1746066823.457488:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230464 00000100:00100000:3.0:1746066823.457496:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21111 00000100:00100000:0.0:1746066823.457497:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.457500:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21112 00000100:00100000:3.0:1746066823.457501:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882985231232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.457504:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882985229440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.457507:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985231488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.457519:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.457536:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985230976 00000100:00100000:0.0:1746066823.457538:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985230976 00000100:00100000:0.0:1746066823.457551:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231488 00000100:00100000:0.0:1746066823.457553:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231488 00000100:00100000:3.0:1746066823.457556:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3776:x1830882985231232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (191us total) trans 17179875518 rc 0/0 00000100:00100000:0.0:1746066823.457560:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21113 00000100:00100000:3.0:1746066823.457563:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21111 00000100:00100000:0.0:1746066823.457564:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985229952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066823.457565:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985229440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (142us total) trans 21474842862 rc 0/0 00000100:00100000:1.0:1746066823.457571:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21112 00000100:00100000:3.0:1746066823.457575:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21114 00000100:00100000:3.0:1746066823.457584:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882985230464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066823.457624:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3774:x1830882985229952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (171us total) trans 21474842863 rc 0/0 00000100:00100000:0.0:1746066823.457630:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21113 00000100:00100000:3.0:1746066823.457637:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3774:x1830882985230464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (159us total) trans 21474842864 rc 0/0 00000100:00100000:0.0:1746066823.457641:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21115 00000100:00100000:3.0:1746066823.457644:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21114 00000100:00100000:0.0:1746066823.457646:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882985230976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.457655:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21116 00000100:00100000:3.0:1746066823.457661:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882985231488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066823.457692:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:0.0:1746066823.457695:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066823.457702:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066823.457704:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066823.457706:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:3.0:1746066823.457720:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3774:x1830882985231488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (200us total) trans 17179875520 rc 0/0 00000100:00100000:3.0:1746066823.457726:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21116 00000100:00100000:0.0:1746066823.457729:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3774:x1830882985230976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (230us total) trans 17179875519 rc 0/0 00000100:00100000:0.0:1746066823.457733:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21115 00000004:00080000:0.0:1746066823.457755:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80380/2, rc 0, transno 17179875520 00000100:00100000:0.0:1746066823.457759:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985231488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066823.457766:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985230592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 636us (702us total) trans 17179875514 rc 0/0 00000004:00080000:0.0:1746066823.457767:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5766d80/2, rc 0, transno 21474842862 00000100:00100000:0.0:1746066823.457770:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985229440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.457772:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21106 00000004:00080000:0.0:1746066823.457776:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765180/2, rc 0, transno 21474842863 00000100:00100000:0.0:1746066823.457779:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985229952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066823.457786:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764380/2, rc 0, transno 21474842864 00000100:00100000:0.0:1746066823.457788:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985230464:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066823.457795:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d854000/2, rc 0, transno 17179875515 00000100:00100000:3.0:1746066823.457799:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985231104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.457801:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855c00/2, rc 0, transno 17179875519 00000100:00100000:0.0:1746066823.457804:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985230976:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066823.457809:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855f80/2, rc 0, transno 17179875514 00000100:00100000:3.0:1746066823.457812:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985230592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.457820:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855880/2, rc 0, transno 17179875517 00000100:00100000:0.0:1746066823.457823:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985230208:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.457830:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d857100/2, rc 0, transno 17179875516 00000004:00080000:0.0:1746066823.457830:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765500/2, rc 0, transno 21474842861 00000100:00100000:0.0:1746066823.457833:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985230720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.457834:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985231360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.457840:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d857800/2, rc 0, transno 17179875518 00000100:00100000:0.0:1746066823.457843:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985231232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.461305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.461403:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735552 00000100:00100000:1.0:1746066823.461411:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735552 00000100:00100000:1.0:1746066823.461450:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17411 00000100:00100000:1.0:1746066823.461457:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+7:3778:x1830882985735552:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066823.461474:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.461488:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8766 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.461532:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.461543:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.461557:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.461559:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066823.461562:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152c00, rc 0) 00000100:00100000:1.0:1746066823.461763:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3778:x1830882985735552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 305us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.461771:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17411 00000100:00100000:0.0:1746066823.463450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.463493:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735680 00000100:00100000:1.0:1746066823.463499:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735680 00000100:00100000:1.0:1746066823.463530:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17412 00000100:00100000:1.0:1746066823.463535:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3778:x1830882985735680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066823.463544:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.463553:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfb3223 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d876d expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.463610:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.463617:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.463623:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066823.463641:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066823.463644:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066823.463652:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.463665:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfb3223 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d876d expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.463674:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d876d expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.463678:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.463680:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066823.463681:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0153e00, rc 0) 00000100:00100000:1.0:1746066823.463712:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3778:x1830882985735680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 177us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.463717:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17412 00000100:00100000:2.0:1746066823.465329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.465348:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.465362:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.465375:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.465389:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735936 00000100:00100000:2.0:1746066823.465393:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735936 00000100:00100000:2.0:1746066823.465413:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736192 00000100:00100000:2.0:1746066823.465415:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736192 00000100:00100000:2.0:1746066823.465425:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736448 00000100:00100000:2.0:1746066823.465426:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736448 00000100:00100000:2.0:1746066823.465450:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985735808 00000100:00100000:2.0:1746066823.465452:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985735808 00000100:00100000:2.0:1746066823.465465:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21117 00000100:00100000:2.0:1746066823.465470:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985735936:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066823.465479:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.465489:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d877b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066823.465505:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd88, atime: 0x6812dd88, ctime: 0x6812dd88, blocks: 0x808 00010000:00010000:2.0:1746066823.465517:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.465518:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.465525:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.465536:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.465544:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6000, rc 0) 00000100:00100000:2.0:1746066823.465566:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985735936:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.465572:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21118 00000100:00100000:3.0:1746066823.465584:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985736192:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066823.465599:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.465615:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8789 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066823.465633:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd87, atime: 0x6812dd86, ctime: 0x6812dd87, blocks: 0x800 00010000:00010000:3.0:1746066823.465654:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.465656:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.465663:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.465676:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.465692:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb200, rc 0) 00000100:00100000:3.0:1746066823.465728:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985736192:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.465860:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21117 00000100:00100000:2.0:1746066823.465873:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21119 00000100:00100000:2.0:1746066823.465878:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+6:2016:x1830882985736448:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066823.465900:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21120 00010000:00010000:2.0:1746066823.465903:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066823.465907:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985735808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066823.465910:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8797 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.465912:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746066823.465922:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd88, atime: 0x6812dd88, ctime: 0x6812dd88, blocks: 0x1000 00010000:00010000:1.0:1746066823.465923:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8774 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.465929:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.465930:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.465934:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746066823.465934:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd88, atime: 0x6812dd88, ctime: 0x6812dd88, blocks: 0x800 00010000:00010000:1.0:1746066823.465941:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.465942:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.465942:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.465945:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.465948:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7c00, rc 0) 00010000:00010000:1.0:1746066823.465953:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.465956:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21118 00010000:00010000:1.0:1746066823.465958:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152200, rc 0) 00000100:00100000:2.0:1746066823.465965:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985736448:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 87us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.465969:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985735808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 64us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.465970:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21119 00000100:00100000:1.0:1746066823.465974:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21120 00000100:00100000:2.0:1746066823.465999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.466035:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736064 00000100:00100000:3.0:1746066823.466040:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736064 00000100:00100000:2.0:1746066823.466049:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.466069:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736320 00000100:00100000:2.0:1746066823.466071:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736320 00000100:00100000:2.0:1746066823.466093:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21121 00000100:00100000:2.0:1746066823.466099:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+7:2016:x1830882985736064:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066823.466105:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066823.466106:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21122 00000100:00100000:1.0:1746066823.466111:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985736320:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066823.466112:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8782 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.466117:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746066823.466121:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd87, atime: 0x6812dd84, ctime: 0x6812dd87, blocks: 0x800 00010000:00010000:1.0:1746066823.466123:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8790 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.466128:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.466129:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746066823.466131:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 5073344, mtime: 0x6812dd87, atime: 0x6812dd86, ctime: 0x6812dd87, blocks: 0x16b8 00010000:00010000:2.0:1746066823.466132:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.466137:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.466137:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.466140:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 8 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.466140:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.466146:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7400, rc 0) 00010000:00010000:1.0:1746066823.466147:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.466153:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152e00, rc 0) 00000100:00100000:2.0:1746066823.466159:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985736064:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.466163:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21121 00000100:00100000:1.0:1746066823.466163:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985736320:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 52us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.466167:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21122 00000100:00100000:2.0:1746066823.472381:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.472787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.473891:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736576 00000100:00100000:0.0:1746066823.473899:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736576 00000100:00100000:0.0:1746066823.473935:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736704 00000100:00100000:0.0:1746066823.473937:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736704 00000100:00100000:0.0:1746066823.473953:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21123 00000100:00100000:0.0:1746066823.473961:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985736576:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066823.474181:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21124 00000100:00100000:3.0:1746066823.474187:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985736704:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066823.474197:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985736576:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 236us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.474204:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21123 00000100:00100000:3.0:1746066823.474231:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985736704:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 44us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.474236:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21124 00000100:00100000:1.0:1746066823.474273:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.474330:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.474389:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736832 00000100:00100000:0.0:1746066823.474393:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736832 00000100:00100000:1.0:1746066823.474397:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.474412:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985736960 00000100:00100000:1.0:1746066823.474418:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985736960 00000100:00100000:0.0:1746066823.474419:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737088 00000100:00100000:0.0:1746066823.474421:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737088 00000100:00100000:2.0:1746066823.474440:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21125 00000100:00100000:0.0:1746066823.474517:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21126 00000100:00100000:0.0:1746066823.474524:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985737088:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066823.474568:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985737088:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.474573:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21126 00000100:00100000:1.0:1746066823.474662:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21127 00000100:00100000:1.0:1746066823.474670:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985736960:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066823.474708:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985736832:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066823.474748:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985736960:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 79us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.474749:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985736832:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 302us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.474754:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21127 00000100:00100000:2.0:1746066823.474762:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21125 00000100:00100000:1.0:1746066823.474845:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.474860:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737216 00000100:00100000:1.0:1746066823.474863:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737216 00000100:00100000:1.0:1746066823.474909:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21128 00000100:00100000:1.0:1746066823.475100:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985737216:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066823.475142:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985737216:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 227us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.475147:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21128 00000100:00100000:0.0:1746066823.476926:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.477029:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737344 00000100:00100000:1.0:1746066823.477033:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737344 00000100:00100000:1.0:1746066823.477118:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21129 00000100:00100000:1.0:1746066823.477123:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985737344:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066823.477183:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985737344:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 59us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.477188:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21129 00000100:00100000:0.0:1746066823.477775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.478858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.478870:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.478875:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737600 00000100:00100000:1.0:1746066823.478879:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737472 00000100:00100000:0.0:1746066823.478879:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737600 00000100:00100000:1.0:1746066823.478892:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737472 00000100:00100000:2.0:1746066823.479051:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737856 00000100:00100000:2.0:1746066823.479056:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737856 00000100:00100000:1.0:1746066823.479108:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21130 00000100:00100000:1.0:1746066823.479115:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985737472:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066823.479135:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21131 00000100:00100000:2.0:1746066823.479142:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985737600:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066823.479172:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985737472:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 58us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.479177:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985737600:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 37us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.479177:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21130 00000100:00100000:2.0:1746066823.479182:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21131 00000100:00100000:1.0:1746066823.479188:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21132 00000100:00100000:1.0:1746066823.479192:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985737856:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066823.479226:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985737856:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.479231:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21132 00000100:00100000:1.0:1746066823.479305:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.479505:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737728 00000100:00100000:2.0:1746066823.479508:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737728 00000100:00100000:2.0:1746066823.479525:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21133 00000100:00100000:2.0:1746066823.479529:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985737728:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066823.479588:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985737728:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.479592:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21133 00000100:00100000:1.0:1746066823.479789:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.480068:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985737984 00000100:00100000:0.0:1746066823.480072:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985737984 00000100:00100000:0.0:1746066823.480088:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21134 00000100:00100000:0.0:1746066823.480092:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985737984:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066823.480129:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985737984:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.480134:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21134 00000100:00100000:0.0:1746066823.486743:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.487445:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985738240 00000100:00100000:1.0:1746066823.487455:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985738240 00000100:00100000:1.0:1746066823.487514:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8040 00000100:00100000:1.0:1746066823.487521:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985738240:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066823.487556:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.487570:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.487572:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.487576:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.487588:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.489478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.490693:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985738496 00000100:00100000:0.0:1746066823.490702:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985738496 00000100:00100000:0.0:1746066823.490751:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17413 00000100:00100000:0.0:1746066823.490758:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:3783:x1830882985738496:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066823.490778:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.490793:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfb3262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d879e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.490851:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.490862:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.490871:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.490900:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.490907:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.490913:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.491000:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.491009:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.491015:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.491040:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.491049:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 8 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.491060:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985231616:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.492268:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.493486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.493515:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.494259:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985738880 00000100:00100000:2.0:1746066823.494267:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985738880 00000100:00100000:1.0:1746066823.494317:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985739136 00000100:00100000:1.0:1746066823.494325:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985739136 00000100:00100000:2.0:1746066823.494352:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8041 00000100:00100000:2.0:1746066823.494360:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985738880:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066823.494386:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.494398:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066823.494399:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8042 00010000:00010000:2.0:1746066823.494400:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.494404:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.494414:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.494687:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.494702:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985739008 00000100:00100000:0.0:1746066823.494705:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985739008 00000100:00100000:1.0:1746066823.494756:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985739136:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066823.494784:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.494795:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.494797:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.494801:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.494812:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.495496:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8043 00000100:00100000:1.0:1746066823.495502:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985739008:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066823.495519:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.495525:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.495527:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.495529:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.495571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.495592:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985739392 00000100:00100000:0.0:1746066823.495595:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985739392 00000100:00100000:3.0:1746066823.495600:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.495621:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985739520 00000100:00100000:0.0:1746066823.495623:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985739520 00000100:00100000:0.0:1746066823.495636:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8044 00000100:00100000:0.0:1746066823.495640:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985739392:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066823.495654:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.495661:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.495662:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.495665:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.495673:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.495691:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8045 00000100:00100000:3.0:1746066823.495699:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985739520:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066823.495716:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.495725:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.495727:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.495730:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.495740:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.498521:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.500935:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.500953:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.500961:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.500968:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0153a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066823.500973:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.500982:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.501001:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.501008:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfb325b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.501077:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985738240:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 13550us (14339us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.501088:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8040 00000100:00100000:2.0:1746066823.502175:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.502220:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.502386:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740032 00000100:00100000:3.0:1746066823.502395:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740032 00010000:00010000:3.0:1746066823.502428:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 9 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.502468:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9762 00000100:00100000:3.0:1746066823.502475:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985740032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.502488:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.502494:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 9 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.502504:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 9 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.502525:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.502529:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.502538:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.502545:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.502560:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.502592:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985740032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.502598:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9762 00010000:00010000:0.0:1746066823.503068:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bba00/0xf1867c21abfb31dd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d875f expref: 8 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746066823.503086:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985231616:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066823.503104:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503112:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503117:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066823.503133:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:0.0:1746066823.503227:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503234:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503272:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503277:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0d600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066823.503281:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503286:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503294:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066823.503296:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066823.503298:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503302:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfb3277 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503317:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503322:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503327:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503334:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503338:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066823.503340:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503345:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503352:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066823.503354:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066823.503356:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503360:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfb3269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503367:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503372:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503376:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503380:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066823.503382:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503387:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503396:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097855b00) 00010000:00010000:0.0:1746066823.503398:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066823.503400:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503404:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfb3270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.503446:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfb3262 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d879e expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.503453:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfb3262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d879e expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.503460:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0ce00, rc 0) 00000100:00100000:0.0:1746066823.503482:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:3783:x1830882985738496:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12725us (14012us total) trans 8589937935 rc 301/301 00000100:00100000:0.0:1746066823.503488:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17413 00000100:00100000:1.0:1746066823.503566:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985739904 00000100:00100000:1.0:1746066823.503571:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985739904 00000100:00100000:1.0:1746066823.503619:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8046 00000100:00100000:1.0:1746066823.503626:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985739904:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066823.503654:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.503666:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.503668:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.503674:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.503684:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506132:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506148:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506155:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506161:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009575a200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066823.506165:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506172:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506190:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.506196:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfb327e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.506274:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985738880:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11909us (12790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066823.506567:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8041 00010000:00010000:2.0:1746066823.507862:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507874:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507880:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507910:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066823.507914:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507920:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507934:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.507939:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9c00/0xf1867c21abfb3285 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.508542:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985739136:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 13591us (14480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.508553:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8042 00010000:00010000:0.0:1746066823.510630:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510645:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510755:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510762:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5771c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066823.510766:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510774:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510793:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.510798:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfb3293 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.510874:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985739392:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 15228us (15300us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066823.510918:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8044 00010000:00010000:1.0:1746066823.514509:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514527:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514535:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514542:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066823.514546:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514553:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514572:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.514578:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfb328c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.514941:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985739008:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19430us (20246us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.514951:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8043 00010000:00010000:3.0:1746066823.520964:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.520981:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.520991:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.520998:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984bb000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066823.521003:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.521011:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.521031:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.521037:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfb329a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.521196:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985739520:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 25492us (25589us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066823.521206:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8045 00010000:00010000:1.0:1746066823.521951:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.521963:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.521970:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.521976:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066823.521979:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.521986:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.521998:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.522004:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfb32a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.522066:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985739904:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18439us (19893us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.522072:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8046 00000100:00100000:0.0:1746066823.541590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.541663:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740288 00000100:00100000:2.0:1746066823.541672:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740288 00000100:00100000:2.0:1746066823.541731:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17414 00000100:00100000:2.0:1746066823.541739:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3778:x1830882985740288:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066823.541787:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.541812:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfb322a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d876d expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.541839:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.541843:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066823.541912:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.543305:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.543321:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00010000:2.0:1746066823.543436:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5b00700 reply state ffff88009412d000 transno 8589937936 ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.543445:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.543450:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.543452:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746066823.543454:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066823.543558:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3778:x1830882985740288:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 1818us (1978us total) trans 8589937936 rc 0/0 00000100:00100000:2.0:1746066823.543565:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17414 00000100:00100000:0.0:1746066823.548102:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.548568:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740544 00000100:00100000:1.0:1746066823.548577:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740544 00000100:00100000:1.0:1746066823.548630:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17415 00000100:00100000:1.0:1746066823.548638:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:3786:x1830882985740544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.548665:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.548681:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb32b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87a5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.548753:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.548765:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.548775:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.548787:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.548792:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.548797:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549378:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549386:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549392:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066823.549400:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066823.549676:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549686:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549692:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549697:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066823.549700:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549706:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549956:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.549958:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066823.549963:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.549968:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550155:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550392:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550397:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550400:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550404:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066823.550406:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550410:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550416:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066823.550418:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066823.550420:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550424:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfb32bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550432:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550436:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550440:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550443:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066823.550445:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550449:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550454:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096476700) 00010000:00010000:1.0:1746066823.550456:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066823.550458:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550464:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfb32c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.550505:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb32b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87a5 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.550511:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfb32b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87a5 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.550518:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05e00, rc 0) 00000100:00100000:1.0:1746066823.550574:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:3786:x1830882985740544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1935us (2480us total) trans 8589937937 rc 301/301 00000100:00100000:1.0:1746066823.550581:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17415 00000100:00100000:1.0:1746066823.550931:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.550968:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.550973:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741440 00000100:00100000:1.0:1746066823.550996:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.551010:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741440 00000100:00100000:1.0:1746066823.551025:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.551127:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17416 00000100:00100000:2.0:1746066823.551134:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:3783:x1830882985741440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.551146:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.551155:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb32d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87ac expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.551188:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb32d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ac expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.551227:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740800 00000100:00100000:3.0:1746066823.551231:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740800 00000100:00100000:0.0:1746066823.551231:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741056 00000100:00100000:0.0:1746066823.551236:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741056 00000100:00100000:1.0:1746066823.551253:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.551277:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740672 00000100:00100000:0.0:1746066823.551280:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740672 00000100:00100000:0.0:1746066823.551290:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741312 00000100:00100000:0.0:1746066823.551292:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741312 00000100:00100000:0.0:1746066823.551303:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21135 00000100:00100000:0.0:1746066823.551307:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985740800:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066823.551356:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21136 00000100:00100000:3.0:1746066823.551363:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985741056:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066823.551395:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21137 00000100:00100000:1.0:1746066823.551401:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985740672:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066823.551410:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066823.551413:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551415:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551417:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551419:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746066823.551431:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066823.551434:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066823 -> 1746066824 00002000:00010000:3.0:1746066823.551436:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066822 -> 1746066824 00002000:00010000:3.0:1746066823.551438:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066823 -> 1746066824 00002000:00010000:3.0:1746066823.551440:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066823.551441:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985740800:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 133us (473us total) trans 21474842865 rc 0/0 00002000:00010000:1.0:1746066823.551446:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746066823.551446:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21135 00002000:00010000:1.0:1746066823.551448:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.551450:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.551451:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.551453:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066823.551459:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21138 00000100:00100000:3.0:1746066823.551460:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985741056:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 98us (464us total) trans 17179875521 rc 0/0 00000100:00100000:0.0:1746066823.551463:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985741312:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066823.551466:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21136 00000100:00100000:1.0:1746066823.551466:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985740672:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 67us (441us total) trans 17179875522 rc 0/0 00000100:00100000:1.0:1746066823.551472:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21137 00000100:00100000:1.0:1746066823.551497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066823.551498:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066823.551500:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551502:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551504:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:0.0:1746066823.551505:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066823.551507:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985740928 00000100:00100000:3.0:1746066823.551509:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985740928 00000100:00100000:0.0:1746066823.551519:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985741312:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 56us (266us total) trans 21474842866 rc 0/0 00000100:00100000:3.0:1746066823.551524:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21139 00000100:00100000:3.0:1746066823.551528:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985740928:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066823.551528:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21138 00000100:00100000:1.0:1746066823.551537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.551576:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb32d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ac expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.551592:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.551594:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066823.551596:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b200, rc 0) 00000100:00100000:2.0:1746066823.551617:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3783:x1830882985741440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 485us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.551622:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17416 00002000:00010000:3.0:1746066823.552053:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066823.552055:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066823 -> 1746066824 00002000:00010000:3.0:1746066823.552057:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066820 -> 1746066824 00000100:00100000:1.0:1746066823.552057:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741184 00002000:00010000:3.0:1746066823.552059:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066823 -> 1746066824 00000100:00100000:1.0:1746066823.552060:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741184 00002000:00010000:3.0:1746066823.552061:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066823.552076:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21140 00000100:00100000:3.0:1746066823.552078:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985740928:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 549us (580us total) trans 21474842867 rc 0/0 00000100:00100000:1.0:1746066823.552081:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985741184:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066823.552083:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21139 00002000:00010000:1.0:1746066823.552274:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:1.0:1746066823.552276:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066823 -> 1746066824 00002000:00010000:1.0:1746066823.552278:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066822 -> 1746066824 00002000:00010000:1.0:1746066823.552280:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066823 -> 1746066824 00002000:00010000:1.0:1746066823.552281:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:1.0:1746066823.552314:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985741184:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 232us (775us total) trans 17179875523 rc 0/0 00000100:00100000:1.0:1746066823.552319:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21140 00000100:00100000:0.0:1746066823.553181:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.553530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.553692:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.553722:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741952 00000100:00100000:2.0:1746066823.553727:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741952 00000100:00100000:2.0:1746066823.553757:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17417 00000100:00100000:3.0:1746066823.553763:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985741696 00000100:00100000:2.0:1746066823.553764:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3783:x1830882985741952:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066823.553767:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985741696 00010000:00010000:2.0:1746066823.553781:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.553785:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1746066823.553795:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742208 00000100:00100000:3.0:1746066823.553798:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742208 00010000:00010000:2.0:1746066823.553808:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb32d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ac expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.553813:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6599 00000100:00100000:3.0:1746066823.553818:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3786:x1830882985741696:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:2.0:1746066823.553841:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.553845:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.553863:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6600 00000100:00100000:2.0:1746066823.553872:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3778:x1830882985742208:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746066823.553963:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985742208:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 94us (270us total) trans 8589937939 rc 0/0 00000100:00100000:3.0:1746066823.553964:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3786:x1830882985741696:12345-192.168.204.16@tcp:35:cat.0 Request processed in 145us (784us total) trans 8589937938 rc 0/0 00000100:00100000:2.0:1746066823.553969:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6600 00000100:00100000:3.0:1746066823.553972:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6599 00010000:00010000:2.0:1746066823.553987:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb32e0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87b3 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.554020:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066823.554031:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.554038:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066823.554063:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.554071:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 9 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.554083:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985231744:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.554163:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.555051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.555154:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742464 00000100:00100000:3.0:1746066823.555159:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742464 00000100:00100000:2.0:1746066823.555410:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6601 00000100:00100000:2.0:1746066823.555418:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3778:x1830882985742464:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746066823.555526:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3778:x1830882985742464:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 108us (476us total) trans 8589937940 rc 0/0 00000100:00100000:2.0:1746066823.555532:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6601 00000100:00100000:0.0:1746066823.555962:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.556021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.556055:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742592 00000100:00100000:1.0:1746066823.556059:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742592 00000100:00100000:1.0:1746066823.556084:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17418 00000100:00100000:1.0:1746066823.556089:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:3786:x1830882985742592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.556099:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.556110:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfb32ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87ba expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.556162:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.556180:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066823.556185:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.556188:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742720 00000100:00100000:3.0:1746066823.556191:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742720 00010000:00010000:1.0:1746066823.556197:0:17253:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.556205:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.556205:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.556222:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9763 00000100:00100000:3.0:1746066823.556227:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985742720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.556234:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.556251:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.556261:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.556278:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.556282:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.556287:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.556293:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.556298:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.556304:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.556312:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.556322:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066823.556580:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfb321c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8766 expref: 11 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.556590:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985231744:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.556603:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066823.556608:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066823.556612:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000040:00080000:2.0:1746066823.556803:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1312, 88 off123056 00000004:00080000:2.0:1746066823.556808:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791767924547ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.556855:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1308, 88 off122608 00000004:00080000:2.0:1746066823.556858:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791767974652ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.556869:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1309, 88 off122696 00000004:00080000:2.0:1746066823.556871:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791767987697ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.556878:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1313, 88 off123144 00000004:00080000:2.0:1746066823.556880:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791767997262ns, next at 733263941116ns, rc = 0 00000100:00100000:3.0:1746066823.556902:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985742720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 653us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.556910:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9763 00000040:00080000:2.0:1746066823.556914:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1314, 88 off123232 00000004:00080000:2.0:1746066823.556916:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791768033067ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.556928:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1310, 88 off122784 00000004:00080000:2.0:1746066823.556930:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791768047119ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.557345:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1312, 88 off122968 00000004:00080000:2.0:1746066823.557361:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791768477257ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.557423:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1313, 88 off123056 00000004:00080000:2.0:1746066823.557426:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791768543219ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.557443:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1315, 88 off123320 00000004:00080000:2.0:1746066823.557447:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791768563320ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.557929:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1314, 88 off123144 00000004:00080000:2.0:1746066823.557933:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791769049469ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.557954:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1316, 88 off123408 00000004:00080000:2.0:1746066823.557957:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791769073794ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.557963:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1315, 88 off123232 00000004:00080000:2.0:1746066823.557966:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791769082332ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066823.557971:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1317, 88 off123496 00000004:00080000:2.0:1746066823.557974:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791769090464ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.557980:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1318, 88 off123584 00000004:00080000:2.0:1746066823.557982:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791769099249ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.557989:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1319, 88 off123672 00000004:00080000:2.0:1746066823.557992:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791769108809ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.557999:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1320, 88 off123760 00000004:00080000:2.0:1746066823.558001:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791769118250ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066823.558008:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1316, 88 off123320 00000004:00080000:2.0:1746066823.558010:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791769126995ns, next at 733263917711ns, rc = 0 00000001:00080000:1.0:1746066823.563467:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937941 is committed 00000004:00080000:1.0:1746066823.563481:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1289 committed 00000004:00080000:1.0:1746066823.563500:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1295 committed 00000004:00080000:1.0:1746066823.563505:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1294 committed 00000004:00080000:1.0:1746066823.563507:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1293 committed 00000004:00080000:1.0:1746066823.563508:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1292 committed 00000004:00080000:1.0:1746066823.563509:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1288 committed 00000004:00080000:1.0:1746066823.563511:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1291 committed 00000004:00080000:1.0:1746066823.563512:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1287 committed 00000004:00080000:1.0:1746066823.563514:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1290 committed 00000004:00080000:1.0:1746066823.563515:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1286 committed 00000004:00080000:1.0:1746066823.563516:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1285 committed 00000004:00080000:1.0:1746066823.563518:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1284 committed 00000004:00080000:1.0:1746066823.563519:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1289 committed 00000004:00080000:1.0:1746066823.563520:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1288 committed 00000004:00080000:1.0:1746066823.563522:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1283 committed 00000004:00080000:1.0:1746066823.563523:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1282 committed 00000004:00080000:1.0:1746066823.563524:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1287 committed 00000001:00080000:1.0:1746066823.563534:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937940 is committed 00010000:00010000:1.0:1746066823.563576:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563588:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563594:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563599:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009575bc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066823.563604:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563610:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563626:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066823.563629:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066823.563632:0:3761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563640:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066823.563644:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb32af lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.563829:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985231872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.563911:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.563938:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.563953:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.563969:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066823.563973:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.563989:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.564001:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564015:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.564037:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985231872 00000100:00100000:3.0:1746066823.564044:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985231872 00000100:00100000:3.0:1746066823.564075:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232384 00000100:00100000:3.0:1746066823.564077:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232384 00000100:00100000:3.0:1746066823.564086:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232256 00000100:00100000:3.0:1746066823.564087:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232256 00000100:00100000:3.0:1746066823.564097:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232768 00000100:00100000:3.0:1746066823.564098:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232768 00000100:00100000:3.0:1746066823.564110:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21141 00000100:00100000:3.0:1746066823.564116:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882985231872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.564155:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.564212:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746066823.564254:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746066823.564256:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232640:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066823.564258:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564260:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564262:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564264:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066823.564273:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.564294:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746066823.564297:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882985231872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (387us total) trans 21474842868 rc 0/0 00000100:00100000:2.0:1746066823.564299:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564304:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21141 00000100:00100000:2.0:1746066823.564315:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.564327:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564328:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232128 00000100:00100000:3.0:1746066823.564331:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232128 00000100:00100000:2.0:1746066823.564339:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066823.564346:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232640 00000100:00100000:3.0:1746066823.564348:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232640 00000100:00100000:3.0:1746066823.564355:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232000 00000100:00100000:3.0:1746066823.564357:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232000 00000100:00100000:3.0:1746066823.564364:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232512 00000100:00100000:3.0:1746066823.564366:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232512 00000100:00100000:2.0:1746066823.564370:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21142 00000100:00100000:3.0:1746066823.564377:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21143 00000100:00100000:2.0:1746066823.564380:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882985232384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564382:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882985232256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564435:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882985232256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (444us total) trans 21474842869 rc 0/0 00000100:00100000:3.0:1746066823.564439:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21143 00000100:00100000:3.0:1746066823.564449:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21144 00000100:00100000:3.0:1746066823.564452:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882985232768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564502:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3775:x1830882985232768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (486us total) trans 21474842871 rc 0/0 00000100:00100000:3.0:1746066823.564506:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21144 00000100:00100000:2.0:1746066823.564512:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882985232384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (556us total) trans 21474842870 rc 0/0 00000100:00100000:3.0:1746066823.564514:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21145 00000100:00100000:3.0:1746066823.564518:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882985232128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.564519:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21142 00002000:00010000:3.0:1746066823.564549:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066823.564551:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564553:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564555:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066823.564556:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066823.564576:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882985232128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (365us total) trans 21474842872 rc 0/0 00000100:00100000:3.0:1746066823.564580:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21145 00000100:00100000:3.0:1746066823.564588:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21146 00000100:00100000:3.0:1746066823.564591:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882985232640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066823.564622:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21147 00000100:00100000:2.0:1746066823.564628:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882985232000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564631:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882985232640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (357us total) trans 21474842873 rc 0/0 00000100:00100000:3.0:1746066823.564636:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21146 00000100:00100000:3.0:1746066823.564643:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21148 00000100:00100000:3.0:1746066823.564647:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882985232512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066823.564676:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066823.564680:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.564681:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.564683:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.564685:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066823.564688:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882985232512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (348us total) trans 21474842875 rc 0/0 00000100:00100000:3.0:1746066823.564692:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21148 00000100:00100000:2.0:1746066823.564706:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882985232000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (390us total) trans 21474842874 rc 0/0 00000100:00100000:2.0:1746066823.564712:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21147 00000004:00080000:3.0:1746066823.564728:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5764700/2, rc 0, transno 21474842869 00000100:00100000:3.0:1746066823.564732:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066823.564739:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967ab800/2, rc 0, transno 21474842871 00000100:00100000:3.0:1746066823.564742:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066823.564748:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5767100/2, rc 0, transno 21474842874 00000004:00080000:3.0:1746066823.564750:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765880/2, rc 0, transno 21474842868 00000100:00100000:2.0:1746066823.564753:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564754:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985231872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066823.564762:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5766300/2, rc 0, transno 21474842875 00000004:00080000:3.0:1746066823.564764:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5766a00/2, rc 0, transno 21474842870 00000100:00100000:2.0:1746066823.564766:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066823.564767:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066823.564776:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5765f80/2, rc 0, transno 21474842872 00000100:00100000:2.0:1746066823.564778:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066823.564784:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967ab100/2, rc 0, transno 21474842873 00000100:00100000:2.0:1746066823.564787:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985232640:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066823.564830:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.564838:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.564840:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066823.564843:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.564850:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.564854:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.564913:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb32e0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 31 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066823.564924:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.564958:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.564966:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.564968:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b600, rc 0) 00000100:00100000:3.0:1746066823.565003:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:3783:x1830882985741952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11240us (11474us total) trans 8589937941 rc 0/0 00000004:00200000:2.0:1746066823.565008:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:3.0:1746066823.565009:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17417 00000004:00200000:2.0:1746066823.565011:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066823.565025:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.565054:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfb32ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.565069:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.565076:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.565078:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746066823.565080:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04800, rc 0) 00000100:00100000:2.0:1746066823.565119:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:3786:x1830882985742592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9029us (9157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.565124:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17418 00000100:00100000:0.0:1746066823.565350:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.565380:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.565394:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.565400:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.565409:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.565421:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066823.565424:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066823.565425:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.565439:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.565441:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.565448:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.565456:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066823.565478:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066823.565482:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.565497:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.565855:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233024 00000100:00100000:2.0:1746066823.565857:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.565859:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233024 00000100:00100000:2.0:1746066823.565873:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.565879:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233536 00000100:00100000:1.0:1746066823.565897:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233536 00000100:00100000:1.0:1746066823.565907:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985232896 00000100:00100000:1.0:1746066823.565908:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985232896 00000100:00100000:2.0:1746066823.565909:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233152 00000100:00100000:2.0:1746066823.565913:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233152 00000100:00100000:1.0:1746066823.565915:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233408 00000100:00100000:1.0:1746066823.565917:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233408 00000100:00100000:1.0:1746066823.565925:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233280 00000100:00100000:1.0:1746066823.565926:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233280 00000100:00100000:2.0:1746066823.565930:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233792 00000100:00100000:2.0:1746066823.565932:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233792 00000100:00100000:1.0:1746066823.565935:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21149 00000100:00100000:1.0:1746066823.565940:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985233024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.565942:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21150 00000100:00100000:2.0:1746066823.565946:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882985233536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.565998:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21151 00000100:00100000:2.0:1746066823.566002:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985232896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066823.566007:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066823.566010:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.566012:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.566014:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:1.0:1746066823.566015:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066823.566037:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985233024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (656us total) trans 17179875524 rc 0/0 00000100:00100000:1.0:1746066823.566042:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21149 00002000:00010000:2.0:1746066823.566044:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066823.566047:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.566049:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.566051:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00000100:00100000:1.0:1746066823.566051:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21152 00002000:00010000:2.0:1746066823.566052:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066823.566054:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985233408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.566074:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985232896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (648us total) trans 17179875526 rc 0/0 00000100:00100000:2.0:1746066823.566079:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21151 00002000:00010000:1.0:1746066823.566084:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:1.0:1746066823.566086:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066823.566088:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746066823.566089:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21153 00002000:00010000:1.0:1746066823.566090:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066823.566092:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066823.566093:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882985233152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566106:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985233408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (648us total) trans 17179875527 rc 0/0 00000100:00100000:1.0:1746066823.566110:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21152 00000100:00100000:1.0:1746066823.566118:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21154 00000100:00100000:1.0:1746066823.566121:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882985233280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566131:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21155 00002000:00010000:2.0:1746066823.566134:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00000100:00100000:1.0:1746066823.566134:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985233792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066823.566136:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.566138:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.566140:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066823.566141:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:2.0:1746066823.566159:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882985233152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (719us total) trans 17179875528 rc 0/0 00000100:00100000:2.0:1746066823.566163:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21153 00002000:00010000:1.0:1746066823.566167:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066823.566169:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066823.566171:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066823.566172:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066823.566174:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066823.566188:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985233792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (315us total) trans 17179875529 rc 0/0 00000100:00100000:1.0:1746066823.566193:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21155 00000100:00100000:1.0:1746066823.566253:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985233280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (754us total) trans 17179875530 rc 0/0 00000100:00100000:1.0:1746066823.566257:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21154 00000100:00100000:0.0:1746066823.566336:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066823.566358:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b03100/2, rc 0, transno 17179875524 00000100:00100000:0.0:1746066823.566364:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.566371:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00380/2, rc 0, transno 17179875528 00000100:00100000:0.0:1746066823.566374:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566478:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066823.566486:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985233920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566505:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066823.566523:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233664 00000100:00100000:1.0:1746066823.566525:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233664 00000100:00100000:1.0:1746066823.566537:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985233920 00000100:00100000:1.0:1746066823.566538:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985233920 00000100:00100000:1.0:1746066823.566548:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21156 00000100:00100000:1.0:1746066823.566551:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985233664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566603:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882985233664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (267us total) trans 17179875531 rc 0/0 00000100:00100000:1.0:1746066823.566608:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21156 00000100:00100000:1.0:1746066823.566616:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21157 00000100:00100000:1.0:1746066823.566620:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882985233920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066823.566676:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3774:x1830882985233920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (169us total) trans 17179875532 rc 0/0 00000100:00100000:1.0:1746066823.566681:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21157 00000004:00080000:1.0:1746066823.566698:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098925500/2, rc 0, transno 17179875532 00000100:00100000:1.0:1746066823.566701:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985233920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066823.566761:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b03480/2, rc 0, transno 17179875531 00000100:00100000:0.0:1746066823.566765:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066823.566781:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985233536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 834us (1371us total) trans 17179875525 rc 0/0 00000004:00080000:0.0:1746066823.566784:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00a80/2, rc 0, transno 17179875525 00000100:00100000:2.0:1746066823.566786:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21150 00000100:00100000:0.0:1746066823.566787:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985233536:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.566811:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01880/2, rc 0, transno 17179875530 00000100:00100000:2.0:1746066823.566814:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233280:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.566821:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b02d80/2, rc 0, transno 17179875529 00000100:00100000:2.0:1746066823.566823:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.566828:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b01f80/2, rc 0, transno 17179875526 00000100:00100000:2.0:1746066823.566830:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985232896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066823.566836:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b00000/2, rc 0, transno 17179875527 00000100:00100000:2.0:1746066823.566838:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985233408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066823.567231:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.567331:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742848 00000100:00100000:2.0:1746066823.567335:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742848 00000100:00100000:2.0:1746066823.567354:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21158 00000100:00100000:2.0:1746066823.567359:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3783:x1830882985742848:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.567368:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.567382:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87c1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.567401:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.567408:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.567410:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.567414:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1294336->1843199] (req 1294336->1843199) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.567435:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.567447:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 10 pid: 9590 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.567456:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985234048:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.567512:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.570073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.570095:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.570105:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.570112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.570288:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985234048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.570357:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743232 00000100:00100000:0.0:1746066823.570362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.570364:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743232 00000100:00100000:0.0:1746066823.570373:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.570404:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743488 00000100:00100000:3.0:1746066823.570407:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743488 00000100:00100000:3.0:1746066823.570422:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743104 00000100:00100000:3.0:1746066823.570424:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743104 00000100:00100000:1.0:1746066823.570431:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743360 00000100:00100000:1.0:1746066823.570434:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743360 00000100:00100000:3.0:1746066823.570435:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743616 00000100:00100000:3.0:1746066823.570437:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743616 00000100:00100000:3.0:1746066823.570450:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21159 00000100:00100000:1.0:1746066823.570455:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21160 00000100:00100000:1.0:1746066823.570460:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985743488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.570475:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.570490:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87dd expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.570508:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066823.570510:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.570510:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.570518:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.570520:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.570530:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87cf expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.570530:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.570540:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5ec00, rc 0) 00010000:00010000:3.0:1746066823.570543:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.570544:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.570549:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.570560:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.570568:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718ca00, rc 0) 00010000:00010000:2.0:1746066823.570586:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1294336->1843199] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.570598:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575aa00, rc 0) 00000100:00100000:0.0:1746066823.570631:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21161 00000100:00100000:0.0:1746066823.570636:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066823.570642:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.570649:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87c8 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.570666:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.570667:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.570672:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.570680:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.570687:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc0e800, rc 0) 00000100:00100000:3.0:1746066823.570944:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985743232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 486us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.570944:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985743488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 482us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.570950:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21160 00000100:00100000:3.0:1746066823.570953:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21159 00000100:00100000:1.0:1746066823.570965:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21162 00000100:00100000:3.0:1746066823.570968:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21163 00000100:00100000:1.0:1746066823.570969:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743616:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066823.570974:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.570974:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.570980:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.570980:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87e4 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.570986:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfb331f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87d6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.570989:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.570991:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.570994:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.571001:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.571003:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.571009:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfb331f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87d6 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.571009:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5e800, rc 0) 00010000:00010000:3.0:1746066823.571018:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfb331f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87d6 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066823.571021:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985743616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.571026:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21162 00010000:00010000:3.0:1746066823.571028:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718d600, rc 0) 00000100:00100000:3.0:1746066823.571044:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (682us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.571050:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21163 00000100:00100000:3.0:1746066823.571070:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985742976 00000100:00100000:3.0:1746066823.571072:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985742976 00010000:00010000:3.0:1746066823.571088:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 11 pid: 9590 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.571106:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9764 00000100:00100000:3.0:1746066823.571112:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985742976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.571120:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.571138:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 11 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.571148:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 11 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.571167:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7400/0xf1867c21abfb324d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8782 expref: 11 pid: 9590 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746066823.571175:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.571176:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.571181:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.571188:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.571205:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3783:x1830882985742848:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3846us (3975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.571211:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21158 00010000:00010000:3.0:1746066823.571213:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.571224:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985234176:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.571277:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.571341:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985743104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 704us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.571346:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21161 00000100:00100000:0.0:1746066823.571455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.571464:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985743744 00000100:00100000:0.0:1746066823.571467:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985743744 00000100:00100000:0.0:1746066823.571492:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21164 00000100:00100000:0.0:1746066823.571496:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985743744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066823.571502:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.571509:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87eb expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.571518:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.571519:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.571523:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 35 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.571532:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 35 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.571539:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5600, rc 0) 00000100:00100000:0.0:1746066823.571553:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985743744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.571558:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21164 00000100:00100000:3.0:1746066823.574220:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985234176:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.574250:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.574287:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985742976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3174us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.574298:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9764 00000100:00100000:0.0:1746066823.574689:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.574861:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985744000 00000100:00100000:1.0:1746066823.574866:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985744000 00002000:00100000:1.0:1746066823.574933:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1298431) req@ffff880098927800 x1830882985744000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.574943:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927800 with x1830882985744000 ext(1294336->1298431) 00002000:00010000:1.0:1746066823.574948:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098927800 00000100:00100000:1.0:1746066823.574973:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8047 00000100:00100000:1.0:1746066823.574979:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985744000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066823.575184:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985744000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 204us (496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066823.575190:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8047 00002000:00100000:1.0:1746066823.575195:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1298431) req@ffff880098927800 x1830882985744000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.575203:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927800 with x1830882985744000 ext(1294336->1298431) 00002000:00010000:1.0:1746066823.575206:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098927800 00000100:00100000:0.0:1746066823.579540:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.579645:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985744256 00000100:00100000:1.0:1746066823.579653:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985744256 00002000:00100000:1.0:1746066823.579689:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1839104->1843199) req@ffff880098927b80 x1830882985744256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.579700:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927b80 with x1830882985744256 ext(1839104->1843199) 00002000:00010000:1.0:1746066823.579704:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098927b80 00000100:00100000:1.0:1746066823.579736:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8048 00000100:00100000:1.0:1746066823.579743:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985744256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066823.579868:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882985744256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 125us (335us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066823.579875:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8048 00002000:00100000:1.0:1746066823.579881:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1839104->1843199) req@ffff880098927b80 x1830882985744256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.579910:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927b80 with x1830882985744256 ext(1839104->1843199) 00002000:00010000:1.0:1746066823.579912:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098927b80 00000100:00100000:0.0:1746066823.580015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.580083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.580112:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985744640 00000100:00100000:3.0:1746066823.580117:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985744640 00000100:00100000:2.0:1746066823.580121:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066823.580135:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009c775180 x1830882985744640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.580145:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775180 with x1830882985744640 ext(1048576->2097151) 00002000:00010000:3.0:1746066823.580147:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c775180 00000100:00100000:3.0:1746066823.580157:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985744768 00000100:00100000:3.0:1746066823.580158:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985744768 00002000:00100000:3.0:1746066823.580165:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098f54000 x1830882985744768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.580170:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54000 with x1830882985744768 ext(0->1048575) 00002000:00010000:3.0:1746066823.580171:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f54000 00000100:00100000:3.0:1746066823.580177:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985745024 00000100:00100000:3.0:1746066823.580179:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985745024 00002000:00100000:3.0:1746066823.580184:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1294335) req@ffff880098f55f80 x1830882985745024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066823.580184:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8049 00002000:00100000:3.0:1746066823.580189:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55f80 with x1830882985745024 ext(1048576->1294335) 00002000:00010000:3.0:1746066823.580190:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f55f80 00000100:00100000:0.0:1746066823.580193:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985744640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.580197:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8050 00000100:00100000:3.0:1746066823.580200:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985744768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.580387:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8051 00000100:00100000:2.0:1746066823.580395:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985745024:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.584047:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985745024:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3647us (3919us total) trans 0 rc 245760/245760 00000100:00100000:2.0:1746066823.584054:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8051 00002000:00100000:2.0:1746066823.584061:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1294335) req@ffff880098f55f80 x1830882985745024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 245760/245760 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.584067:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f55f80 with x1830882985745024 ext(1048576->1294335) 00002000:00010000:2.0:1746066823.584071:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098f55f80 00000100:00100000:3.0:1746066823.585846:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985744768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5640us (5758us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066823.585855:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8050 00002000:00100000:3.0:1746066823.585863:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098f54000 x1830882985744768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.585871:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f54000 with x1830882985744768 ext(0->1048575) 00002000:00010000:3.0:1746066823.585875:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098f54000 00000100:00100000:0.0:1746066823.587308:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.587380:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985745280 00000100:00100000:3.0:1746066823.587387:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985745280 00000100:00100000:3.0:1746066823.587416:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6602 00000100:00100000:3.0:1746066823.587422:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3783:x1830882985745280:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066823.587438:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985744640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7245us (7425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.587444:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8049 00002000:00100000:2.0:1746066823.587451:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009c775180 x1830882985744640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.587457:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775180 with x1830882985744640 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.587461:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c775180 00000100:00100000:3.0:1746066823.587580:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:3783:x1830882985745280:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 157us (273us total) trans 8589937942 rc 0/0 00000100:00100000:3.0:1746066823.587587:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6602 00000100:00100000:0.0:1746066823.589457:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.589506:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985745536 00000100:00100000:2.0:1746066823.589514:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985745536 00002000:00100000:2.0:1746066823.589542:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1843200->2097151) req@ffff88009c774380 x1830882985745536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.589551:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774380 with x1830882985745536 ext(1843200->2097151) 00002000:00010000:2.0:1746066823.589555:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774380 00000100:00100000:2.0:1746066823.589581:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8052 00000100:00100000:2.0:1746066823.589587:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985745536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.591723:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985745536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2130us (2268us total) trans 0 rc 253952/253952 00000100:00100000:2.0:1746066823.591732:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8052 00002000:00100000:2.0:1746066823.591740:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1843200->2097151) req@ffff88009c774380 x1830882985745536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.591749:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774380 with x1830882985745536 ext(1843200->2097151) 00002000:00010000:2.0:1746066823.591754:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774380 00000100:00100000:0.0:1746066823.592210:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.592267:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985745792 00000100:00100000:2.0:1746066823.592273:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985745792 00002000:00100000:2.0:1746066823.592298:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009c775880 x1830882985745792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.592306:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775880 with x1830882985745792 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.592309:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775880 00000100:00100000:2.0:1746066823.592331:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8053 00000100:00100000:2.0:1746066823.592337:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985745792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.597427:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985745792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5084us (5212us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.597436:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8053 00002000:00100000:2.0:1746066823.597444:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009c775880 x1830882985745792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.597450:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c775880 with x1830882985745792 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.597455:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c775880 00000100:00100000:0.0:1746066823.607149:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.607197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.607226:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985746048 00000100:00100000:2.0:1746066823.607248:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985746048 00000100:00100000:3.0:1746066823.607266:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985746304 00000100:00100000:3.0:1746066823.607273:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985746304 00002000:00100000:2.0:1746066823.607291:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009c776300 x1830882985746048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.607301:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776300 with x1830882985746048 ext(2097152->4194303) 00002000:00100000:3.0:1746066823.607306:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c774700 x1830882985746304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746066823.607306:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776300 00002000:00100000:3.0:1746066823.607315:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985746304 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.607319:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774700 00000100:00100000:2.0:1746066823.607340:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8054 00000100:00100000:2.0:1746066823.607346:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985746048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.607404:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8055 00000100:00100000:3.0:1746066823.607412:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985746304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066823.613386:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.613449:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985746560 00000100:00100000:2.0:1746066823.613457:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985746560 00000100:00100000:2.0:1746066823.613519:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17419 00000100:00100000:2.0:1746066823.613527:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3791:x1830882985746560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.613546:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.613562:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb332d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87f2 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.613625:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613636:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613646:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613657:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613666:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613670:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613755:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613763:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613768:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066823.613776:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066823.613833:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613839:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613843:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613849:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613853:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009575b000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.613856:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613861:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613873:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066823.613876:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.613879:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613913:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b000/0xf1867c21abfb3334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613931:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613936:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613940:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613944:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009575bc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.613946:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613951:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613957:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d891300) 00010000:00010000:2.0:1746066823.613959:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.613962:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613966:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfb333b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.613996:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfb332d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.614006:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.614012:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.614014:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066823.614016:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46fe00, rc 0) 00000100:00100000:2.0:1746066823.614054:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3791:x1830882985746560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 528us (673us total) trans 8589937943 rc 0/0 00000100:00100000:2.0:1746066823.614060:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17419 00000100:00100000:3.0:1746066823.626492:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985746304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19069us (19283us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066823.626504:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8055 00002000:00100000:3.0:1746066823.626517:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009c774700 x1830882985746304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.626526:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c774700 with x1830882985746304 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.626533:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c774700 00000100:00100000:0.0:1746066823.629292:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.629799:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985746816 00000100:00100000:3.0:1746066823.629808:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985746816 00000100:00100000:3.0:1746066823.629852:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6603 00000100:00100000:3.0:1746066823.629861:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3791:x1830882985746816:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066823.630101:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3791:x1830882985746816:12345-192.168.204.16@tcp:35:cat.0 Request processed in 239us (818us total) trans 8589937944 rc 0/0 00000100:00100000:3.0:1746066823.630107:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6603 00000100:00100000:2.0:1746066823.630190:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985746048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22842us (23051us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066823.630199:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8054 00002000:00100000:2.0:1746066823.630208:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009c776300 x1830882985746048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.630218:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c776300 with x1830882985746048 ext(2097152->4194303) 00002000:00010000:2.0:1746066823.630223:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c776300 00000100:00100000:0.0:1746066823.634448:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.634495:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.634512:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.634537:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.635325:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747840 00000100:00100000:3.0:1746066823.635336:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747840 00000100:00100000:3.0:1746066823.635388:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17420 00000100:00100000:3.0:1746066823.635396:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+11:3793:x1830882985747840:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746066823.635417:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747072 00000100:00100000:0.0:1746066823.635417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066823.635421:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066823.635427:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747072 00010000:00010000:3.0:1746066823.635439:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb3350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8823 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.635544:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066823.635546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066823.635560:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.635567:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.635573:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.635605:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.635617:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 12 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.635633:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985234304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.635673:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985746944 00000100:00100000:1.0:1746066823.635676:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985746944 00000100:00100000:1.0:1746066823.635694:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747200 00000100:00100000:2.0:1746066823.635696:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747456 00000100:00100000:1.0:1746066823.635696:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747200 00000100:00100000:2.0:1746066823.635701:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747456 00000100:00100000:1.0:1746066823.635705:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747328 00000100:00100000:1.0:1746066823.635707:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747328 00010000:00010000:3.0:1746066823.635727:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.635729:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21165 00010000:00010000:3.0:1746066823.635737:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 29 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.635737:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985747072:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066823.635738:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21166 00000100:00100000:3.0:1746066823.635744:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985234432:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.635745:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985746944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.635746:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.635757:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8800 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.635760:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.635772:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.635774:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.635775:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d87f9 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.635794:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.635795:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.635803:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066823.635808:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066823.635816:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.635826:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497e00, rc 0) 00000100:00100000:1.0:1746066823.635867:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985746944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.635873:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21166 00000100:00100000:1.0:1746066823.635914:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747584 00000100:00100000:1.0:1746066823.635917:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747584 00000100:00100000:1.0:1746066823.635940:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21167 00000100:00100000:1.0:1746066823.635945:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985747200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.635951:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066823.635955:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21168 00010000:00010000:1.0:1746066823.635959:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfb336c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8807 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.635961:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2013:x1830882985747456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066823.635970:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.635979:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8815 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.635990:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066823.635992:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985234560:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066823.635992:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066823.635998:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.636000:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00010000:00010000:0.0:1746066823.636009:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.636017:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5200, rc 0) 00000100:00100000:3.0:1746066823.636020:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21169 00000100:00100000:3.0:1746066823.636026:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985747328:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066823.636026:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066823.636033:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066823.636038:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985747456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (622us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066823.636040:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d880e expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.636044:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21168 00000100:00100000:1.0:1746066823.636049:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21170 00010000:00010000:3.0:1746066823.636051:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.636052:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066823.636054:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985747584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.636058:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 16 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.636059:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.636066:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 16 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.636066:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d881c expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.636073:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32a00, rc 0) 00010000:00010000:1.0:1746066823.636076:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.636077:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.636081:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 26 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.636090:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985747328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (543us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066823.636090:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 26 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.636096:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21169 00010000:00010000:1.0:1746066823.636097:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497800, rc 0) 00000100:00100000:1.0:1746066823.636113:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985747584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.636118:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21170 00010000:00010000:2.0:1746066823.636358:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.636371:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.636378:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a53a00, rc 0) 00000100:00100000:2.0:1746066823.636399:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985747072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 664us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.636404:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21165 00000100:00100000:0.0:1746066823.639731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.639860:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985234304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.639871:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985234432:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.639923:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066823.640351:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985234560:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066823.640380:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfb336c lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8807 expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.640392:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfb336c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8807 expref: 24 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066823.640460:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.640545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.640601:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985748096 00000100:00100000:2.0:1746066823.640608:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985748096 00010000:00010000:2.0:1746066823.640637:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 30 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.640668:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:2.0:1746066823.640685:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985747968 00000100:00100000:2.0:1746066823.640687:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985747968 00000100:00100000:3.0:1746066823.640694:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9765 00010000:00010000:2.0:1746066823.640697:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 13 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.640702:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985748096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.640715:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066823.640718:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985747200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4771us (6179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.640719:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9766 00010000:00010000:3.0:1746066823.640721:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 30 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.640724:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:2016:x1830882985747968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066823.640725:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21167 00010000:00010000:3.0:1746066823.640730:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 30 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.640731:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.640735:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 13 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.640748:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfb32f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87ba expref: 30 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.640750:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 13 pid: 17253 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.640762:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fe00/0xf1867c21abfb3342 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f2 expref: 13 pid: 17253 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.640769:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985748352 00010000:00010000:3.0:1746066823.640772:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:1.0:1746066823.640773:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985748352 00010000:00010000:3.0:1746066823.640777:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.640785:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.640790:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00002000:00100000:1.0:1746066823.640797:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a03d5500 x1830882985748352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.640805:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882985748352 ext(4194304->5074943) 00002000:00010000:1.0:1746066823.640808:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:1.0:1746066823.640820:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8056 00010000:00010000:2.0:1746066823.640821:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.640824:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.640824:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985748352:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066823.640829:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.640852:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985748096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 151us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.640852:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:2016:x1830882985747968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.640858:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9766 00000100:00100000:3.0:1746066823.640866:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9765 00010000:00010000:3.0:1746066823.640911:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.640916:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066823.640934:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.641048:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb3350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.641061:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.641066:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.641069:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066823.641071:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e362000, rc 0) 00000100:00100000:3.0:1746066823.641102:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3793:x1830882985747840:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5706us (6664us total) trans 8589937945 rc 0/0 00000100:00100000:3.0:1746066823.641107:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17420 00000100:00100000:1.0:1746066823.646701:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985748352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5863us (6144us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066823.646714:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8056 00002000:00100000:1.0:1746066823.646726:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a03d5500 x1830882985748352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.646736:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882985748352 ext(4194304->5074943) 00002000:00010000:1.0:1746066823.646742:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:3.0:1746066823.647760:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.647782:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985748480 00000100:00100000:3.0:1746066823.647789:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985748480 00000100:00100000:3.0:1746066823.647824:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17421 00000100:00100000:3.0:1746066823.647831:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3791:x1830882985748480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.647854:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.647872:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d882a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.647951:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.647965:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.647981:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.647984:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066823.647987:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33800, rc 0) 00000100:00100000:3.0:1746066823.648019:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3791:x1830882985748480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 189us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.648025:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17421 00000100:00100000:0.0:1746066823.654486:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.654595:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.654685:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985748736 00000100:00100000:2.0:1746066823.654691:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985748992 00000100:00100000:1.0:1746066823.654695:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985748736 00000100:00100000:2.0:1746066823.654697:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985748992 00002000:00100000:2.0:1746066823.654741:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a03d4000 x1830882985748992/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.654741:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a03d7100 x1830882985748736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.654752:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882985748992 ext(1048576->2097151) 00002000:00100000:1.0:1746066823.654756:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882985748736 ext(0->1048575) 00002000:00010000:2.0:1746066823.654758:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4000 00002000:00010000:1.0:1746066823.654760:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:2.0:1746066823.654897:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8057 00000100:00100000:2.0:1746066823.654905:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985748736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066823.654921:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8058 00000100:00100000:0.0:1746066823.654927:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985748992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.661342:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985748992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6403us (6734us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.661355:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8058 00002000:00100000:2.0:1746066823.661368:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a03d4000 x1830882985748992/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.661378:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882985748992 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.661385:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4000 00000100:00100000:2.0:1746066823.662250:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985748736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7344us (7773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.662257:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8057 00002000:00100000:2.0:1746066823.662263:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a03d7100 x1830882985748736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.662270:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882985748736 ext(0->1048575) 00002000:00010000:2.0:1746066823.662274:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:0.0:1746066823.665384:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.665619:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985749120 00000100:00100000:1.0:1746066823.665627:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985749120 00000100:00100000:1.0:1746066823.665681:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21171 00000100:00100000:1.0:1746066823.665689:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3793:x1830882985749120:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066823.665706:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.665723:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8831 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.665752:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.665760:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066823.665761:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066823.665765:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.665793:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.665804:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 34 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746066823.665821:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985234688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.665940:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.670209:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.670291:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985749248 00000100:00100000:2.0:1746066823.670300:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985749248 00002000:00100000:2.0:1746066823.670348:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1843199) req@ffff8800a03d7800 x1830882985749248/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066823.670358:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985234688:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746066823.670359:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882985749248 ext(1294336->1843199) 00010000:00010000:2.0:1746066823.670369:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 35 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.670382:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.670384:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 35 pid: 11630 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.670390:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d7800 00010000:00010000:1.0:1746066823.670397:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46800, rc 0) 00000100:00100000:2.0:1746066823.670424:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2299 00000100:00100000:2.0:1746066823.670432:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985749248:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066823.670446:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3793:x1830882985749120:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4758us (5073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.670453:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21171 00000100:00100000:2.0:1746066823.675947:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.675992:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985749376 00000100:00100000:1.0:1746066823.676000:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985749376 00000100:00100000:1.0:1746066823.676035:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21172 00000100:00100000:1.0:1746066823.676041:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3791:x1830882985749376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.676057:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.676071:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8838 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.676093:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066823.676097:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.676101:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066823.676104:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.676131:0:1893:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.676142:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.676148:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47600, rc 0) 00000100:00100000:1.0:1746066823.676188:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3791:x1830882985749376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.676191:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21172 00010000:00010000:3.0:1746066823.676371:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066823.677749:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985749248:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7310us (7544us total) trans 21474842876 rc 0/0 00000100:00100000:2.0:1746066823.677759:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2299 00002000:00100000:2.0:1746066823.677770:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1294336->1843199) req@ffff8800a03d7800 x1830882985749248/t21474842876(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.677781:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882985749248 ext(1294336->1843199) 00010000:00010000:2.0:1746066823.677791:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.677805:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.677813:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d7800 00000100:00100000:0.0:1746066823.682432:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.682958:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985749504 00000100:00100000:3.0:1746066823.682968:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985749504 00010000:00010000:3.0:1746066823.683008:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.683050:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9767 00000100:00100000:3.0:1746066823.683058:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985749504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.683072:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.683092:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.683109:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.683133:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575aa00/0xf1867c21abfb32fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1294336->1843199) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c1 expref: 37 pid: 11630 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.683292:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.683294:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.683302:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.683310:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.683346:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.683358:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 24 pid: 1893 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746066823.683370:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985234944:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.685328:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.687582:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985234944:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.687609:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066823.687643:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.687664:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985749504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4607us (5242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.687676:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9767 00000100:00100000:2.0:1746066823.687772:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985749760 00000100:00100000:2.0:1746066823.687779:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985749760 00002000:00100000:2.0:1746066823.687816:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->1908735) req@ffff8800a03d4a80 x1830882985749760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.687825:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882985749760 ext(1904640->1908735) 00010000:00010000:2.0:1746066823.687834:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.687847:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.687853:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4a80 00000100:00100000:2.0:1746066823.687910:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2300 00000100:00100000:2.0:1746066823.687918:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985749760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.688042:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985749760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 124us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.688048:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2300 00002000:00100000:2.0:1746066823.688054:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->1908735) req@ffff8800a03d4a80 x1830882985749760/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.688060:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882985749760 ext(1904640->1908735) 00010000:00010000:2.0:1746066823.688064:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.688073:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746066823.688079:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4a80 00000100:00100000:0.0:1746066823.691064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.691166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.691226:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750016 00000100:00100000:1.0:1746066823.691245:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750144 00000100:00100000:3.0:1746066823.691246:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750016 00000100:00100000:1.0:1746066823.691249:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750144 00000100:00100000:1.0:1746066823.691297:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21173 00000100:00100000:1.0:1746066823.691304:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3793:x1830882985750144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066823.691333:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.691350:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d883f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066823.691366:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->2097151) req@ffff8800a03d7480 x1830882985750016/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.691374:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985750016 ext(1904640->2097151) 00010000:00010000:1.0:1746066823.691378:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.691380:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.691385:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.691391:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 25 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746066823.691391:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.691396:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746066823.691397:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d7480 00010000:00010000:1.0:1746066823.691399:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.691401:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.691411:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2301 00000100:00100000:3.0:1746066823.691415:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985750016:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746066823.691430:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.691439:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 34 pid: 20361 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.691450:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235072:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.691534:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.691542:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.691549:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066823.691691:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.691699:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 12 pid: 13363 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.691706:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235328:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.691723:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.694790:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.694814:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d857480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.694824:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066823.694831:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882985235328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.694853:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066823.694859:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.694876:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47800, rc 0) 00000100:00100000:1.0:1746066823.694934:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3793:x1830882985750144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3630us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.694943:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21173 00000100:00100000:2.0:1746066823.695022:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750400 00000100:00100000:2.0:1746066823.695029:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750400 00010000:00010000:2.0:1746066823.695053:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 13 pid: 13363 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.695079:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750272 00000100:00100000:2.0:1746066823.695081:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750272 00010000:00010000:2.0:1746066823.695089:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746066823.695113:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9768 00000100:00100000:2.0:1746066823.695119:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985750400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.695130:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066823.695131:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9769 00000100:00100000:1.0:1746066823.695136:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985750272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.695142:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.695149:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 13 pid: 13363 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.695149:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.695158:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746066823.695316:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985750016:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3897us (4147us total) trans 21474842877 rc 0/0 00000100:00100000:3.0:1746066823.695325:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2301 00002000:00100000:3.0:1746066823.695333:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->2097151) req@ffff8800a03d7480 x1830882985750016/t21474842877(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.695342:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882985750016 ext(1904640->2097151) 00010000:00010000:3.0:1746066823.695349:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746066823.695485:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746066823.695492:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d7480 00010000:00010000:2.0:1746066823.695934:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 13 pid: 13363 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.695964:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfb3238 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8789 expref: 13 pid: 13363 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746066823.696011:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.696146:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985750400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1027us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.696153:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9768 00010000:00010000:1.0:1746066823.696716:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfb337a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d880e expref: 17 pid: 13726 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.696740:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.696761:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985750272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1624us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.696770:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9769 00000100:00100000:0.0:1746066823.697101:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.697154:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750528 00000100:00100000:1.0:1746066823.697163:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750528 00010000:00010000:1.0:1746066823.697178:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746066823.697200:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9770 00000100:00100000:1.0:1746066823.697205:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985750528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.697213:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.697226:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.697243:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.697256:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5ec00/0xf1867c21abfb3303 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87dd expref: 35 pid: 20361 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746066823.697266:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.697267:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.697273:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.697282:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.697310:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.697321:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985235456:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.697376:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.698486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.698639:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750656 00000100:00100000:2.0:1746066823.698644:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750656 00010000:00010000:2.0:1746066823.698663:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746066823.698682:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9771 00000100:00100000:2.0:1746066823.698687:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985750656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.698695:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.698707:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.698716:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.698730:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfb3396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8831 expref: 27 pid: 1893 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746066823.698741:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.698742:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.698746:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.698753:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.698774:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.698782:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985235584:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.699361:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.699661:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985235456:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066823.699674:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066823.699707:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985750528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2501us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066823.699715:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9770 00000100:00100000:0.0:1746066823.702039:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.702094:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985750912 00000100:00100000:3.0:1746066823.702102:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985750912 00002000:00100000:3.0:1746066823.702145:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1232896->1236991) req@ffff8800a03d5180 x1830882985750912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.702155:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5180 with x1830882985750912 ext(1232896->1236991) 00002000:00010000:3.0:1746066823.702159:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5180 00000100:00100000:3.0:1746066823.702176:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8059 00000100:00100000:3.0:1746066823.702182:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985750912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.702332:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985750912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.702336:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985235584:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066823.702338:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8059 00002000:00100000:3.0:1746066823.702344:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1232896->1236991) req@ffff8800a03d5180 x1830882985750912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.702351:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5180 with x1830882985750912 ext(1232896->1236991) 00002000:00010000:3.0:1746066823.702353:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5180 00010000:00010000:2.0:1746066823.702357:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.702381:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985750656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3693us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.702389:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9771 00000100:00100000:0.0:1746066823.703836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.704227:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985751168 00000100:00100000:2.0:1746066823.704245:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985751168 00002000:00100000:2.0:1746066823.704275:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a03d6300 x1830882985751168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.704284:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882985751168 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.704289:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6300 00000100:00100000:2.0:1746066823.704315:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8060 00000100:00100000:2.0:1746066823.704322:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985751168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.710712:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985751168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6377us (6866us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066823.710726:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8060 00002000:00100000:2.0:1746066823.710738:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a03d6300 x1830882985751168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.710748:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882985751168 ext(1048576->2097151) 00002000:00010000:2.0:1746066823.710755:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6300 00000100:00100000:0.0:1746066823.715229:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.715331:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985751424 00000100:00100000:2.0:1746066823.715341:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985751424 00002000:00100000:2.0:1746066823.715391:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1236992->2097151) req@ffff8800a03d5c00 x1830882985751424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.715401:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882985751424 ext(1236992->2097151) 00002000:00010000:2.0:1746066823.715406:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:2.0:1746066823.715440:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8061 00000100:00100000:2.0:1746066823.715448:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985751424:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.722396:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2013:x1830882985751424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6936us (7166us total) trans 0 rc 860160/860160 00000100:00100000:2.0:1746066823.722408:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8061 00002000:00100000:2.0:1746066823.722419:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1236992->2097151) req@ffff8800a03d5c00 x1830882985751424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 860160/860160 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.722712:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882985751424 ext(1236992->2097151) 00002000:00010000:2.0:1746066823.722718:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:0.0:1746066823.735067:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.735116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.735257:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985751936 00000100:00100000:2.0:1746066823.735267:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985751936 00002000:00100000:2.0:1746066823.735320:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a03d6a00 x1830882985751936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.735331:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882985751936 ext(2097152->4194303) 00002000:00010000:2.0:1746066823.735337:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6a00 00000100:00100000:2.0:1746066823.735354:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985751808 00000100:00100000:2.0:1746066823.735357:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985751808 00002000:00100000:2.0:1746066823.735370:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a03d7b80 x1830882985751808/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.735376:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7b80 with x1830882985751808 ext(2097152->4194303) 00002000:00010000:2.0:1746066823.735379:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d7b80 00000100:00100000:2.0:1746066823.735407:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8062 00000100:00100000:2.0:1746066823.735415:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985751936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.735416:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8063 00000100:00100000:3.0:1746066823.735425:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985751808:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.749158:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985751808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13721us (14028us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066823.749172:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8063 00002000:00100000:3.0:1746066823.749185:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a03d7b80 x1830882985751808/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.749194:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7b80 with x1830882985751808 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.749200:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d7b80 00000100:00100000:2.0:1746066823.753156:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985751936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17731us (18088us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066823.753170:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8062 00002000:00100000:2.0:1746066823.753182:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a03d6a00 x1830882985751936/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.753192:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882985751936 ext(2097152->4194303) 00002000:00010000:2.0:1746066823.753198:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6a00 00000100:00100000:0.0:1746066823.761773:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.762032:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985752192 00000100:00100000:2.0:1746066823.762043:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985752192 00002000:00100000:2.0:1746066823.762090:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a03d6d80 x1830882985752192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.762100:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882985752192 ext(4194304->5074943) 00002000:00010000:2.0:1746066823.762105:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:2.0:1746066823.762142:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8064 00000100:00100000:2.0:1746066823.762149:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985752192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.769929:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985752192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7767us (8153us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066823.769941:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8064 00002000:00100000:2.0:1746066823.769953:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a03d6d80 x1830882985752192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.769962:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882985752192 ext(4194304->5074943) 00002000:00010000:2.0:1746066823.769969:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:0.0:1746066823.811547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.812129:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985752448 00000100:00100000:3.0:1746066823.812140:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985752448 00000100:00100000:3.0:1746066823.812195:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17422 00000100:00100000:3.0:1746066823.812203:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:3798:x1830882985752448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.812230:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.812281:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32200/0xf1867c21abfb33ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8846 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.812356:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812368:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812379:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812391:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812396:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812400:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812505:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812513:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812518:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066823.812527:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.812594:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812599:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812605:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812610:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812616:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b32a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.812620:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812626:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812635:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.812638:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.812642:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812650:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812680:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812685:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812689:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812693:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097bc9000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.812696:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812700:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812706:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfd600) 00010000:00010000:3.0:1746066823.812707:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.812709:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812713:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9000/0xf1867c21abfb33b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.812749:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32200/0xf1867c21abfb33ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.812761:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.812770:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.812772:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.812774:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9800, rc 0) 00000100:00100000:3.0:1746066823.812835:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3798:x1830882985752448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 632us (1299us total) trans 8589937946 rc 0/0 00000100:00100000:3.0:1746066823.812842:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17422 00000100:00100000:0.0:1746066823.815730:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.819124:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985752576 00000100:00100000:1.0:1746066823.819137:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985752576 00000100:00100000:2.0:1746066823.820321:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21174 00000100:00100000:2.0:1746066823.820333:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:3798:x1830882985752576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.820354:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.820371:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d884d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.820401:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820410:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820417:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820423:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.820426:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.820429:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->2670591] (req 2654208->2670591) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.820460:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820472:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.820484:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235712:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.820588:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820595:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 15 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.820602:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.820625:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.820633:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 11 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.820640:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235968:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.820654:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.824539:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.824555:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235840:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.824564:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985235968:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.824599:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2654208->2670591] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.824617:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497a00, rc 0) 00000100:00100000:2.0:1746066823.824676:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:3798:x1830882985752576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4344us (8951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.824684:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21174 00000100:00100000:0.0:1746066823.827296:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.827607:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985752832 00000100:00100000:3.0:1746066823.827616:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985752832 00000100:00100000:3.0:1746066823.827660:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17423 00000100:00100000:3.0:1746066823.827668:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3800:x1830882985752832:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.827687:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.827702:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8854 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.827778:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827791:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827801:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827813:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827817:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827825:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827946:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827955:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.827960:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066823.828056:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.828127:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828134:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828139:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828145:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828150:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b33000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.828153:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828158:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828169:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.828171:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.828176:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828181:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33000/0xf1867c21abfb33dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828213:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828218:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828222:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828225:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009718d600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.828227:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828231:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828245:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfde00) 00010000:00010000:3.0:1746066823.828248:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.828250:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828254:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfb33e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.828290:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32a00/0xf1867c21abfb33d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.828301:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 15 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.828307:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.828309:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.828311:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e363400, rc 0) 00000100:00100000:3.0:1746066823.828971:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3800:x1830882985752832:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1302us (1681us total) trans 8589937947 rc 0/0 00000100:00100000:3.0:1746066823.828979:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17423 00000100:00100000:0.0:1746066823.832091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.832139:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.832173:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985753088 00000100:00100000:2.0:1746066823.832182:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985753088 00010000:00010000:2.0:1746066823.832221:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 12 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.832249:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985752960 00000100:00100000:2.0:1746066823.832251:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985752960 00010000:00010000:2.0:1746066823.832259:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.832273:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9772 00000100:00100000:2.0:1746066823.832279:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985753088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.832293:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.832311:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 12 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832326:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 12 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832352:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152e00/0xf1867c21abfb3254 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8790 expref: 12 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832367:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.832413:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985753088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.832419:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9772 00000100:00100000:2.0:1746066823.832432:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9773 00000100:00100000:2.0:1746066823.832436:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882985752960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.832442:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.832449:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832457:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832467:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5e800/0xf1867c21abfb3318 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87e4 expref: 35 pid: 20361 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.832474:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.832486:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985752960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.832494:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9773 00000100:00100000:0.0:1746066823.832869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.832960:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985753344 00000100:00100000:3.0:1746066823.832965:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985753344 00000100:00100000:3.0:1746066823.832990:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6604 00000100:00100000:3.0:1746066823.832999:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3800:x1830882985753344:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066823.833627:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.833683:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985753472 00000100:00100000:1.0:1746066823.833687:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985753472 00010000:00010000:1.0:1746066823.833704:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066823.833720:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9774 00000100:00100000:1.0:1746066823.833725:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985753472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.833732:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.833742:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.833751:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.833764:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3373 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8815 expref: 16 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.833774:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3800:x1830882985753344:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 777us (904us total) trans 8589937948 rc 0/0 00010000:00010000:1.0:1746066823.833776:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.833778:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066823.833780:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6604 00010000:00010000:1.0:1746066823.833784:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.833795:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.833823:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.833834:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985236096:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.833878:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.836230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.836826:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985236096:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066823.836845:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.836914:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:2015:x1830882985753472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3187us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.836924:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9774 00000100:00100000:2.0:1746066823.836929:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985753728 00000100:00100000:2.0:1746066823.836935:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985753728 00002000:00100000:2.0:1746066823.836972:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2658303) req@ffff88009d9b1c00 x1830882985753728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.836986:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882985753728 ext(2654208->2658303) 00002000:00010000:2.0:1746066823.836991:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:2.0:1746066823.837019:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8065 00000100:00100000:2.0:1746066823.837025:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985753728:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066823.837151:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985753728:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 126us (930us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066823.837156:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8065 00002000:00100000:2.0:1746066823.837161:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2658303) req@ffff88009d9b1c00 x1830882985753728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.837167:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882985753728 ext(2654208->2658303) 00002000:00010000:2.0:1746066823.837170:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:0.0:1746066823.841187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.841246:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985753984 00000100:00100000:3.0:1746066823.841255:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985753984 00002000:00100000:3.0:1746066823.841297:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2666496->2670591) req@ffff88009d9b3b80 x1830882985753984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.841306:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3b80 with x1830882985753984 ext(2666496->2670591) 00002000:00010000:3.0:1746066823.841311:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b3b80 00000100:00100000:3.0:1746066823.841338:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8066 00000100:00100000:3.0:1746066823.841345:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985753984:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.841475:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882985753984:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 130us (299us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.841483:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8066 00002000:00100000:3.0:1746066823.841487:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2666496->2670591) req@ffff88009d9b3b80 x1830882985753984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.841493:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3b80 with x1830882985753984 ext(2666496->2670591) 00002000:00010000:3.0:1746066823.841495:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b3b80 00000100:00100000:0.0:1746066823.843047:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.843115:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985754112 00000100:00100000:2.0:1746066823.843121:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985754112 00000100:00100000:2.0:1746066823.843164:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21175 00000100:00100000:2.0:1746066823.843170:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3800:x1830882985754112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.843184:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.843200:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d885b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.843239:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.843247:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066823.843249:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066823.843253:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.843282:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.843294:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 33 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066823.843305:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985236224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.843373:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.845650:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985236224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.845680:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.845696:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497200, rc 0) 00000100:00100000:2.0:1746066823.845736:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3800:x1830882985754112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2565us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.845744:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21175 00000100:00100000:2.0:1746066823.847695:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.847798:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.847955:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985754496 00000100:00100000:3.0:1746066823.847964:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985754496 00000100:00100000:3.0:1746066823.848006:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6605 00000100:00100000:3.0:1746066823.848014:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3798:x1830882985754496:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066823.848224:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:3798:x1830882985754496:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 210us (535us total) trans 8589937949 rc 0/0 00000100:00100000:3.0:1746066823.848231:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6605 00000100:00100000:3.0:1746066823.848265:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985754624 00000100:00100000:3.0:1746066823.848268:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985754624 00002000:00100000:3.0:1746066823.848292:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2670591) req@ffff8800a5d83800 x1830882985754624/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 16872/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.848301:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882985754624 ext(2654208->2670591) 00010000:00010000:3.0:1746066823.848309:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 34 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066823.848322:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 34 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066823.848329:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83800 00000100:00100000:3.0:1746066823.848344:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2302 00000100:00100000:3.0:1746066823.848349:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882985754624:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066823.849851:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985754624:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1495us (2046us total) trans 17179875533 rc 0/0 00000100:00100000:3.0:1746066823.849860:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2302 00002000:00100000:3.0:1746066823.849868:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2654208->2670591) req@ffff8800a5d83800 x1830882985754624/t17179875533(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 16872/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.849876:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882985754624 ext(2654208->2670591) 00010000:00010000:3.0:1746066823.850270:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066823.850284:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066823.850290:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83800 00000100:00100000:0.0:1746066823.852026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.852226:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985754752 00000100:00100000:1.0:1746066823.852244:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985754752 00010000:00010000:1.0:1746066823.852277:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066823.852313:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9775 00000100:00100000:1.0:1746066823.852320:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985754752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066823.852334:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.852353:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066823.852369:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066823.852393:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfb33ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2670591) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d884d expref: 36 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066823.852409:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.852411:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066823.852418:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.852426:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066823.852797:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.853009:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985236352:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066823.853096:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.855186:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.855336:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882985236352:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066823.855357:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066823.855395:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985754752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3075us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.855406:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9775 00000100:00100000:3.0:1746066823.855510:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755008 00000100:00100000:3.0:1746066823.855516:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755008 00002000:00100000:3.0:1746066823.855548:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3096575) req@ffff88009d9b2d80 x1830882985755008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.855557:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2d80 with x1830882985755008 ext(3092480->3096575) 00002000:00010000:3.0:1746066823.855561:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b2d80 00000100:00100000:3.0:1746066823.855584:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8067 00000100:00100000:3.0:1746066823.855589:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985755008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.855692:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985755008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 103us (513us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.855698:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8067 00002000:00100000:3.0:1746066823.855702:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3096575) req@ffff88009d9b2d80 x1830882985755008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.855708:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2d80 with x1830882985755008 ext(3092480->3096575) 00002000:00010000:3.0:1746066823.855710:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b2d80 00000100:00100000:0.0:1746066823.860533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.861419:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755136 00000100:00100000:2.0:1746066823.861429:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755136 00000100:00100000:2.0:1746066823.861504:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21176 00000100:00100000:2.0:1746066823.861512:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3800:x1830882985755136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.861532:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.861550:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8862 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.861584:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.862011:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.862020:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 35 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.862026:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.862028:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.862032:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.862067:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 35 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.862079:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 35 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.862097:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.862917:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.862931:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.862940:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.863665:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.863675:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 9 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.863684:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236736:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.863710:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.865687:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.867055:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.867147:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066823.867156:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985236736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.867187:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.867209:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:2.0:1746066823.867268:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3800:x1830882985755136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5757us (6746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.867277:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21176 00000100:00100000:0.0:1746066823.867606:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.867639:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.868088:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755264 00000100:00100000:3.0:1746066823.868095:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755264 00010000:00010000:3.0:1746066823.868124:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 36 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.868147:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755392 00000100:00100000:3.0:1746066823.868149:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755392 00010000:00010000:3.0:1746066823.868157:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 10 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.868167:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755520 00000100:00100000:3.0:1746066823.868168:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755520 00010000:00010000:3.0:1746066823.868174:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.868185:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9776 00000100:00100000:3.0:1746066823.868191:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985755264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.868202:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.868222:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 36 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.868243:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 36 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.868268:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfb3326 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87eb expref: 36 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.868283:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.868304:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985755264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 114us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.868309:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9776 00000100:00100000:3.0:1746066823.868321:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9777 00000100:00100000:3.0:1746066823.868325:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985755392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.868330:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.868336:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 10 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.868342:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 10 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.868494:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9778 00000100:00100000:2.0:1746066823.868500:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985755520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.868507:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.869569:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.869576:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfb323f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8797 expref: 10 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.869579:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.869590:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfb3381 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d881c expref: 27 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.869591:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.869593:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.869599:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.869606:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.869669:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066823.869687:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.869698:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985236864:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.869702:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985755520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1202us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.869708:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9778 00000100:00100000:3.0:1746066823.869755:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.873957:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985236864:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.873978:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.874031:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985755392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5703us (6423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.874043:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9777 00000100:00100000:2.0:1746066823.875198:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.875300:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.875362:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756032 00000100:00100000:3.0:1746066823.875369:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756032 00000100:00100000:3.0:1746066823.875406:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17424 00000100:00100000:3.0:1746066823.875413:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:3804:x1830882985756032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.875435:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.875451:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb3406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8869 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.875523:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875534:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875545:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875556:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875560:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875564:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875656:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb341b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875664:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb341b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875670:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb341b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066823.875679:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066823.875748:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875754:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875758:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875763:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875769:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.875773:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875778:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875788:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066823.875791:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.875794:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875799:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad800/0xf1867c21abfb340d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875811:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875815:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875819:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875822:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066823.875824:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875828:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875832:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfd700) 00010000:00010000:3.0:1746066823.875834:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066823.875836:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875842:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066823.875875:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb3406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8869 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.875904:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb341b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8869 expref: 34 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.875910:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.875912:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066823.875914:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066823.875946:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:3804:x1830882985756032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 533us (645us total) trans 8589937950 rc 0/0 00000100:00100000:3.0:1746066823.875952:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17424 00000100:00100000:3.0:1746066823.875971:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985755776 00000100:00100000:3.0:1746066823.875974:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985755776 00002000:00100000:3.0:1746066823.875997:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2297856->2301951) req@ffff8800a5d83100 x1830882985755776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.876006:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830882985755776 ext(2297856->2301951) 00002000:00010000:3.0:1746066823.876010:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:3.0:1746066823.876030:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8068 00000100:00100000:3.0:1746066823.876035:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985755776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066823.877037:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985755776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 999us (1841us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066823.877045:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8068 00002000:00100000:3.0:1746066823.877051:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2297856->2301951) req@ffff8800a5d83100 x1830882985755776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.877084:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830882985755776 ext(2297856->2301951) 00002000:00010000:3.0:1746066823.877088:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:0.0:1746066823.879369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.879468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.879714:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756288 00000100:00100000:2.0:1746066823.879722:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756288 00000100:00100000:2.0:1746066823.879759:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6606 00000100:00100000:2.0:1746066823.879766:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3804:x1830882985756288:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066823.880029:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756416 00000100:00100000:3.0:1746066823.880033:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756416 00000100:00100000:3.0:1746066823.880061:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 970 00000100:00100000:3.0:1746066823.880066:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985756416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.880074:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.880096:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb341b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8869 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.880109:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.880113:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.880154:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882985756416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.880160:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 970 00000100:00100000:2.0:1746066823.881972:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:3804:x1830882985756288:12345-192.168.204.16@tcp:35:cat.0 Request processed in 2197us (2602us total) trans 8589937951 rc 0/0 00000100:00100000:2.0:1746066823.881982:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6606 00000100:00100000:0.0:1746066823.886367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.886397:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.886416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.886481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.886664:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756544 00000100:00100000:2.0:1746066823.886673:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756544 00000100:00100000:2.0:1746066823.886727:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756672 00000100:00100000:2.0:1746066823.886729:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756672 00000100:00100000:2.0:1746066823.886748:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756800 00000100:00100000:2.0:1746066823.886750:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756800 00000100:00100000:2.0:1746066823.886761:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985756928 00000100:00100000:2.0:1746066823.886762:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985756928 00000100:00100000:2.0:1746066823.886776:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21177 00000100:00100000:2.0:1746066823.886783:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985756544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.886800:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.886817:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8870 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.886840:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.886842:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.886851:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.886866:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.886877:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497a00, rc 0) 00000100:00100000:2.0:1746066823.886946:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985756544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.886953:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21177 00000100:00100000:2.0:1746066823.886968:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21178 00000100:00100000:2.0:1746066823.886972:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985756672:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.886978:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.886987:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfb3430 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8877 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.887026:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985236992:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.887075:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.887092:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21179 00000100:00100000:2.0:1746066823.887097:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985756800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.887103:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.887110:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb3437 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d887e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.887131:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985237120:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.887148:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.887159:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21180 00000100:00100000:2.0:1746066823.887164:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985756928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.887169:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.887175:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dd1c400/0xf1867c21abfb343e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8885 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.887195:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985237248:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.887213:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.893389:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882985236992:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.893428:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfb3430 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8877 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.893442:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfb3430 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8877 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.893469:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496a00, rc 0) 00000100:00100000:2.0:1746066823.893518:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985237120:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066823.893534:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb3437 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d887e expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.893542:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfb3437 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d887e expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066823.893664:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985756672:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6690us (7265us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.893673:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21178 00000100:00100000:3.0:1746066823.893730:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985237248:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.893743:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dd1c400/0xf1867c21abfb343e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8885 expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.893750:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1c400/0xf1867c21abfb343e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8885 expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.893757:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1c400, rc 0) 00000100:00100000:3.0:1746066823.893772:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985756928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6608us (7290us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.893776:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21180 00010000:00010000:2.0:1746066823.893812:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:2.0:1746066823.893830:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882985756800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6733us (7413us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.893836:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21179 00000100:00100000:0.0:1746066823.894612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.895678:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757184 00000100:00100000:2.0:1746066823.895687:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757184 00000100:00100000:2.0:1746066823.895737:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17425 00000100:00100000:2.0:1746066823.895744:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3808:x1830882985757184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.895767:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.895783:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb3445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d888c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.895869:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.895897:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.895908:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.895925:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.895931:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.895934:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896015:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb345a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896022:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb345a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896025:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb345a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066823.896032:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066823.896090:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896093:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896097:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896101:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066823.896103:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.896105:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dd1c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.896108:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896113:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896122:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066823.896125:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.896129:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066823.896130:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.896134:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c800/0xf1867c21abfb344c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896143:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.896144:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757312 00010000:00010000:2.0:1746066823.896148:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066823.896152:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066823.896153:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.896156:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757312 00010000:00010000:2.0:1746066823.896157:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dd1ce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.896159:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896163:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.896168:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9900) 00010000:00010000:2.0:1746066823.896170:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.896171:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.896176:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757440 00010000:00010000:2.0:1746066823.896176:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1ce00/0xf1867c21abfb3453 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.896178:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757440 00000100:00100000:0.0:1746066823.896181:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757568 00000100:00100000:0.0:1746066823.896184:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757568 00000100:00100000:3.0:1746066823.896190:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21181 00000100:00100000:3.0:1746066823.896195:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985757312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.896202:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.896209:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb3445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d888c expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.896212:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3468 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8893 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066823.896216:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21182 00010000:00010000:2.0:1746066823.896218:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb345a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d888c expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.896223:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:0.0:1746066823.896223:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985757440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.896224:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066823.896226:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1d000, rc 0) 00010000:00010000:0.0:1746066823.896241:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.896248:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b600/0xf1867c21abfb346f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d889a expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.896260:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985237376:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.896269:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3808:x1830882985757184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 526us (1659us total) trans 8589937952 rc 0/0 00000100:00100000:1.0:1746066823.896269:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21183 00000100:00100000:2.0:1746066823.896274:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17425 00000100:00100000:0.0:1746066823.896274:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985237504:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066823.896278:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985757568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066823.896286:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066823.896297:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfb3476 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88a1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.896315:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.896317:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.896330:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985237632:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066823.896353:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.900075:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.900196:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985237376:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066823.900211:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985237632:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.900227:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3468 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8893 expref: 38 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.900229:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfb3476 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a1 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.900249:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3468 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8893 expref: 38 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.900249:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfb3476 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a1 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066823.900269:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848bc00, rc 0) 00000100:00100000:1.0:1746066823.900314:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985757568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4038us (4159us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066823.900322:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21183 00000100:00100000:2.0:1746066823.900383:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985237504:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066823.900402:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b600/0xf1867c21abfb346f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d889a expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.900429:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:1.0:1746066823.900469:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.900495:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757824 00000100:00100000:1.0:1746066823.900501:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757824 00010000:00010000:2.0:1746066823.900551:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b600/0xf1867c21abfb346f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d889a expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.900559:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b600, rc 0) 00000100:00100000:3.0:1746066823.900738:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985757312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4540us (4635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066823.900744:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21181 00000100:00100000:3.0:1746066823.900766:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985757952 00000100:00100000:3.0:1746066823.900769:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985757952 00000100:00100000:3.0:1746066823.900790:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 971 00000100:00100000:3.0:1746066823.900794:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985757952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.900804:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.900820:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb345a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d888c expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.900830:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.900834:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.901035:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985757440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4811us (4903us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066823.901041:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21182 00000100:00100000:3.0:1746066823.901096:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985757952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 300us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.901102:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 971 00000100:00100000:1.0:1746066823.901137:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6607 00000100:00100000:1.0:1746066823.901144:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3808:x1830882985757824:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066823.901315:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3808:x1830882985757824:12345-192.168.204.16@tcp:35:cat.0 Request processed in 170us (1249us total) trans 8589937953 rc 0/0 00000100:00100000:1.0:1746066823.901324:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6607 00000100:00100000:0.0:1746066823.909956:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.910022:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985758208 00000100:00100000:3.0:1746066823.910031:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985758208 00002000:00100000:3.0:1746066823.910081:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009586bb80 x1830882985758208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.910098:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985758208 ext(1048576->2097151) 00002000:00010000:3.0:1746066823.910104:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586bb80 00000100:00100000:3.0:1746066823.910139:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8069 00000100:00100000:3.0:1746066823.910147:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985758208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.916798:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985758208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6639us (6839us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066823.916812:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8069 00002000:00100000:3.0:1746066823.916826:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009586bb80 x1830882985758208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.916836:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586bb80 with x1830882985758208 ext(1048576->2097151) 00002000:00010000:3.0:1746066823.916843:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586bb80 00000100:00100000:0.0:1746066823.917805:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.917850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.917925:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985758592 00000100:00100000:3.0:1746066823.917933:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985758592 00002000:00100000:3.0:1746066823.917969:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095869500 x1830882985758592/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 504/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.917977:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869500 with x1830882985758592 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.917981:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869500 00000100:00100000:3.0:1746066823.917995:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985758720 00000100:00100000:3.0:1746066823.917997:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985758720 00002000:00100000:3.0:1746066823.918009:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2301952->4194303) req@ffff88012d801180 x1830882985758720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.918015:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801180 with x1830882985758720 ext(2301952->4194303) 00002000:00010000:3.0:1746066823.918018:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d801180 00000100:00100000:3.0:1746066823.918030:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8070 00000100:00100000:3.0:1746066823.918036:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2016:x1830882985758592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066823.919484:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8071 00000100:00100000:1.0:1746066823.919494:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985758720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.924713:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.924781:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985758848 00000100:00100000:0.0:1746066823.924791:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985758848 00000100:00100000:0.0:1746066823.924857:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21184 00000100:00100000:0.0:1746066823.924866:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+35:3804:x1830882985758848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066823.924898:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066823.924919:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88a8 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.924949:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.924959:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066823.924960:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066823.924965:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.924997:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066823.925010:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 17 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066823.925023:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985237760:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066823.925097:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.933970:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d803100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985237760:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066823.934006:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.934024:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778600, rc 0) 00000100:00100000:2.0:1746066823.934088:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3804:x1830882985758848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9222us (9385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.934097:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21184 00000100:00100000:1.0:1746066823.937956:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.938017:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985758976 00000100:00100000:0.0:1746066823.938026:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985758976 00002000:00100000:0.0:1746066823.938072:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1236991) req@ffff880093c4d180 x1830882985758976/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.938081:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d180 with x1830882985758976 ext(1048576->1236991) 00010000:00010000:0.0:1746066823.938090:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066823.938102:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746066823.938108:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c4d180 00000100:00100000:0.0:1746066823.938140:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2303 00000100:00100000:0.0:1746066823.938147:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985758976:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066823.941181:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985758720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21675us (23316us total) trans 0 rc 1892352/1892352 00000100:00100000:1.0:1746066823.941194:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8071 00002000:00100000:1.0:1746066823.941206:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2301952->4194303) req@ffff88012d801180 x1830882985758720/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1892352/1892352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.941215:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801180 with x1830882985758720 ext(2301952->4194303) 00002000:00010000:1.0:1746066823.941222:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d801180 00000100:00100000:3.0:1746066823.943201:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985758592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25156us (25391us total) trans 0 rc 2043904/2043904 00000100:00100000:3.0:1746066823.943212:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8070 00002000:00100000:3.0:1746066823.943222:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095869500 x1830882985758592/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 504/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 2043904/2043904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066823.943241:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095869500 with x1830882985758592 ext(2097152->4194303) 00002000:00010000:3.0:1746066823.943246:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095869500 00000100:00100000:2.0:1746066823.943495:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985758976:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5346us (5548us total) trans 17179875534 rc 0/0 00000100:00100000:2.0:1746066823.943502:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2303 00002000:00100000:2.0:1746066823.943508:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1236991) req@ffff880093c4d180 x1830882985758976/t17179875534(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.943514:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4d180 with x1830882985758976 ext(1048576->1236991) 00010000:00010000:2.0:1746066823.943522:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066823.943536:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066823.943542:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c4d180 00000100:00100000:0.0:1746066823.949179:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.949655:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.949747:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985759232 00000100:00100000:3.0:1746066823.949757:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985759232 00010000:00010000:3.0:1746066823.949794:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066823.949833:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9779 00000100:00100000:3.0:1746066823.949840:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985759232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.949855:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.949876:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066823.949932:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066823.949957:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfb33a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d883f expref: 18 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066823.949980:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.949982:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.949989:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.949999:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.950032:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.950046:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985237888:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066823.950915:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985759360 00000100:00100000:3.0:1746066823.950920:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.950923:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985759360 00002000:00100000:2.0:1746066823.950974:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012d802300 x1830882985759360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066823.950981:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802300 with x1830882985759360 ext(4194304->5074943) 00002000:00010000:2.0:1746066823.950985:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d802300 00000100:00100000:2.0:1746066823.951009:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8072 00000100:00100000:2.0:1746066823.951015:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985759360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066823.955072:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985237888:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.955095:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.955143:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985759232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5302us (5974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.955153:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9779 00000100:00100000:0.0:1746066823.957479:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.957526:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.957690:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985759360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6673us (8034us total) trans 0 rc 880640/880640 00000100:00100000:0.0:1746066823.957700:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8072 00002000:00100000:0.0:1746066823.957711:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012d802300 x1830882985759360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.957720:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802300 with x1830882985759360 ext(4194304->5074943) 00002000:00010000:0.0:1746066823.957725:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d802300 00000100:00100000:0.0:1746066823.957747:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985759744 00000100:00100000:0.0:1746066823.957754:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985759744 00002000:00100000:0.0:1746066823.957783:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012d800380 x1830882985759744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.957789:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800380 with x1830882985759744 ext(1048576->2097151) 00002000:00010000:0.0:1746066823.957792:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800380 00000100:00100000:1.0:1746066823.957857:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8073 00000100:00100000:2.0:1746066823.957861:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985759488 00000100:00100000:2.0:1746066823.957865:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985759488 00000100:00100000:1.0:1746066823.957871:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985759744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066823.957917:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21185 00000100:00100000:2.0:1746066823.957924:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2016:x1830882985759488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.957935:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.957949:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88af expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.957969:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.957971:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.957980:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.957995:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.958005:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1c800, rc 0) 00000100:00100000:2.0:1746066823.958021:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2016:x1830882985759488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 98us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.958026:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21185 00000100:00100000:1.0:1746066823.963396:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985759744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5523us (5862us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066823.963407:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8073 00002000:00100000:1.0:1746066823.963417:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012d800380 x1830882985759744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.963426:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800380 with x1830882985759744 ext(1048576->2097151) 00002000:00010000:1.0:1746066823.963431:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800380 00000100:00100000:0.0:1746066823.971299:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.971361:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985759872 00000100:00100000:2.0:1746066823.971369:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985759872 00000100:00100000:0.0:1746066823.971400:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.971578:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760000 00000100:00100000:2.0:1746066823.971582:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760000 00000100:00100000:2.0:1746066823.971602:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21186 00000100:00100000:2.0:1746066823.971608:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985759872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066823.971623:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.971636:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c600/0xf1867c21abfb348b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88b6 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.971650:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21187 00000100:00100000:3.0:1746066823.971665:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985760000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.971682:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066823.971683:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238016:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066823.971697:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb3492 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88bd expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.971742:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985238144:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066823.971761:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.971798:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066823.972487:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066823.972575:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760256 00000100:00100000:2.0:1746066823.972579:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760256 00000100:00100000:2.0:1746066823.972606:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17426 00000100:00100000:2.0:1746066823.972610:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:3811:x1830882985760256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.972619:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066823.972628:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb3499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88c4 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.972676:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972684:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972691:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972698:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972701:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972714:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972794:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d400/0xf1867c21abfb34ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066823.972794:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985238144:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066823.972808:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238016:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066823.972814:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d400/0xf1867c21abfb34ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066823.972818:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb3492 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88bd expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066823.972819:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d400/0xf1867c21abfb34ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.972825:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c600/0xf1867c21abfb348b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88b6 expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00000004:00200000:2.0:1746066823.972827:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:0.0:1746066823.972828:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895400/0xf1867c21abfb3492 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88bd expref: 37 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.972835:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c600/0xf1867c21abfb348b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88b6 expref: 37 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066823.972848:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895400, rc 0) 00010000:00010000:3.0:1746066823.972851:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1c600, rc 0) 00000100:00100000:0.0:1746066823.972905:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985760000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1225us (1483us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066823.972912:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21187 00010000:00010000:2.0:1746066823.972916:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972922:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.972923:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882985759872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1314us (1628us total) trans 0 rc 301/301 00010000:00010000:2.0:1746066823.972927:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066823.972930:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21186 00010000:00010000:2.0:1746066823.972933:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972937:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dd1d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.972941:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972946:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972956:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066823.972959:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.972963:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972967:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d000/0xf1867c21abfb34a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972985:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972989:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972993:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.972997:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011dd1d200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066823.972999:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.973003:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.973009:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9c00) 00010000:00010000:2.0:1746066823.973011:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066823.973012:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.973015:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d200/0xf1867c21abfb34a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066823.973039:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d600/0xf1867c21abfb3499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88c4 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.973048:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d400/0xf1867c21abfb34ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88c4 expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.973051:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066823.973053:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066823.973054:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1d400, rc 0) 00000100:00100000:2.0:1746066823.973091:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:3811:x1830882985760256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 480us (604us total) trans 8589937954 rc 0/0 00000100:00100000:2.0:1746066823.973097:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17426 00000100:00100000:0.0:1746066823.974881:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.975007:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760384 00000100:00100000:3.0:1746066823.975014:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760384 00000100:00100000:3.0:1746066823.975054:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 972 00000100:00100000:3.0:1746066823.975061:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882985760384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.975073:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.975093:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1d400/0xf1867c21abfb34ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88c4 expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.975108:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066823.975111:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.975149:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882985760384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.975155:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 972 00000100:00100000:2.0:1746066823.976194:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.976396:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760512 00000100:00100000:3.0:1746066823.976402:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760512 00000100:00100000:3.0:1746066823.977156:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21188 00000100:00100000:3.0:1746066823.977165:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3804:x1830882985760512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066823.977184:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.977202:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88cb expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.977242:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 17 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.977251:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.977253:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066823.977257:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.977290:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 17 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.977303:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 17 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066823.977315:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.977420:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066823.978614:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238272:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.978635:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.978652:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:3.0:1746066823.978694:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:3804:x1830882985760512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1530us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.978700:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21188 00000100:00100000:2.0:1746066823.978979:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.979067:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760640 00000100:00100000:1.0:1746066823.979074:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760640 00002000:00100000:1.0:1746066823.979109:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3145727) req@ffff8800a5d80e00 x1830882985760640/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.979118:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882985760640 ext(3092480->3145727) 00010000:00010000:1.0:1746066823.979126:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 18 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066823.979137:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 18 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746066823.979143:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80e00 00000100:00100000:1.0:1746066823.979183:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2304 00000100:00100000:1.0:1746066823.979191:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2015:x1830882985760640:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066823.981299:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985760640:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2104us (2316us total) trans 17179875535 rc 0/0 00000100:00100000:1.0:1746066823.981309:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2304 00002000:00100000:1.0:1746066823.981319:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3145727) req@ffff8800a5d80e00 x1830882985760640/t17179875535(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:229/0 lens 488/448 e 0 to 0 dl 1746066834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.981326:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882985760640 ext(3092480->3145727) 00010000:00010000:1.0:1746066823.981334:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066823.981348:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746066823.981354:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80e00 00000100:00100000:0.0:1746066823.987878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.987972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.988061:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760896 00000100:00100000:3.0:1746066823.988069:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760896 00000100:00100000:2.0:1746066823.988090:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985760768 00000100:00100000:2.0:1746066823.988095:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985760768 00010000:00010000:2.0:1746066823.988118:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066823.988149:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9780 00000100:00100000:2.0:1746066823.988157:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985760768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.988170:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066823.988189:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066823.988201:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066823.988222:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfb33f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d885b expref: 20 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066823.988262:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.988264:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066823.988269:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21189 00010000:00010000:2.0:1746066823.988271:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066823.988276:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:3811:x1830882985760896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066823.988280:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.988291:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.988304:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88d2 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.988311:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.988323:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985238400:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066823.988334:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988342:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988349:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988355:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.988356:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066823.988359:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [1019904->1048575] (req 1019904->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.988380:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988391:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.988399:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238528:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.988474:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988483:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.988490:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238656:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.988513:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066823.988520:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 10 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.988527:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238784:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.988542:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.988659:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066823.990536:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985238400:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.990553:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066823.990557:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238528:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.990566:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238656:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066823.990574:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985238784:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066823.990597:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [1019904->1048575] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066823.990598:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985760768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2440us (2735us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066823.990612:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895c00, rc 0) 00000100:00100000:3.0:1746066823.990632:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+38:3811:x1830882985760896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2357us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066823.990638:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21189 00000100:00100000:2.0:1746066823.990964:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9780 00000100:00100000:0.0:1746066823.994518:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.994564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.994593:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066823.994658:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985761152 00000100:00100000:1.0:1746066823.994667:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985761152 00000100:00100000:0.0:1746066823.994682:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066823.994702:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 11 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.994714:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985761024 00000100:00100000:3.0:1746066823.994719:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985761024 00000100:00100000:1.0:1746066823.994728:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985761280 00000100:00100000:1.0:1746066823.994730:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985761280 00010000:00010000:3.0:1746066823.994735:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.994740:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066823.994757:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9781 00000100:00100000:3.0:1746066823.994764:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985761152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066823.994765:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9782 00000100:00100000:1.0:1746066823.994770:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985761024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066823.994777:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066823.994777:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.994794:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 11 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.994797:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.994805:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 11 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.994815:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066823.994829:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9783 00000100:00100000:2.0:1746066823.994839:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985761280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066823.994847:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066823.995016:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152200/0xf1867c21abfb3246 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8774 expref: 11 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066823.995027:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfb3311 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87c8 expref: 38 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.995029:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066823.995037:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066823.995039:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066823.995046:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.995059:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfb3365 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87f9 expref: 19 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066823.995072:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066823.995074:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066823.995077:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985761152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 313us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066823.995077:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985761024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 306us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066823.995080:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.995083:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9782 00000100:00100000:3.0:1746066823.995086:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9781 00010000:00010000:2.0:1746066823.995089:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066823.995119:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066823.995129:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985761536 00000100:00100000:1.0:1746066823.995131:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985761536 00000100:00100000:2.0:1746066823.995132:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985238912:192.168.204.16@tcp:105: 00002000:00100000:1.0:1746066823.995155:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88012d800700 x1830882985761536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066823.995163:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800700 with x1830882985761536 ext(2097152->3145727) 00002000:00010000:1.0:1746066823.995167:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800700 00000100:00100000:2.0:1746066823.995181:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066823.995273:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8074 00000100:00100000:1.0:1746066823.995278:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985761536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066823.996959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.996982:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985761792 00000100:00100000:0.0:1746066823.996987:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985761792 00002000:00100000:0.0:1746066823.997015:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1023999) req@ffff88012d803100 x1830882985761792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/0 e 0 to 0 dl 1746066834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.997024:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985761792 ext(1019904->1023999) 00002000:00010000:0.0:1746066823.997027:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d803100 00000100:00100000:0.0:1746066823.997056:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8075 00000100:00100000:0.0:1746066823.997063:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985761792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066823.997165:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985761792:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 102us (210us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066823.997171:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8075 00002000:00100000:0.0:1746066823.997176:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1023999) req@ffff88012d803100 x1830882985761792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066823.997183:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d803100 with x1830882985761792 ext(1019904->1023999) 00002000:00010000:0.0:1746066823.997185:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d803100 00000100:00100000:2.0:1746066823.997330:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985238912:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066823.997346:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066823.997366:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:2013:x1830882985761280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2530us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066823.997374:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9783 00000100:00100000:0.0:1746066823.998220:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066823.999618:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066823.999733:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762048 00000100:00100000:3.0:1746066823.999740:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762048 00000100:00100000:3.0:1746066823.999780:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17427 00000100:00100000:3.0:1746066823.999787:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3813:x1830882985762048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066823.999808:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066823.999825:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb34ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88d9 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066823.999910:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.999928:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.999939:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.999952:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.999957:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066823.999962:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000051:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfb34df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000059:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfb34df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000066:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfb34df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066824.000074:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066824.000139:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000145:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000150:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000155:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000160:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.000163:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000169:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000180:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066824.000183:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.000187:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000192:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfb34d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000203:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000212:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000216:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000220:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.000223:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000227:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000248:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfde00) 00010000:00010000:3.0:1746066824.000250:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.000252:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000258:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfb34d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.000290:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfb34ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d9 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.000301:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfb34df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d9 expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.000307:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.000309:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066824.000311:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:3.0:1746066824.000363:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3813:x1830882985762048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 576us (2144us total) trans 8589937955 rc 0/0 00000100:00100000:3.0:1746066824.000369:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17427 00000100:00100000:3.0:1746066824.000393:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762176 00000100:00100000:3.0:1746066824.000395:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762176 00000100:00100000:3.0:1746066824.000420:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21190 00000100:00100000:3.0:1746066824.000425:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3811:x1830882985762176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.000434:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.000442:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88e0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.000460:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000469:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000558:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000566:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.000567:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.000571:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.000598:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000609:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 37 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.000621:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.000698:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000707:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 25 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.000715:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.000740:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 8 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.000748:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 8 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.000756:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239296:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.000770:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.002182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.002251:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985761536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6970us (7566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.002261:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8074 00000100:00100000:3.0:1746066824.002262:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239040:192.168.204.16@tcp:104: 00002000:00100000:1.0:1746066824.002271:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff88012d800700 x1830882985761536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:229/0 lens 488/440 e 0 to 0 dl 1746066834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.002280:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d800700 with x1830882985761536 ext(2097152->3145727) 00002000:00010000:1.0:1746066824.002284:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d800700 00000100:00100000:2.0:1746066824.002311:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762304 00000100:00100000:2.0:1746066824.002317:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762304 00000100:00100000:2.0:1746066824.002349:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 973 00000100:00100000:2.0:1746066824.002354:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985762304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.002363:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.002383:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfb34df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d9 expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.002404:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.002407:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.002425:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985762304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.002430:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 973 00000100:00100000:2.0:1746066824.002707:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.002747:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762560 00000100:00100000:1.0:1746066824.002750:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762560 00000100:00100000:1.0:1746066824.002947:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6608 00000100:00100000:1.0:1746066824.002954:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3813:x1830882985762560:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066824.003051:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239168:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.003060:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239296:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.003060:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.003071:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762688 00000100:00100000:0.0:1746066824.003074:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762688 00010000:00010000:3.0:1746066824.003085:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.003086:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 38 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.003102:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:0.0:1746066824.003103:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9784 00000100:00100000:1.0:1746066824.003107:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3813:x1830882985762560:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 154us (400us total) trans 8589937956 rc 0/0 00000100:00100000:0.0:1746066824.003108:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985762688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066824.003113:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6608 00010000:00010000:0.0:1746066824.003115:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066824.003121:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+38:3811:x1830882985762176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2695us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.003127:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21190 00010000:00010000:0.0:1746066824.003130:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 38 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.003482:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 37 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.003499:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718ca00/0xf1867c21abfb330a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87cf expref: 37 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066824.003960:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066824.004040:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.004067:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882985762688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 953us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.004075:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9784 00000100:00100000:3.0:1746066824.004606:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762816 00000100:00100000:3.0:1746066824.004612:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762816 00010000:00010000:3.0:1746066824.004631:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 9 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.004639:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.004807:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985762944 00000100:00100000:3.0:1746066824.004810:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985762944 00010000:00010000:3.0:1746066824.004836:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 26 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.004852:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9785 00000100:00100000:3.0:1746066824.004857:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985762816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.004866:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.004879:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 9 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.004900:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 9 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.004915:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6000/0xf1867c21abfb3231 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d877b expref: 9 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.004927:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746066824.005014:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066824.005017:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9786 00000100:00100000:1.0:1746066824.005023:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985762944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.005030:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.005038:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 26 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.005047:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 26 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.005063:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a53a00/0xf1867c21abfb335e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8800 expref: 26 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.005071:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.005072:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.005078:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.005086:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.005120:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 35 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.005131:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985239424:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066824.005553:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985762816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 695us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.005560:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9785 00000100:00100000:0.0:1746066824.005768:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.005810:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b61a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.005837:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763072 00000100:00100000:3.0:1746066824.005839:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763072 00000100:00100000:3.0:1746066824.005857:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21191 00000100:00100000:3.0:1746066824.005862:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+36:3804:x1830882985763072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.005873:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.005894:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88e7 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.005913:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.005919:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.005920:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.005923:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.005940:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.005950:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 25 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.005963:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239552:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.006128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.006361:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763200 00000100:00100000:1.0:1746066824.006364:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763200 00000100:00100000:1.0:1746066824.006387:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21192 00000100:00100000:1.0:1746066824.006391:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+18:3813:x1830882985763200:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066824.006398:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.006406:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88ee expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.006421:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.006426:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.006427:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.006429:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2703360->2723839] (req 2703360->2723839) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.006443:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.006449:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 36 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.006456:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.006457:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985239680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.006476:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066824.006581:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066824.007858:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985239424:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.007879:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.007965:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985762944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2940us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.007969:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985239552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.007974:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9786 00010000:00010000:3.0:1746066824.007991:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.008004:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575be00, rc 0) 00000100:00100000:1.0:1746066824.008018:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985239680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.008028:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+37:3804:x1830882985763072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2165us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.008034:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21191 00010000:00010000:1.0:1746066824.008036:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2703360->2723839] (req 2703360->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.008056:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4800, rc 0) 00000100:00100000:1.0:1746066824.008075:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3813:x1830882985763200:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1684us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.008081:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21192 00000100:00100000:0.0:1746066824.008293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.008357:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763328 00000100:00100000:1.0:1746066824.008363:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763328 00002000:00100000:1.0:1746066824.008389:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2301951) req@ffff8800966e2d80 x1830882985763328/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.008398:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882985763328 ext(2097152->2301951) 00010000:00010000:1.0:1746066824.008405:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 25 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.008415:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 25 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746066824.008420:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e2d80 00000100:00100000:1.0:1746066824.008435:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2305 00000100:00100000:1.0:1746066824.008440:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985763328:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066824.009133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.009199:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763456 00000100:00100000:1.0:1746066824.009203:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763456 00010000:00010000:1.0:1746066824.009216:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.009245:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9787 00000100:00100000:1.0:1746066824.009250:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985763456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.009257:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.009268:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.009275:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.009289:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894a00/0xf1867c21abfb34bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88cb expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.009300:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.009302:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.009307:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.009313:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.009335:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.009344:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985239808:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.009399:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.010051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.011209:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763712 00000100:00100000:3.0:1746066824.011218:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763712 00002000:00100000:3.0:1746066824.011270:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1363968->1368063) req@ffff8800a5d82300 x1830882985763712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.011279:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882985763712 ext(1363968->1368063) 00002000:00010000:3.0:1746066824.011284:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:3.0:1746066824.011315:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8076 00000100:00100000:3.0:1746066824.011322:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985763712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066824.011362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.011375:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985763968 00000100:00100000:0.0:1746066824.011380:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985763968 00002000:00100000:0.0:1746066824.011404:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->2707455) req@ffff8800966e1880 x1830882985763968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.011418:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985763968 ext(2703360->2707455) 00002000:00010000:0.0:1746066824.011422:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:3.0:1746066824.011445:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985763712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (1394us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066824.011451:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8077 00000100:00100000:0.0:1746066824.011457:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985763968:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.011510:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985239808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.011524:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.011552:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882985763456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2301us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.011561:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9787 00000100:00100000:1.0:1746066824.011638:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2015:x1830882985763328:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3198us (3345us total) trans 21474842878 rc 0/0 00000100:00100000:3.0:1746066824.011673:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8076 00002000:00100000:3.0:1746066824.011786:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1363968->1368063) req@ffff8800a5d82300 x1830882985763712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.011799:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882985763712 ext(1363968->1368063) 00002000:00010000:3.0:1746066824.011802:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:1.0:1746066824.012028:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2305 00002000:00100000:1.0:1746066824.012035:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2301951) req@ffff8800966e2d80 x1830882985763328/t21474842878(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.012043:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882985763328 ext(2097152->2301951) 00010000:00010000:1.0:1746066824.012050:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.012062:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746066824.012068:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e2d80 00000100:00100000:0.0:1746066824.012111:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985763968:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 653us (750us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066824.012116:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8077 00002000:00100000:0.0:1746066824.012121:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->2707455) req@ffff8800966e1880 x1830882985763968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.012127:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1880 with x1830882985763968 ext(2703360->2707455) 00002000:00010000:0.0:1746066824.012130:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1880 00000100:00100000:3.0:1746066824.015587:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.015724:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985764224 00000100:00100000:1.0:1746066824.015732:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985764224 00000100:00100000:1.0:1746066824.015782:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6609 00000100:00100000:1.0:1746066824.015789:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3811:x1830882985764224:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066824.015791:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.015862:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.015921:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985764608 00000100:00100000:0.0:1746066824.015925:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985764608 00002000:00100000:0.0:1746066824.015946:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2719744->2723839) req@ffff8800967a8a80 x1830882985764608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.015953:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882985764608 ext(2719744->2723839) 00002000:00010000:0.0:1746066824.015957:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:1.0:1746066824.015996:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3811:x1830882985764224:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 207us (415us total) trans 8589937957 rc 0/0 00000100:00100000:1.0:1746066824.016003:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6609 00000100:00100000:1.0:1746066824.016023:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985764352 00000100:00100000:1.0:1746066824.016026:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985764352 00010000:00010000:1.0:1746066824.016038:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.016061:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9788 00000100:00100000:1.0:1746066824.016066:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2013:x1830882985764352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.016073:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.016087:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.016097:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.016116:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfb33ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8862 expref: 27 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.016126:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.016128:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.016133:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.016141:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.016166:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.016177:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985239936:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.016216:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.016243:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8078 00000100:00100000:0.0:1746066824.016250:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985764608:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066824.016467:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985764608:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 217us (603us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066824.016473:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8078 00002000:00100000:0.0:1746066824.016479:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2719744->2723839) req@ffff8800967a8a80 x1830882985764608/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.016486:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882985764608 ext(2719744->2723839) 00002000:00010000:0.0:1746066824.016489:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:0.0:1746066824.019977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.020075:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985239936:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.020094:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.020219:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985764352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4151us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.020411:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9788 00000100:00100000:2.0:1746066824.020444:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985764864 00000100:00100000:2.0:1746066824.020451:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985764864 00002000:00100000:2.0:1746066824.020479:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800966e3800 x1830882985764864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.020487:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985764864 ext(2097152->3145727) 00002000:00010000:2.0:1746066824.020491:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3800 00000100:00100000:2.0:1746066824.020514:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8079 00000100:00100000:2.0:1746066824.020521:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985764864:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066824.026276:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985764864:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5738us (6289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.026288:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8079 00002000:00100000:2.0:1746066824.026299:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff8800966e3800 x1830882985764864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.026307:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3800 with x1830882985764864 ext(2097152->3145727) 00002000:00010000:2.0:1746066824.026312:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3800 00000100:00100000:0.0:1746066824.030629:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.030737:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985764992 00000100:00100000:1.0:1746066824.030746:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985764992 00000100:00100000:1.0:1746066824.030802:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21193 00000100:00100000:1.0:1746066824.030811:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:3804:x1830882985764992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.030829:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.030846:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88f5 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.030877:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.030915:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.030916:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.030920:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.030957:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.030968:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 18 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.030980:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985240064:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.031076:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.032278:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985240064:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.032307:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.032322:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589bc00, rc 0) 00000100:00100000:1.0:1746066824.032377:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:3804:x1830882985764992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1566us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.032392:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21193 00000100:00100000:0.0:1746066824.032629:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.032720:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985765120 00000100:00100000:3.0:1746066824.032726:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985765120 00002000:00100000:3.0:1746066824.032778:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->2723839) req@ffff8800966e1c00 x1830882985765120/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.032796:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985765120 ext(2703360->2723839) 00010000:00010000:3.0:1746066824.032803:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 19 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.032815:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 19 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.032830:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e1c00 00000100:00100000:3.0:1746066824.032870:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2306 00000100:00100000:3.0:1746066824.032956:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2016:x1830882985765120:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066824.034241:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985765120:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 1350us (1599us total) trans 17179875536 rc 0/0 00000100:00100000:3.0:1746066824.034248:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2306 00002000:00100000:3.0:1746066824.034256:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->2723839) req@ffff8800966e1c00 x1830882985765120/t17179875536(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.034269:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882985765120 ext(2703360->2723839) 00010000:00010000:3.0:1746066824.034276:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.034287:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.034293:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e1c00 00000100:00100000:0.0:1746066824.035650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.035733:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985765248 00000100:00100000:1.0:1746066824.035740:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985765248 00010000:00010000:1.0:1746066824.035763:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.035799:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9789 00000100:00100000:1.0:1746066824.035805:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985765248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.035815:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066824.035825:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.035835:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066824 -> 1746066825 00010000:00010000:1.0:1746066824.035840:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.035850:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.035868:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4800/0xf1867c21abfb34fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->2723839) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88ee expref: 21 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.035908:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.035910:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.035917:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 36 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.035924:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 36 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.035950:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 36 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.035960:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985240192:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.036023:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.037057:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985240192:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.037071:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.037092:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985765248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1287us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.037099:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9789 00000100:00100000:0.0:1746066824.041757:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.041805:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.041910:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985765632 00000100:00100000:3.0:1746066824.041918:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985765632 00002000:00100000:3.0:1746066824.041960:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e2300 x1830882985765632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.041968:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985765632 ext(3145728->4194303) 00002000:00010000:3.0:1746066824.041973:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:1.0:1746066824.041981:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985765760 00000100:00100000:1.0:1746066824.041985:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985765760 00002000:00100000:1.0:1746066824.042004:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800966e0a80 x1830882985765760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.042011:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882985765760 ext(3145728->4194303) 00002000:00010000:1.0:1746066824.042014:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:3.0:1746066824.042381:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8080 00000100:00100000:3.0:1746066824.042389:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985765632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.042423:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8081 00000100:00100000:1.0:1746066824.042430:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985765760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066824.051980:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985765632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9579us (10217us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.051993:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8080 00002000:00100000:3.0:1746066824.052006:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e2300 x1830882985765632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.052015:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882985765632 ext(3145728->4194303) 00002000:00010000:3.0:1746066824.052022:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:2.0:1746066824.053048:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985765760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10609us (11234us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.053058:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8081 00002000:00100000:2.0:1746066824.053069:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff8800966e0a80 x1830882985765760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.053078:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882985765760 ext(3145728->4194303) 00002000:00010000:2.0:1746066824.053083:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:0.0:1746066824.059035:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.059140:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985766016 00000100:00100000:2.0:1746066824.059150:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985766016 00002000:00100000:2.0:1746066824.059193:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800966e3480 x1830882985766016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.059203:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985766016 ext(4194304->5074943) 00002000:00010000:2.0:1746066824.059208:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:2.0:1746066824.059245:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8082 00000100:00100000:2.0:1746066824.059252:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985766016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.067032:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985766016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7771us (7998us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066824.067043:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8082 00002000:00100000:2.0:1746066824.067054:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800966e3480 x1830882985766016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.067069:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882985766016 ext(4194304->5074943) 00002000:00010000:2.0:1746066824.067075:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066824.137712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.137971:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985766272 00000100:00100000:3.0:1746066824.137980:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985766272 00000100:00100000:3.0:1746066824.138021:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17428 00000100:00100000:3.0:1746066824.138029:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:3818:x1830882985766272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.138049:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.138065:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb3509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d88fc expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.138126:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138138:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138148:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138159:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138165:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138170:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138277:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb351e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138285:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb351e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138290:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb351e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066824.138298:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066824.138358:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138364:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138369:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138374:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138380:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.138383:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138389:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138397:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066824.138400:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.138403:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.138407:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139915:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139930:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139940:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139949:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.139952:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139957:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139967:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfdf00) 00010000:00010000:3.0:1746066824.139970:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.139976:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.139981:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfb3517 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.140037:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfb3509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88fc expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.140050:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb351e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88fc expref: 38 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.140057:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.140071:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066824.140073:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:3.0:1746066824.140135:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:3818:x1830882985766272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2106us (2429us total) trans 8589937958 rc 0/0 00000100:00100000:3.0:1746066824.140145:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17428 00000100:00100000:0.0:1746066824.148480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.148587:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985766400 00000100:00100000:1.0:1746066824.148594:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985766400 00000100:00100000:1.0:1746066824.148653:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 974 00000100:00100000:1.0:1746066824.148661:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985766400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.148674:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.148695:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb351e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88fc expref: 38 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.148729:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.148732:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.149215:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882985766400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 553us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.149223:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 974 00000100:00100000:0.0:1746066824.179007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.179334:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985766656 00000100:00100000:3.0:1746066824.179342:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985766656 00000100:00100000:3.0:1746066824.179383:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17429 00000100:00100000:3.0:1746066824.179389:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3822:x1830882985766656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.179409:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.179423:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfb352c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8903 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.179489:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179500:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179508:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179518:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179523:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179527:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179606:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb3541 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179614:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb3541 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179619:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb3541 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066824.179629:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066824.179687:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179693:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179698:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179702:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179707:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575ba00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.179711:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179715:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179723:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066824.179726:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.179729:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179733:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179760:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179765:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179772:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179775:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.179777:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179781:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179786:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097cfd300) 00010000:00010000:3.0:1746066824.179788:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.179789:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179793:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfb353a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.179824:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfb352c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8903 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.179834:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb3541 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8903 expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.179839:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.179840:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066824.179843:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:3.0:1746066824.179914:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3822:x1830882985766656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 524us (915us total) trans 8589937959 rc 0/0 00000100:00100000:3.0:1746066824.179920:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17429 00000100:00100000:0.0:1746066824.181750:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.182496:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985766912 00000100:00100000:1.0:1746066824.182504:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985766912 00000100:00100000:1.0:1746066824.182540:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6610 00000100:00100000:1.0:1746066824.182547:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3822:x1830882985766912:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066824.182723:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3822:x1830882985766912:12345-192.168.204.16@tcp:35:cat.0 Request processed in 175us (976us total) trans 8589937960 rc 0/0 00000100:00100000:1.0:1746066824.182729:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6610 00000100:00100000:2.0:1746066824.183118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.183205:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767040 00000100:00100000:0.0:1746066824.183208:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767040 00000100:00100000:0.0:1746066824.183241:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 975 00000100:00100000:0.0:1746066824.183250:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985767040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.183258:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.183278:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfb3541 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8903 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.183295:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066824.183299:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.183317:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985767040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.183326:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 975 00000100:00100000:0.0:1746066824.184764:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.184798:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.184822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.184841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.184865:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767168 00000100:00100000:0.0:1746066824.184869:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767168 00000100:00100000:3.0:1746066824.184871:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767296 00000100:00100000:3.0:1746066824.184874:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767296 00000100:00100000:3.0:1746066824.185020:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767424 00000100:00100000:2.0:1746066824.185022:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767552 00000100:00100000:3.0:1746066824.185023:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767424 00000100:00100000:2.0:1746066824.185025:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767552 00000100:00100000:3.0:1746066824.185040:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21194 00000100:00100000:3.0:1746066824.185045:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985767168:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066824.185047:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21195 00000100:00100000:0.0:1746066824.185051:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985767296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.185057:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.185057:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.185069:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb3556 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d890a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.185069:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589b600/0xf1867c21abfb354f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8911 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.185107:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240448:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066824.185107:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985240320:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066824.185143:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21196 00000100:00100000:1.0:1746066824.185149:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985767424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.185154:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066824.185158:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00010000:00010000:1.0:1746066824.185160:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8918 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.185170:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066824.185171:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21197 00010000:00010000:1.0:1746066824.185172:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066824.185174:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985767552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.185178:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.185178:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.185184:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d891f expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.185188:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.185190:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.185192:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.185195:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.185196:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bc400, rc 0) 00010000:00010000:3.0:1746066824.185203:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.185209:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ba00, rc 0) 00000100:00100000:0.0:1746066824.185328:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.185394:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2014:x1830882985767424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 245us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.185400:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21196 00000100:00100000:3.0:1746066824.185460:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985767552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 283us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.185465:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21197 00002000:00010000:1.0:1746066824.187188:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.187193:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.187195:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066824 -> 1746066825 00000100:00100000:1.0:1746066824.187209:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094370700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985240320:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066824.187243:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589b600/0xf1867c21abfb354f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8911 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.187254:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589b600/0xf1867c21abfb354f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8911 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.187274:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589b600, rc 0) 00000100:00100000:1.0:1746066824.187299:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985767296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2247us (2501us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066824.187308:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21195 00002000:00010000:3.0:1746066824.187957:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066824 -> 1746066825 00002000:00010000:3.0:1746066824.187961:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066824 -> 1746066825 00002000:00010000:3.0:1746066824.187962:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066824 -> 1746066825 00000100:00100000:3.0:1746066824.187972:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240448:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066824.187988:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb3556 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d890a expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.187996:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfb3556 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d890a expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.188005:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575aa00, rc 0) 00000100:00100000:3.0:1746066824.188021:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985767168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2976us (3262us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066824.188025:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21194 00000100:00100000:0.0:1746066824.190777:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.190855:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767680 00000100:00100000:3.0:1746066824.190862:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767680 00000100:00100000:3.0:1746066824.190927:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21198 00000100:00100000:3.0:1746066824.190936:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3822:x1830882985767680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.190951:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.190965:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8926 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.190990:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.191002:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.191004:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.191007:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.191033:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.191044:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 36 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.191054:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.191121:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.195218:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240576:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.195260:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.195277:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:3.0:1746066824.195489:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3822:x1830882985767680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4553us (4718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.195496:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21198 00000100:00100000:0.0:1746066824.195858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.197218:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767808 00000100:00100000:2.0:1746066824.197236:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767808 00002000:00100000:2.0:1746066824.197276:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1048575) req@ffff880094373800 x1830882985767808/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.197285:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373800 with x1830882985767808 ext(1019904->1048575) 00010000:00010000:2.0:1746066824.197294:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.197309:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.197316:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094373800 00000100:00100000:2.0:1746066824.197351:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2307 00000100:00100000:2.0:1746066824.197358:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882985767808:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066824.200107:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985767808:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2741us (4240us total) trans 17179875537 rc 0/0 00000100:00100000:3.0:1746066824.200118:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2307 00002000:00100000:3.0:1746066824.200128:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (1019904->1048575) req@ffff880094373800 x1830882985767808/t17179875537(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.200137:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373800 with x1830882985767808 ext(1019904->1048575) 00010000:00010000:3.0:1746066824.200147:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.200159:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.200166:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094373800 00000100:00100000:0.0:1746066824.205796:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.205994:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985767936 00000100:00100000:2.0:1746066824.206003:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985767936 00010000:00010000:2.0:1746066824.206048:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.206086:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9790 00000100:00100000:2.0:1746066824.206093:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985767936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.206106:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.206124:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.206137:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.206156:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfb34c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1019904->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88d2 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.206185:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.206188:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.206194:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.206202:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.206245:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.206256:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985240704:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.206336:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.212720:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985240704:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.212739:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.212968:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985767936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6873us (7179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.212980:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9790 00000100:00100000:0.0:1746066824.215476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.215835:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985768192 00000100:00100000:3.0:1746066824.215843:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985768192 00002000:00100000:3.0:1746066824.215878:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880094373480 x1830882985768192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.215914:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373480 with x1830882985768192 ext(0->1048575) 00002000:00010000:3.0:1746066824.215919:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094373480 00000100:00100000:3.0:1746066824.215936:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8083 00000100:00100000:3.0:1746066824.215943:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985768192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.223928:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985768192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7975us (8446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.223943:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8083 00002000:00100000:3.0:1746066824.223955:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880094373480 x1830882985768192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.223964:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094373480 with x1830882985768192 ext(0->1048575) 00002000:00010000:3.0:1746066824.223969:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094373480 00000100:00100000:0.0:1746066824.240859:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.241093:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985768320 00000100:00100000:3.0:1746066824.241102:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985768320 00000100:00100000:3.0:1746066824.241151:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21199 00000100:00100000:3.0:1746066824.241158:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3822:x1830882985768320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.241171:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.241186:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d892d expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.241502:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.241508:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.241510:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.241513:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.241537:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 36 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.241547:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 36 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.241690:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985240832:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.242074:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.248318:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882985240832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.248347:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.248367:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575aa00, rc 0) 00000100:00100000:3.0:1746066824.248407:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3822:x1830882985768320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7249us (7555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.248415:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21199 00000100:00100000:2.0:1746066824.251812:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.251822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.251862:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985768704 00000100:00100000:0.0:1746066824.251862:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985768448 00000100:00100000:2.0:1746066824.251869:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985768704 00000100:00100000:0.0:1746066824.251869:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985768448 00000100:00100000:2.0:1746066824.251929:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17430 00002000:00100000:0.0:1746066824.251930:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1368063) req@ffff8800a5d81880 x1830882985768448/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066824.251934:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3824:x1830882985768704:12345-192.168.204.16@tcp:101:multiop.0 00002000:00100000:0.0:1746066824.251940:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830882985768448 ext(1048576->1368063) 00010000:00010000:0.0:1746066824.251949:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.251950:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.251963:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfb3579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8934 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.251963:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746066824.251969:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d81880 00000100:00100000:0.0:1746066824.251983:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2308 00000100:00100000:0.0:1746066824.251988:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882985768448:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746066824.252022:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252033:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252041:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252051:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252056:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252060:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252140:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfb358e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252148:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfb358e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252154:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfb358e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066824.252161:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066824.252219:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252223:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252240:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252244:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252248:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9c600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.252250:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252254:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252260:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066824.252262:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.252264:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252267:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c600/0xf1867c21abfb3580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252289:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252298:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252303:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252307:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9dc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.252309:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252314:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252320:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9700) 00010000:00010000:2.0:1746066824.252322:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.252324:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252327:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9dc00/0xf1867c21abfb3587 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066824.252355:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfb3579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8934 expref: 25 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.252364:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfb358e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8934 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.252369:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.252371:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066824.252373:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9da00, rc 0) 00000100:00100000:2.0:1746066824.252400:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3824:x1830882985768704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 464us (579us total) trans 8589937961 rc 0/0 00000100:00100000:2.0:1746066824.252406:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17430 00000100:00100000:1.0:1746066824.258558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.258581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.258674:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.258705:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769216 00000100:00100000:3.0:1746066824.258707:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769088 00000100:00100000:1.0:1746066824.258713:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769216 00000100:00100000:3.0:1746066824.258717:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769088 00000100:00100000:1.0:1746066824.258750:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21200 00000100:00100000:1.0:1746066824.258759:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3818:x1830882985769216:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066824.258773:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 976 00010000:00010000:1.0:1746066824.258774:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066824.258781:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985769088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.258789:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d893b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.258793:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.258813:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfb358e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8934 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.258816:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.258824:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.258825:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.258829:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [503808->1048575] (req 503808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.258836:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.258840:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.258914:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2016:x1830882985769088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.258920:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 976 00000100:00100000:0.0:1746066824.258946:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985768960 00000100:00100000:0.0:1746066824.258951:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985768960 00000100:00100000:0.0:1746066824.258975:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6611 00000100:00100000:0.0:1746066824.258980:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3824:x1830882985768960:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066824.259085:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985768448:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7095us (7278us total) trans 21474842879 rc 0/0 00000100:00100000:2.0:1746066824.259096:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2308 00002000:00100000:2.0:1746066824.259105:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1368063) req@ffff8800a5d81880 x1830882985768448/t21474842879(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.259114:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830882985768448 ext(1048576->1368063) 00010000:00010000:2.0:1746066824.259121:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.259134:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.259141:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d81880 00000100:00100000:0.0:1746066824.259650:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3824:x1830882985768960:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 667us (1101us total) trans 8589937962 rc 0/0 00000100:00100000:0.0:1746066824.259657:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6611 00010000:00010000:1.0:1746066824.262013:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.262031:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 21 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.262046:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240960:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.262349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.262388:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.264997:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769344 00000100:00100000:3.0:1746066824.265014:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769344 00010000:00010000:3.0:1746066824.265060:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.265105:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9791 00000100:00100000:3.0:1746066824.265112:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985769344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.265126:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.265148:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.265159:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.265181:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfb34ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e0 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.265198:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.265199:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.265206:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.265215:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.265255:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.265267:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985241088:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066824.265359:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.272164:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882985240960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.272197:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [503808->1048575] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.272217:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bdc00, rc 0) 00000100:00100000:1.0:1746066824.272276:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3818:x1830882985769216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13517us (13600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.272285:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21200 00000100:00100000:2.0:1746066824.272652:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985241088:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.272665:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.272686:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985769344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7574us (10339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.272695:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9791 00000100:00100000:0.0:1746066824.273094:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.273168:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769472 00000100:00100000:2.0:1746066824.273175:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769472 00010000:00010000:2.0:1746066824.273196:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.273215:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9792 00000100:00100000:2.0:1746066824.273222:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985769472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.273245:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.273261:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.273272:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.273293:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfb356b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8926 expref: 22 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.273462:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.273464:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.273471:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.273479:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.273511:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.273523:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985241216:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.273785:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.274425:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.274522:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769600 00000100:00100000:1.0:1746066824.274526:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769600 00000100:00080000:0.0:1746066824.274598:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066824.274649:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17431 00000100:00100000:1.0:1746066824.274657:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+6:3825:x1830882985769600:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.274675:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.274690:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8942 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.274743:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274755:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274765:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274777:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274786:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274791:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274858:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274869:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.274875:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.274926:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.274937:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 23 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.274947:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985241344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.274997:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.282516:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.282553:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.282581:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985769856 00000100:00100000:0.0:1746066824.282590:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985769856 00002000:00100000:0.0:1746066824.282636:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d7e300 x1830882985769856/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.282651:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830882985769856 ext(1048576->2097151) 00002000:00010000:0.0:1746066824.282657:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7e300 00000100:00100000:1.0:1746066824.282739:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985241344:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.282761:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066824.282822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.282851:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770240 00000100:00100000:1.0:1746066824.282855:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770240 00010000:00010000:1.0:1746066824.282872:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 24 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.282915:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9793 00000100:00100000:1.0:1746066824.282923:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985770240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.282935:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.282941:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 24 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.282951:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 24 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.282973:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfb3357 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8823 expref: 24 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.283669:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5766680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985241216:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.283683:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.283727:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985769472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10504us (10634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.283735:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9792 00000100:00100000:0.0:1746066824.283827:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770112 00000100:00100000:0.0:1746066824.283831:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770112 00002000:00100000:0.0:1746066824.283851:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d7d880 x1830882985770112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.283858:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882985770112 ext(1048576->2097151) 00002000:00010000:0.0:1746066824.283862:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7d880 00010000:00010000:1.0:1746066824.283900:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.283905:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.283920:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.283927:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.283944:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.283945:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8084 00000100:00100000:3.0:1746066824.283954:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985769856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.283961:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985770240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1040us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.283968:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9793 00010000:00010000:1.0:1746066824.283986:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.283992:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066824.284044:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066824.284049:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066824.284066:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284077:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284088:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284094:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284099:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284105:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284111:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bcc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.284115:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284121:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284130:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066824.284133:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.284137:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284141:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284151:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284155:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284159:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284163:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.284164:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284168:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284174:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fc3db00) 00010000:00010000:1.0:1746066824.284176:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.284178:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284182:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.284215:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.284237:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 7 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.284243:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.284245:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066824.284248:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd000, rc 0) 00000100:00100000:1.0:1746066824.284274:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985769600:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9618us (9849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.284280:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17431 00000100:00100000:2.0:1746066824.284987:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8085 00000100:00100000:2.0:1746066824.284995:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985770112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.298810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.298816:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.298850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.298855:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771136 00000100:00100000:1.0:1746066824.298866:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771136 00000100:00100000:0.0:1746066824.298876:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.298924:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.298956:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770368 00000100:00100000:0.0:1746066824.298960:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770368 00000100:00100000:0.0:1746066824.298993:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770496 00000100:00100000:0.0:1746066824.298995:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770496 00000100:00100000:0.0:1746066824.299006:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770624 00000100:00100000:0.0:1746066824.299007:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770624 00000100:00100000:1.0:1746066824.299009:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17432 00000100:00100000:0.0:1746066824.299016:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770752 00000100:00100000:0.0:1746066824.299017:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770752 00000100:00100000:1.0:1746066824.299019:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:3828:x1830882985771136:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066824.299029:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21201 00000100:00100000:0.0:1746066824.299034:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985770368:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.299044:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.299044:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.299060:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bca00/0xf1867c21abfb35c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d896c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.299061:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfb35bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8949 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.299115:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985241472:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066824.299134:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299148:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299159:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299170:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299176:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299185:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299189:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a840 going to sleep for 11 seconds 00000100:00080000:0.0:1746066824.299205:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066824.299218:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21202 00000100:00100000:0.0:1746066824.299232:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985770496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.299240:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.299249:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8950 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.299262:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.299264:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.299273:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.299285:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.299288:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299295:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c800, rc 0) 00010000:00010000:1.0:1746066824.299297:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299303:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066824.299312:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:0.0:1746066824.299316:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985770496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 93us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.299321:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21202 00000100:00100000:0.0:1746066824.299335:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21203 00000100:00100000:0.0:1746066824.299339:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985770624:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.299349:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.299355:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8957 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.299364:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.299367:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.299371:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.299380:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.299383:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299386:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d400, rc 0) 00010000:00010000:1.0:1746066824.299389:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299395:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299400:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985770624:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (523us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066824.299402:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299405:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21203 00010000:00010000:1.0:1746066824.299408:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bde00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.299412:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299413:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21204 00000100:00100000:0.0:1746066824.299417:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985770752:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.299418:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299422:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.299428:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066824.299428:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d895e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.299432:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.299435:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299437:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.299438:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.299440:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bde00/0xf1867c21abfb35cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299442:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.299451:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.299454:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.299458:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c200, rc 0) 00010000:00010000:1.0:1746066824.299459:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299464:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299468:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.299471:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299472:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985770752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (547us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066824.299476:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.299480:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21204 00010000:00010000:1.0:1746066824.299481:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fc3c900) 00010000:00010000:1.0:1746066824.299483:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.299485:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299490:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd400/0xf1867c21abfb35d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.299524:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bca00/0xf1867c21abfb35c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 40 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.299537:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.299543:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.299545:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066824.299547:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bcc00, rc 0) 00000100:00100000:1.0:1746066824.299568:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3828:x1830882985771136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 551us (753us total) trans 8589937963 rc 0/0 00000100:00100000:1.0:1746066824.299573:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17432 00000100:00100000:2.0:1746066824.306958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.307001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.307026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.307167:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2014:x1830882985770112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22170us (24610us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.307177:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8085 00002000:00100000:2.0:1746066824.307188:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff8800a5d7d880 x1830882985770112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.307197:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882985770112 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.307203:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7d880 00000100:00100000:2.0:1746066824.307263:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.307338:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985770880 00000100:00100000:1.0:1746066824.307347:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985770880 00000100:00100000:1.0:1746066824.307376:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771264 00000100:00100000:1.0:1746066824.307378:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771264 00000100:00100000:1.0:1746066824.307387:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771392 00000100:00100000:1.0:1746066824.307389:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771392 00000100:00100000:1.0:1746066824.307405:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21205 00000100:00100000:1.0:1746066824.307411:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985770880:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.307427:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.307446:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8965 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307470:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307472:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307481:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.307496:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.307508:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59e00, rc 0) 00000100:00100000:0.0:1746066824.307518:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771648 00000100:00100000:0.0:1746066824.307522:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771648 00000100:00100000:1.0:1746066824.307530:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985770880:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 119us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.307535:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21205 00000100:00100000:0.0:1746066824.307545:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6612 00000100:00100000:1.0:1746066824.307546:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21206 00000100:00100000:1.0:1746066824.307550:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985771264:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746066824.307550:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:3828:x1830882985771648:12345-192.168.204.16@tcp:35:cat.0 00010000:00010000:1.0:1746066824.307558:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.307567:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8973 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307578:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307579:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307583:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.307592:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.307598:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59600, rc 0) 00000100:00100000:1.0:1746066824.307611:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985771264:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 60us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.307615:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21206 00000100:00100000:1.0:1746066824.307624:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21207 00000100:00100000:1.0:1746066824.307628:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+38:3818:x1830882985771392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066824.307636:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.307642:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d897a expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307656:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307664:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.307669:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307670:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.307673:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 39 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307698:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066824.307698:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:3828:x1830882985771648:12345-192.168.204.16@tcp:35:cat.0 Request processed in 147us (434us total) trans 8589937964 rc 0/0 00000100:00100000:0.0:1746066824.307704:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6612 00010000:00010000:1.0:1746066824.307709:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 10 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.307721:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985241600:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.307783:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.307791:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 29 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.307804:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985241728:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.307822:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.307829:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985241472:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066824.307855:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfb35bf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8949 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.307866:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfb35bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8949 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.307874:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d600, rc 0) 00000100:00100000:0.0:1746066824.307910:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985770368:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 8876us (9112us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066824.307917:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21201 00000100:00100000:1.0:1746066824.308418:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985769856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24464us (25911us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.308425:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8084 00002000:00100000:1.0:1746066824.308432:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d7e300 x1830882985769856/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.308440:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7e300 with x1830882985769856 ext(1048576->2097151) 00010000:00010000:1.0:1746066824.308446:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 28 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.308455:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 28 pid: 11630 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746066824.308461:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7e300 00000100:00100000:1.0:1746066824.312694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.312741:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.312857:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771904 00000100:00100000:3.0:1746066824.312866:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771904 00000100:00100000:0.0:1746066824.312866:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985771776 00000100:00100000:0.0:1746066824.312870:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985771776 00000100:00100000:3.0:1746066824.312932:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21208 00000100:00100000:3.0:1746066824.312940:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3824:x1830882985771904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.312958:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066824.312968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066824.312974:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8988 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.313004:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 40 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.313010:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985241600:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.313012:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.313018:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.313024:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.313026:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.313028:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2207744->2723839] (req 2207744->2723839) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.313045:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985241728:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.313055:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.313066:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 29 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.313066:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.313078:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985241856:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.313080:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd200, rc 0) 00010000:00010000:3.0:1746066824.313143:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066824.313146:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21209 00010000:00010000:3.0:1746066824.313151:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.313154:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985771776:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066824.313159:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985241984:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.313161:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985772288 00010000:00010000:0.0:1746066824.313161:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066824.313165:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985772288 00010000:00010000:0.0:1746066824.313168:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb361a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8981 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.313183:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066824.313189:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17433 00000100:00100000:1.0:1746066824.313194:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985772288:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.313204:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066824.313210:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+41:3818:x1830882985771392:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5580us (6182us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066824.313216:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb3621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d898f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.313218:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 41 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.313219:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21207 00010000:00010000:3.0:1746066824.313239:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 41 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.313247:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985242112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.313264:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746066824.313316:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb361a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8981 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.313326:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.313326:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2dc00/0xf1867c21abfb361a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8981 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066824.313328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066824.313338:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2dc00, rc 0) 00010000:00010000:1.0:1746066824.313342:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.313345:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985772032 00000100:00100000:3.0:1746066824.313348:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985772032 00010000:00010000:1.0:1746066824.313350:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.313356:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066824.313356:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985771776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 203us (615us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066824.313361:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21209 00010000:00010000:3.0:1746066824.313362:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 11 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.313372:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.313380:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9794 00010000:00010000:1.0:1746066824.313381:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 39 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.313385:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985772032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066824.313389:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.313393:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.313410:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 11 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.313419:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.313427:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 8 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.313430:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 11 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.313435:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.313444:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c800/0xf1867c21abfb35db lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8950 expref: 11 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.313450:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912240 going to sleep for 11 seconds 00010000:00010000:3.0:1746066824.313462:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.313478:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2013:x1830882985772032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.313484:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9794 00000100:00100000:0.0:1746066824.324062:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.324451:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.324481:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.324722:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985772928 00000100:00100000:1.0:1746066824.324732:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985772928 00002000:00100000:1.0:1746066824.324782:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7ed80 x1830882985772928/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.324792:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882985772928 ext(2097152->4194303) 00010000:00010000:1.0:1746066824.324802:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 30 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.324815:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 30 pid: 13726 timeout: 892 lvb_type: 1 00002000:00010000:1.0:1746066824.324822:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:3.0:1746066824.324939:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985772416 00000100:00100000:3.0:1746066824.324944:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985772416 00010000:00010000:3.0:1746066824.324961:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 31 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.324989:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9795 00000100:00100000:3.0:1746066824.324995:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985772416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.325007:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.325026:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 31 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.325036:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 31 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.325057:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575aa00/0xf1867c21abfb3572 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d892d expref: 31 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.325083:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.325086:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.325093:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.325101:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.325135:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.325146:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985242496:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066824.325323:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.325567:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985772800 00000100:00100000:1.0:1746066824.325571:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985772800 00002000:00100000:1.0:1746066824.325590:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5d7f100 x1830882985772800/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.325597:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882985772800 ext(2097152->4194303) 00002000:00010000:1.0:1746066824.325601:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:2.0:1746066824.325673:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2309 00000100:00100000:2.0:1746066824.325682:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985772928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.327127:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985241856:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.329309:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8086 00000100:00100000:1.0:1746066824.329326:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985772800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.331138:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.331165:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.331184:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773056 00000100:00100000:0.0:1746066824.331192:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773056 00010000:00010000:0.0:1746066824.331238:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.331373:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773312 00000100:00100000:0.0:1746066824.331377:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773312 00010000:00010000:0.0:1746066824.331391:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.331406:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9796 00000100:00100000:0.0:1746066824.331415:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985773056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.331426:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.331443:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.331455:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 10 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.331480:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.331506:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985773056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.331513:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9796 00000100:00100000:0.0:1746066824.331527:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9797 00000100:00100000:0.0:1746066824.331531:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985773312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.331538:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.331542:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331550:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331563:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066824.331568:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.331578:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.331587:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.331598:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985773312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.331603:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9797 00000100:00100000:0.0:1746066824.331674:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.331689:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773184 00000100:00100000:0.0:1746066824.331691:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773184 00010000:00010000:0.0:1746066824.331701:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 40 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.331714:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9798 00000100:00100000:0.0:1746066824.331718:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985773184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.331725:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.331729:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 40 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331736:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 40 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331746:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066824.331749:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.331756:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.331763:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066824.331781:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.331800:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985773184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.331806:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9798 00000100:00100000:0.0:1746066824.331849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.331873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.331881:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773568 00000100:00100000:0.0:1746066824.331909:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773568 00010000:00010000:0.0:1746066824.331920:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.331932:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9799 00000100:00100000:0.0:1746066824.331937:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985773568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.331942:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.331948:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331956:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.331967:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.331979:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985773568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.331984:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9799 00000100:00100000:0.0:1746066824.332061:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985242496:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066824.332077:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.332091:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985772416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7097us (8043us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.332097:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9795 00000100:00100000:0.0:1746066824.332169:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773696 00000100:00100000:0.0:1746066824.332172:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773696 00002000:00100000:0.0:1746066824.332198:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->503807) req@ffff8800a5b0ce00 x1830882985773696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.332207:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ce00 with x1830882985773696 ext(0->503807) 00002000:00010000:0.0:1746066824.332212:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ce00 00000100:00100000:0.0:1746066824.332235:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8087 00000100:00100000:0.0:1746066824.332240:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985773696:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066824.332308:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a59600/0xf1867c21abfb3605 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8973 expref: 9 pid: 13726 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.332321:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985241984:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.332331:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfb34f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88e7 expref: 38 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.332340:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985242112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.332361:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2207744->2723839] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.332375:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894200, rc 0) 00000100:00100000:3.0:1746066824.332409:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3824:x1830882985771904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 19470us (19728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.332417:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21208 00010000:00010000:1.0:1746066824.336308:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bcc00/0xf1867c21abfb35e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d896c expref: 39 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.336352:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242240:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.336367:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6bd000/0xf1867c21abfb35b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8942 expref: 8 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.336381:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242368:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.336404:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.336413:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.336422:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066824.336446:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066824.336583:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb3621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.336595:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.336604:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.336606:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066824.336609:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc200, rc 0) 00000100:00100000:1.0:1746066824.336650:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985772288:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 23455us (23682us total) trans 8589937965 rc 0/0 00000100:00100000:1.0:1746066824.336657:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17433 00000100:00100000:0.0:1746066824.342080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.342157:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985773952 00000100:00100000:2.0:1746066824.342167:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985773952 00002000:00100000:2.0:1746066824.342215:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1286144->1290239) req@ffff8800a5b0ca80 x1830882985773952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.342236:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ca80 with x1830882985773952 ext(1286144->1290239) 00002000:00010000:2.0:1746066824.342242:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0ca80 00000100:00100000:2.0:1746066824.342274:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8088 00000100:00100000:2.0:1746066824.342282:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985773952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.342431:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985773952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 149us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066824.342438:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8088 00002000:00100000:2.0:1746066824.342443:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1286144->1290239) req@ffff8800a5b0ca80 x1830882985773952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.342450:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ca80 with x1830882985773952 ext(1286144->1290239) 00002000:00010000:2.0:1746066824.342453:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0ca80 00000100:00100000:2.0:1746066824.346303:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985772928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20608us (21838us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066824.346316:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2309 00002000:00100000:2.0:1746066824.346330:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5d7ed80 x1830882985772928/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.346346:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882985772928 ext(2097152->4194303) 00010000:00010000:2.0:1746066824.346357:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.346372:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00002000:00010000:2.0:1746066824.346379:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:1.0:1746066824.356673:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985772800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27342us (32178us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066824.356685:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8086 00002000:00100000:1.0:1746066824.356696:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5d7f100 x1830882985772800/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.356705:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882985772800 ext(2097152->4194303) 00002000:00010000:1.0:1746066824.356712:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:1.0:1746066824.357738:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.357770:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985773696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25527us (25918us total) trans 0 rc 503808/503808 00000100:00100000:1.0:1746066824.357775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.357778:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8087 00002000:00100000:2.0:1746066824.357785:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->503807) req@ffff8800a5b0ce00 x1830882985773696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 503808/503808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.357793:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0ce00 with x1830882985773696 ext(0->503807) 00000100:00100000:1.0:1746066824.357794:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774208 00002000:00010000:2.0:1746066824.357797:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5b0ce00 00000100:00100000:1.0:1746066824.357801:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774208 00000100:00100000:1.0:1746066824.357842:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17434 00000100:00100000:1.0:1746066824.357849:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985774208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.357872:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.357910:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb3636 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8996 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.357998:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.358014:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.358021:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.358049:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.358060:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 9 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.358071:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242624:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.358147:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.358244:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.358327:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774080 00000100:00100000:0.0:1746066824.358332:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774080 00010000:00010000:0.0:1746066824.358351:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.358369:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9800 00000100:00100000:0.0:1746066824.358373:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985774080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.358382:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.358401:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.358410:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.358433:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfb3564 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d891f expref: 28 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.358460:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.358462:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.358468:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.358475:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.358496:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.358504:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985242752:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066824.358527:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.358581:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774464 00000100:00100000:2.0:1746066824.358584:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774464 00000100:00100000:2.0:1746066824.358607:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6613 00000100:00100000:2.0:1746066824.358611:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:3818:x1830882985774464:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066824.358815:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3818:x1830882985774464:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 202us (571us total) trans 8589937966 rc 0/0 00000100:00100000:2.0:1746066824.358820:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6613 00000100:00100000:1.0:1746066824.360281:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882985242624:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.360292:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066824.360340:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066824.360387:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774592 00000100:00100000:3.0:1746066824.360391:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774592 00010000:00010000:3.0:1746066824.360411:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 10 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.360432:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9801 00000100:00100000:3.0:1746066824.360438:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985774592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.360447:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.360452:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 10 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.360462:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 10 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.360479:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3628 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d898f expref: 10 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.360502:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.360506:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.360514:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.360521:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066824.360535:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.360566:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2014:x1830882985774592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.360572:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9801 00010000:00010000:1.0:1746066824.360754:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.360760:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066824.360801:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066824.360805:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066824.360817:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.360842:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc000/0xf1867c21abfb3636 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8996 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.360867:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8996 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.360873:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.360876:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066824.360878:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:1.0:1746066824.360918:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985774208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3070us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.360924:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17434 00000100:00100000:0.0:1746066824.362022:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.362141:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774720 00000100:00100000:3.0:1746066824.362147:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774720 00000100:00100000:3.0:1746066824.362186:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21210 00000100:00100000:3.0:1746066824.362192:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3822:x1830882985774720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.362212:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.362236:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d899d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.362261:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.362267:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.362269:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066824.362273:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.362297:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.362308:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.362325:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985242880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.362700:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.367398:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985242752:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066824.367422:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.367482:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882985774080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9106us (9747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.367493:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9800 00000100:00100000:0.0:1746066824.369996:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.370041:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.370052:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985774976 00000100:00100000:2.0:1746066824.370061:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985774976 00000100:00100000:0.0:1746066824.370064:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.370081:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985775104 00000100:00100000:0.0:1746066824.370087:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985775104 00000100:00100000:0.0:1746066824.370124:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985775232 00000100:00100000:0.0:1746066824.370126:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985775232 00000100:00100000:0.0:1746066824.370140:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21211 00000100:00100000:0.0:1746066824.370146:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985775104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.370164:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.370181:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb364b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89a4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.370243:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985243008:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066824.370306:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.370324:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.370338:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985775360 00000100:00100000:0.0:1746066824.370341:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985775360 00000100:00100000:0.0:1746066824.370354:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21212 00000100:00100000:0.0:1746066824.370358:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985775232:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.370364:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.370373:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb3652 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89ab expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.370395:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985243136:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066824.370411:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.370424:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21213 00000100:00100000:0.0:1746066824.370428:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985775360:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.370432:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.370438:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3659 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89b2 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.370457:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985243264:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066824.370471:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097eeb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.370504:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066824.370644:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (1290240->2097151) req@ffff8800a5b0e300 x1830882985774976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.370653:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0e300 with x1830882985774976 ext(1290240->2097151) 00002000:00010000:2.0:1746066824.370658:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0e300 00000100:00100000:2.0:1746066824.370675:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985775616 00000100:00100000:2.0:1746066824.370677:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985775616 00002000:00100000:2.0:1746066824.370692:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2719744->2723839) req@ffff8800a5d7dc00 x1830882985775616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.370698:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830882985775616 ext(2719744->2723839) 00010000:00010000:2.0:1746066824.370703:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.370716:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.370722:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:2.0:1746066824.370746:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2310 00000100:00100000:2.0:1746066824.370752:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985775616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.370766:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8089 00000100:00100000:0.0:1746066824.370773:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985774976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.370862:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985775616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 110us (356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066824.370868:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2310 00002000:00100000:2.0:1746066824.370874:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2719744->2723839) req@ffff8800a5d7dc00 x1830882985775616/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.370880:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7dc00 with x1830882985775616 ext(2719744->2723839) 00010000:00010000:2.0:1746066824.370902:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.370911:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.370917:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7dc00 00000100:00100000:3.0:1746066824.371108:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985242880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.371131:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.371142:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ec800, rc 0) 00000100:00100000:3.0:1746066824.371176:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3822:x1830882985774720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8984us (9157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.371182:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21210 00002000:00010000:0.0:1746066824.376665:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066824 -> 1746066825 00002000:00010000:0.0:1746066824.376673:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066824 -> 1746066825 00002000:00010000:0.0:1746066824.376675:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066824 -> 1746066825 00000100:00100000:0.0:1746066824.376698:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985243264:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066824.376727:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3659 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b2 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.376740:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3659 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b2 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.376752:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cca00, rc 0) 00000100:00100000:0.0:1746066824.376800:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985775360:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6370us (6473us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066824.376807:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21213 00000100:00100000:0.0:1746066824.376855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.376875:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985243008:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066824.376875:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985243136:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066824.376926:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb364b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89a4 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.376927:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb3652 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ab expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.376936:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2cc00/0xf1867c21abfb364b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89a4 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.376936:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2c000/0xf1867c21abfb3652 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ab expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.376951:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2cc00, rc 0) 00010000:00010000:1.0:1746066824.376951:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:0.0:1746066824.376970:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.376991:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985775104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6845us (6950us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066824.376995:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985775232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6634us (6928us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066824.376997:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21211 00000100:00100000:1.0:1746066824.377001:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21212 00000100:00100000:0.0:1746066824.377025:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985775872 00000100:00100000:0.0:1746066824.377030:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985775872 00002000:00100000:0.0:1746066824.377064:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2207744->2723839) req@ffff8800930e2300 x1830882985775872/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066824.377200:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776128 00000100:00100000:3.0:1746066824.377203:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776128 00002000:00100000:0.0:1746066824.377207:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2300 with x1830882985775872 ext(2207744->2723839) 00010000:00010000:0.0:1746066824.377215:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.377236:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746066824.377242:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e2300 00000100:00100000:3.0:1746066824.377249:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6614 00000100:00100000:3.0:1746066824.377256:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3824:x1830882985776128:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066824.377270:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2311 00000100:00100000:0.0:1746066824.377278:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985775872:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066824.377760:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3824:x1830882985776128:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 504us (903us total) trans 8589937967 rc 0/0 00000100:00100000:3.0:1746066824.377766:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6614 00000100:00100000:2.0:1746066824.382659:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985774976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11872us (12660us total) trans 0 rc 806912/806912 00000100:00100000:2.0:1746066824.382670:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8089 00002000:00100000:2.0:1746066824.382682:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1290240->2097151) req@ffff8800a5b0e300 x1830882985774976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.382692:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5b0e300 with x1830882985774976 ext(1290240->2097151) 00002000:00010000:2.0:1746066824.382699:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5b0e300 00000100:00100000:1.0:1746066824.384207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.384236:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776384 00000100:00100000:1.0:1746066824.384242:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776384 00000100:00100000:1.0:1746066824.384288:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17435 00000100:00100000:1.0:1746066824.384295:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985776384:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.384313:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.384329:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3660 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89b9 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.384416:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.384430:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066824.384440:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066824.384451:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066824.384517:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d800/0xf1867c21abfb3660 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b9 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.384530:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b9 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.384537:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.384539:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066824.384543:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c000, rc 0) 00000100:00100000:1.0:1746066824.384570:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3825:x1830882985776384:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 276us (368us total) trans 8589937968 rc 0/0 00000100:00100000:1.0:1746066824.384575:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17435 00000100:00100000:2.0:1746066824.385726:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985775872:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8445us (8751us total) trans 21474842880 rc 0/0 00000100:00100000:2.0:1746066824.385738:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2311 00002000:00100000:2.0:1746066824.385746:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (2207744->2723839) req@ffff8800930e2300 x1830882985775872/t21474842880(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.385755:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2300 with x1830882985775872 ext(2207744->2723839) 00010000:00010000:2.0:1746066824.385763:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.385775:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.385782:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930e2300 00000100:00100000:0.0:1746066824.388520:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.388564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.388611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.388771:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776768 00000100:00100000:3.0:1746066824.388780:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776768 00000100:00100000:3.0:1746066824.388817:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776640 00000100:00100000:3.0:1746066824.388819:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776640 00000100:00100000:3.0:1746066824.388835:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21214 00000100:00100000:3.0:1746066824.388842:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985776768:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066824.388920:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.388939:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.388946:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.388952:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.388957:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.388959:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.388962:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 6/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.388991:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.389002:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 37 pid: 3528 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.389014:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.389124:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777280 00000100:00100000:2.0:1746066824.389128:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777280 00010000:00010000:2.0:1746066824.389147:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.389163:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9802 00000100:00100000:2.0:1746066824.389168:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985777280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.389175:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.389193:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.389203:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.389239:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfb3613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2207744->2723839) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8988 expref: 30 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.389254:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.389255:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.389261:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.389268:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.389291:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.389300:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985243520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.389324:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.389413:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21215 00000100:00100000:1.0:1746066824.389422:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985776640:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066824.389442:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.389452:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.389458:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.389459:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.389461:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.389476:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 37 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.389487:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 37 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.389495:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985243648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.389517:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00010000:00010000:3.0:1746066824.390188:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.390197:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 10 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.390211:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.390284:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.390292:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.390300:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.390317:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.393018:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.393088:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.393111:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777024 00000100:00100000:0.0:1746066824.393118:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777024 00000100:00100000:0.0:1746066824.393154:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776896 00000100:00100000:0.0:1746066824.393156:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776896 00000100:00100000:0.0:1746066824.393169:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21216 00000100:00100000:0.0:1746066824.393176:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985777024:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066824.393218:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393252:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393261:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393268:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393274:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.393276:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.393279:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393306:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393317:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 20 pid: 9592 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.393331:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244032:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.393408:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 13 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393416:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 13 pid: 13726 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.393424:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244160:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.393447:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393455:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 38 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.393462:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.393476:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.393513:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.393759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.393775:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777152 00000100:00100000:0.0:1746066824.393777:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777152 00000100:00100000:0.0:1746066824.393793:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777408 00000100:00100000:0.0:1746066824.393795:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777408 00000100:00100000:0.0:1746066824.393807:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21217 00000100:00100000:0.0:1746066824.393812:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985776896:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066824.393828:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393838:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393844:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393851:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393861:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.393863:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.393865:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.393881:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393909:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 20 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.393917:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244416:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.393959:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.393967:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 13 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.393974:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244544:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.393980:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21218 00000100:00100000:2.0:1746066824.393987:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985777152:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066824.393994:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.394001:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.394005:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.394013:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.394016:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.394022:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.394023:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066824.394024:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746066824.394026:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.394040:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21219 00000100:00100000:0.0:1746066824.394045:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:3828:x1830882985777408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066824.394049:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.394052:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.394056:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.394062:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89c0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.394063:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985244800:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.394073:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.394076:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.394082:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066824.394082:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066824.394085:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.394094:0:20361:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.394096:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.394102:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882985243520:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066824.394104:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.394113:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ed800, rc 0) 00010000:00010000:2.0:1746066824.394114:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.394115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.394127:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985776512 00000100:00100000:1.0:1746066824.394129:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985776512 00000100:00100000:2.0:1746066824.394130:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985777280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4961us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.394134:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:3828:x1830882985777408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.394139:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9802 00000100:00100000:0.0:1746066824.394142:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21219 00000100:00100000:1.0:1746066824.394155:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21220 00000100:00100000:1.0:1746066824.394160:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985776512:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746066824.394194:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985243648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.394198:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066824.394211:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.394249:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777536 00000100:00100000:2.0:1746066824.394252:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777536 00000100:00100000:3.0:1746066824.394255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066824.394275:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1290239) req@ffff8800967a9180 x1830882985777536/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.394283:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882985777536 ext(1048576->1290239) 00010000:00010000:2.0:1746066824.394289:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.394297:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.394307:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9180 00010000:00010000:1.0:1746066824.394311:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.394322:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.394328:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.394329:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.394331:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.394334:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777664 00000100:00100000:2.0:1746066824.394338:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777664 00010000:00010000:1.0:1746066824.394347:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.394350:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 40 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.394355:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.394365:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9803 00000100:00100000:1.0:1746066824.394367:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985244928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.394369:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985777664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.394377:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066824.394387:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746066824.394394:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 40 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.394402:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 40 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.394418:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497a00/0xf1867c21abfb3429 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8870 expref: 40 pid: 3528 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.394427:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.394442:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985777664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.394447:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9803 00000100:00100000:2.0:1746066824.394460:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2312 00000100:00100000:2.0:1746066824.394465:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985777536:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066824.398080:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.398135:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985777920 00000100:00100000:2.0:1746066824.398142:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985777920 00002000:00100000:2.0:1746066824.398186:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012b165f80 x1830882985777920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.398197:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165f80 with x1830882985777920 ext(2097152->4194303) 00010000:00010000:2.0:1746066824.398205:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.398216:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 29 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.398230:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165f80 00000100:00100000:2.0:1746066824.398258:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2313 00000100:00100000:2.0:1746066824.398265:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985777920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.401727:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243776:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.411423:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.411568:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985243904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.411599:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.411651:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.411770:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.411809:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.411833:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.411838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.411841:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985244160:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.411852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066824.411858:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.411863:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.411880:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778048 00000100:00100000:0.0:1746066824.411880:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778176 00000100:00100000:1.0:1746066824.411897:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778048 00000100:00100000:0.0:1746066824.411897:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778176 00010000:00010000:0.0:1746066824.411930:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 31 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.411944:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778432 00000100:00100000:3.0:1746066824.411946:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778432 00000100:00100000:0.0:1746066824.411952:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778560 00000100:00100000:0.0:1746066824.411954:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778560 00010000:00010000:3.0:1746066824.411993:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 15 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.411993:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 39 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.412003:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778304 00000100:00100000:0.0:1746066824.412005:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778304 00000100:00100000:3.0:1746066824.412006:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9804 00000100:00100000:3.0:1746066824.412012:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2013:x1830882985778176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.412013:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 21 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412024:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066824.412026:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9805 00000100:00100000:0.0:1746066824.412030:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985778560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.412036:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.412040:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 31 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.412045:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 39 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.412049:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 31 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.412052:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 39 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.412069:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47600/0xf1867c21abfb339d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8838 expref: 31 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.412069:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3502 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88f5 expref: 39 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.412085:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066824.412085:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066824.412114:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 12 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.412119:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985778560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.412125:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9805 00000100:00100000:1.0:1746066824.412128:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9806 00000100:00100000:1.0:1746066824.412132:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985778432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066824.412137:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9807 00010000:00010000:1.0:1746066824.412138:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066824.412140:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985778304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.412145:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 15 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.412145:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.412149:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 21 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.412152:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 15 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.412159:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 21 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.412180:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfb35fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8965 expref: 15 pid: 13726 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.412183:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfb355d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8918 expref: 21 pid: 9592 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.412191:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.412193:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.412197:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.412204:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.412213:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066824.412219:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.412262:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985778176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 250us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.412269:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9804 00000100:00100000:3.0:1746066824.412279:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9808 00000100:00100000:3.0:1746066824.412283:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985778048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.412289:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.412294:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 12 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412302:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 12 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412311:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfb35f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8957 expref: 12 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412322:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.412324:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.412326:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412332:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412342:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.412352:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985778048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.412356:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9808 00010000:00010000:3.0:1746066824.412388:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412395:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412408:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412414:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412420:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412430:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd0c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066824.412434:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412441:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412447:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.412448:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.412452:0:9592:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412457:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.412477:0:9592:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.412488:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985245056:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066824.412530:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.412601:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.412609:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778688 00000100:00100000:3.0:1746066824.412611:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778688 00010000:00010000:3.0:1746066824.412621:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 15 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.412636:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9809 00000100:00100000:3.0:1746066824.412640:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985778688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.412646:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.412653:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 15 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412659:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 15 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412668:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.412678:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985778688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 38us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.412682:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9809 00000100:00100000:3.0:1746066824.412705:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.412713:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778816 00000100:00100000:3.0:1746066824.412715:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778816 00010000:00010000:3.0:1746066824.412721:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 21 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.412732:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9810 00000100:00100000:3.0:1746066824.412736:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2013:x1830882985778816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.412741:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.412747:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 21 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412758:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 21 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412767:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dd1c800/0xf1867c21abfb3484 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88af expref: 21 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.412773:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.412783:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2013:x1830882985778816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.412787:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9810 00000100:00100000:2.0:1746066824.412811:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882985777536:12345-192.168.204.16@tcp:4:cat.0 Request processed in 18344us (18611us total) trans 21474842881 rc 0/0 00000100:00100000:2.0:1746066824.412819:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2312 00002000:00100000:2.0:1746066824.412827:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1290239) req@ffff8800967a9180 x1830882985777536/t21474842881(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.412837:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882985777536 ext(1048576->1290239) 00010000:00010000:2.0:1746066824.412844:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.412853:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.412859:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9180 00000100:00100000:2.0:1746066824.412908:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985244800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.412920:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.412938:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.412953:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985778944 00000100:00100000:2.0:1746066824.412956:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985778944 00000100:00100000:3.0:1746066824.412957:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066824.412965:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.412983:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9811 00000100:00100000:2.0:1746066824.412988:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985778944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.412994:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.413001:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.413008:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 38 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.413018:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.413020:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.413022:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.413028:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.413038:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.413056:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882985778944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.413061:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9811 00000100:00100000:2.0:1746066824.413073:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779072 00000100:00100000:2.0:1746066824.413076:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779072 00002000:00100000:2.0:1746066824.413093:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (503808->1048575) req@ffff880098f56300 x1830882985779072/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.413100:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56300 with x1830882985779072 ext(503808->1048575) 00010000:00010000:2.0:1746066824.413105:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.413113:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 38 pid: 11630 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.413119:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098f56300 00000100:00100000:1.0:1746066824.413129:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985778432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 996us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.413135:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2314 00000100:00100000:1.0:1746066824.413135:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9806 00000100:00100000:2.0:1746066824.413139:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985779072:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066824.413175:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985244928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.413185:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413196:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413201:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413211:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413217:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413236:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413241:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db77a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.413244:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413250:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413259:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413264:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb3683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.413301:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985777024:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 20125us (20293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.413308:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21216 00010000:00010000:1.0:1746066824.413348:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfb35f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d895e expref: 12 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.413355:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.413361:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778600/0xf1867c21abfb347d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d88a8 expref: 39 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.413367:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882985244672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.413382:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413387:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413394:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413405:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413411:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413417:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413422:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2c800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.413424:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413430:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413438:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.413444:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c800/0xf1867c21abfb368a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.413454:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2013:x1830882985778304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1311us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.413460:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9807 00000100:00100000:1.0:1746066824.413469:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985776896:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 19657us (20381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.413474:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21217 00000100:00100000:2.0:1746066824.413766:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985777920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15501us (15735us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066824.413771:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2313 00002000:00100000:2.0:1746066824.413777:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012b165f80 x1830882985777920/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.413784:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165f80 with x1830882985777920 ext(2097152->4194303) 00010000:00010000:2.0:1746066824.413789:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.413802:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746066824.413807:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165f80 00000100:00100000:3.0:1746066824.415245:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985245056:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066824.415264:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.415271:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfb3675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.415329:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2016:x1830882985776768:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 26486us (26763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.415337:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21214 00000100:00100000:0.0:1746066824.417991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.418031:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779200 00000100:00100000:2.0:1746066824.418040:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779200 00010000:00010000:2.0:1746066824.418076:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.418103:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9812 00000100:00100000:2.0:1746066824.418112:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985779200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.418125:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.418144:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.418155:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.418183:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd200/0xf1867c21abfb360c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d897a expref: 40 pid: 13726 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.418201:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.418203:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.418208:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.418230:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.418254:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066824.418266:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418273:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.418289:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882985779200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 179us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066824.418289:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418295:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.418296:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9812 00010000:00010000:1.0:1746066824.418301:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418307:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7d000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.418311:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418317:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418327:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.418332:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d000/0xf1867c21abfb367c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.418379:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985776640:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 28960us (29767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.418387:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21215 00000100:00100000:3.0:1746066824.420415:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985779072:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7268us (7450us total) trans 17179875538 rc 0/0 00000100:00100000:3.0:1746066824.420425:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2314 00002000:00100000:3.0:1746066824.420438:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7f:0x0] (503808->1048575) req@ffff880098f56300 x1830882985779072/t17179875538(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.420447:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098f56300 with x1830882985779072 ext(503808->1048575) 00010000:00010000:3.0:1746066824.420457:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.420470:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.420477:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098f56300 00000100:00100000:0.0:1746066824.420936:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.421172:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779456 00000100:00100000:3.0:1746066824.421180:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779456 00002000:00100000:3.0:1746066824.421211:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009677c700 x1830882985779456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.421218:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882985779456 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.421230:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c700 00000100:00100000:3.0:1746066824.421255:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8090 00000100:00100000:3.0:1746066824.421265:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985779456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.422345:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.422705:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779584 00000100:00100000:1.0:1746066824.422710:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779584 00000100:00100000:1.0:1746066824.422749:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21221 00000100:00100000:1.0:1746066824.422755:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3822:x1830882985779584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.422766:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.422786:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89c7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066824.422804:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 5073344, mtime: 0x6812dd89, atime: 0x6812dd88, ctime: 0x6812dd89, blocks: 0x16b8 00010000:00010000:1.0:1746066824.422821:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.422823:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.422830:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.422842:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.422851:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82c00, rc 0) 00000100:00100000:1.0:1746066824.422877:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3822:x1830882985779584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.422903:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21221 00000100:00100000:0.0:1746066824.426637:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.426704:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779712 00000100:00100000:2.0:1746066824.426712:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779712 00010000:00010000:2.0:1746066824.426750:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.426793:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9813 00000100:00100000:2.0:1746066824.426802:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985779712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.426817:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.426837:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.426849:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.426873:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec800/0xf1867c21abfb3644 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d899d expref: 28 pid: 1893 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.426930:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.426933:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.426938:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.426947:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.426973:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.427028:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985779712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 227us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.427035:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9813 00010000:00010000:2.0:1746066824.427078:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427085:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427101:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427108:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427115:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427121:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03cca00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066824.427124:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427135:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427145:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.427149:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.427185:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985777152:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 33199us (33672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.427191:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21218 00000100:00100000:2.0:1746066824.427643:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.428183:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985779840 00000100:00100000:0.0:1746066824.428252:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985779840 00010000:00010000:0.0:1746066824.428276:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.428301:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9814 00000100:00100000:0.0:1746066824.428306:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985779840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.428316:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.428328:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.428335:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.428348:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bdc00/0xf1867c21abfb359c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d893b expref: 39 pid: 11630 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.428697:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.428700:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.428703:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.428710:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.428733:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066824.428757:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.428757:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882985779840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 450us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.428762:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9814 00010000:00010000:1.0:1746066824.428764:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428778:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428784:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428789:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428794:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7ce00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.428797:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428803:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428812:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.428817:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7ce00/0xf1867c21abfb369f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.428867:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985776512:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 34706us (34752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.428874:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21220 00000100:00100000:3.0:1746066824.430997:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985779456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9729us (10055us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.431006:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8090 00002000:00100000:3.0:1746066824.431161:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88009677c700 x1830882985779456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.431171:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882985779456 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.431177:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c700 00000100:00100000:2.0:1746066824.431620:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.431698:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780096 00000100:00100000:3.0:1746066824.431705:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780096 00002000:00100000:3.0:1746066824.431738:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e1f80 x1830882985780096/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.431746:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882985780096 ext(3145728->4194303) 00002000:00010000:3.0:1746066824.431750:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:3.0:1746066824.431773:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8091 00000100:00100000:3.0:1746066824.431780:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985780096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.432027:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.432158:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780352 00000100:00100000:0.0:1746066824.432162:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780352 00000100:00100000:0.0:1746066824.432202:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17436 00000100:00100000:0.0:1746066824.432208:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3825:x1830882985780352:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:0.0:1746066824.432259:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.432286:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb363d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8996 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432301:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066824.432304:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066824.432329:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.432341:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432348:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432354:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432359:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432364:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 7/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066824.432391:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432402:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 23 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.432414:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245184:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.432481:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432488:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 39 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.432495:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245312:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.432518:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432524:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.432530:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245440:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.432547:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.432554:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.432560:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.432576:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.435138:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245184:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.435152:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245312:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.435160:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.435167:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985245568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.435199:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066824.437913:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.437948:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.437965:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.437975:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.438027:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780992 00000100:00100000:1.0:1746066824.438035:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780992 00000100:00100000:1.0:1746066824.438106:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21222 00000100:00100000:0.0:1746066824.438147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.438152:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780480 00000100:00100000:2.0:1746066824.438157:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780480 00010000:00010000:2.0:1746066824.438182:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 24 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.438203:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780608 00000100:00100000:2.0:1746066824.438205:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780608 00010000:00010000:2.0:1746066824.438215:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 40 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.438360:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:3828:x1830882985780992:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066824.438383:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780864 00000100:00100000:2.0:1746066824.438386:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780864 00000100:00100000:3.0:1746066824.438390:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985780736 00000100:00100000:3.0:1746066824.438394:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985780736 00010000:00010000:2.0:1746066824.438398:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 41 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.438409:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 25 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.438412:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9815 00000100:00100000:2.0:1746066824.438418:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2016:x1830882985780480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066824.438424:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9816 00000100:00100000:3.0:1746066824.438429:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985780608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.438430:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.438436:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.438436:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 25 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.438440:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 41 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.438445:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 25 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.438469:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.438570:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89ce expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066824.438592:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd88, atime: 0x6812dd88, ctime: 0x6812dd88, blocks: 0x800 00010000:00010000:1.0:1746066824.438608:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.438609:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.438617:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.438631:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.438641:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eb200, rc 0) 00010000:00010000:3.0:1746066824.438910:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 41 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.438931:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363400/0xf1867c21abfb33ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8854 expref: 25 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.438936:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097bc9800/0xf1867c21abfb33c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8846 expref: 41 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.438944:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.438948:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.438956:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.438956:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066824.438960:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.438967:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.438981:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985780480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 563us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.438985:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985780608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 555us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.438987:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9815 00000100:00100000:3.0:1746066824.438991:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9816 00000100:00100000:2.0:1746066824.439002:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9817 00000100:00100000:3.0:1746066824.439005:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9818 00000100:00100000:2.0:1746066824.439007:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882985780864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066824.439011:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985780736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.439012:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.439016:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.439017:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.439022:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.439022:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.439031:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b600/0xf1867c21abfb32e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d87b3 expref: 39 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.439034:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.439039:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.439042:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.439047:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.439060:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882985780864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.439065:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9817 00000100:00100000:0.0:1746066824.439162:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2016:x1830882985780096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7381us (7542us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066824.439169:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8091 00002000:00100000:0.0:1746066824.439178:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800966e1f80 x1830882985780096/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.439187:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882985780096 ext(3145728->4194303) 00002000:00010000:0.0:1746066824.439192:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:1.0:1746066824.439264:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:3828:x1830882985780992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1150us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.439270:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21222 00010000:00010000:3.0:1746066824.439457:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33800/0xf1867c21abfb338f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d882a expref: 23 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.439468:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.439471:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.439477:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.439483:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.439515:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.439533:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985780736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 523us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.439540:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9818 00010000:00010000:2.0:1746066824.439608:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.439616:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000040:00080000:2.0:1746066824.439839:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1321, 88 off123848 00000004:00080000:2.0:1746066824.439846:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792650962017ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.439897:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1317, 88 off123408 00000004:00080000:2.0:1746066824.439901:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651017657ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.439912:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1318, 88 off123496 00000004:00080000:2.0:1746066824.439914:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651030885ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.439921:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1322, 88 off123936 00000004:00080000:2.0:1746066824.439923:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651039955ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.439929:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1323, 88 off124024 00000004:00080000:2.0:1746066824.439932:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651048867ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.439938:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1319, 88 off123584 00000004:00080000:2.0:1746066824.439940:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651056860ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.439945:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1320, 88 off123672 00000004:00080000:2.0:1746066824.439947:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651064140ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.439953:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1321, 88 off123760 00000004:00080000:2.0:1746066824.439955:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651071977ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.439961:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1324, 88 off124112 00000004:00080000:2.0:1746066824.439962:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651079259ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.439968:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1322, 88 off123848 00000004:00080000:2.0:1746066824.439970:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651086330ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.440313:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1325, 88 off124200 00000004:00080000:2.0:1746066824.440318:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651435070ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.440331:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1323, 88 off123936 00000004:00080000:2.0:1746066824.440334:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651450974ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.440625:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1326, 88 off124288 00000004:00080000:2.0:1746066824.440629:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651745899ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.440641:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1327, 88 off124376 00000004:00080000:2.0:1746066824.440643:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651759957ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.440651:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1328, 88 off124464 00000004:00080000:2.0:1746066824.440653:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651769687ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.440659:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1329, 88 off124552 00000004:00080000:2.0:1746066824.440662:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792651778979ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.440671:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1324, 88 off124024 00000004:00080000:2.0:1746066824.440673:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792651789799ns, next at 733263917711ns, rc = 0 00000100:00100000:0.0:1746066824.442360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.442734:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781120 00000100:00100000:1.0:1746066824.442742:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781120 00000100:00100000:1.0:1746066824.442868:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17437 00000100:00100000:1.0:1746066824.442877:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:3828:x1830882985781120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.442928:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.442949:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89d5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.443004:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.443012:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 4/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.443031:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.443044:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.443057:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.443060:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066824.443063:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 39 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.443070:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eb600, rc 0) 00000100:00100000:1.0:1746066824.443126:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:3828:x1830882985781120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 249us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.443132:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17437 00000001:00080000:2.0:1746066824.444289:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937969 is committed 00000004:00080000:2.0:1746066824.444297:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1297 committed 00000004:00080000:2.0:1746066824.444390:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1304 committed 00000004:00080000:2.0:1746066824.444404:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1303 committed 00000004:00080000:2.0:1746066824.444406:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1302 committed 00000004:00080000:2.0:1746066824.444407:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1301 committed 00000004:00080000:2.0:1746066824.444408:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1296 committed 00000004:00080000:2.0:1746066824.444410:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1300 committed 00000004:00080000:2.0:1746066824.444412:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1295 committed 00000004:00080000:2.0:1746066824.444414:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1299 committed 00000004:00080000:2.0:1746066824.444415:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1294 committed 00000004:00080000:2.0:1746066824.444416:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1293 committed 00000004:00080000:2.0:1746066824.444417:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1292 committed 00000004:00080000:2.0:1746066824.444419:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1298 committed 00000004:00080000:2.0:1746066824.444420:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1297 committed 00000004:00080000:2.0:1746066824.444421:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1291 committed 00000004:00080000:2.0:1746066824.444422:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1290 committed 00000004:00080000:2.0:1746066824.444424:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1296 committed 00000001:00080000:2.0:1746066824.444433:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937967 is committed 00000001:00080000:2.0:1746066824.444436:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937966 is committed 00000100:00100000:0.0:1746066824.444508:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985245696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.444556:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.444681:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985245824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.444705:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.444783:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985245696 00000100:00100000:1.0:1746066824.444789:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985245696 00000100:00100000:3.0:1746066824.444796:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985246080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.444814:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985245824 00000100:00100000:1.0:1746066824.444817:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985245824 00000100:00100000:1.0:1746066824.444831:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21223 00000100:00100000:2.0:1746066824.444838:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.444838:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882985245696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.444869:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985245952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.444913:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.444927:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985246592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.444941:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.444952:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985247104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.444964:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.444973:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985247616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.444984:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.445001:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882985245696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (443us total) trans 17179875539 rc 0/0 00000100:00100000:3.0:1746066824.445006:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246080 00000100:00100000:1.0:1746066824.445007:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21223 00000100:00100000:3.0:1746066824.445009:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246080 00000100:00100000:1.0:1746066824.445018:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246592 00000100:00100000:1.0:1746066824.445021:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246592 00000100:00100000:3.0:1746066824.445025:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21224 00000100:00100000:3.0:1746066824.445030:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882985245824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.445034:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247104 00000100:00100000:1.0:1746066824.445036:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247104 00000100:00100000:1.0:1746066824.445045:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247616 00000100:00100000:1.0:1746066824.445047:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247616 00000100:00100000:1.0:1746066824.445058:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21225 00000100:00100000:1.0:1746066824.445061:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882985246080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066824.445106:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:1.0:1746066824.445109:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.445111:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00000100:00100000:3.0:1746066824.445113:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3777:x1830882985245824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (407us total) trans 21474842882 rc 0/0 00002000:00010000:1.0:1746066824.445113:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.445115:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:3.0:1746066824.445119:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21224 00000100:00100000:3.0:1746066824.445128:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21226 00000100:00100000:3.0:1746066824.445132:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882985246592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.445137:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882985246080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (224us total) trans 17179875540 rc 0/0 00000100:00100000:1.0:1746066824.445143:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21225 00000100:00100000:1.0:1746066824.445154:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21227 00000100:00100000:1.0:1746066824.445158:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882985247104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.445184:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985246592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (242us total) trans 21474842883 rc 0/0 00000100:00100000:3.0:1746066824.445189:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21226 00000100:00100000:3.0:1746066824.445197:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21228 00000100:00100000:3.0:1746066824.445201:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882985247616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.445209:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882985247104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (243us total) trans 17179875541 rc 0/0 00000100:00100000:1.0:1746066824.445214:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21227 00000100:00100000:3.0:1746066824.445258:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882985247616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (272us total) trans 21474842884 rc 0/0 00000100:00100000:3.0:1746066824.445263:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21228 00000004:00080000:3.0:1746066824.445300:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c775500/2, rc 0, transno 17179875540 00000100:00100000:3.0:1746066824.445318:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985246080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.445326:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f54380/2, rc 0, transno 21474842883 00000100:00100000:3.0:1746066824.445329:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985246592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066824.445334:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967aaa00/2, rc 0, transno 17179875541 00000100:00100000:3.0:1746066824.445336:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985247104:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.445341:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e423100/2, rc 0, transno 21474842884 00000100:00100000:3.0:1746066824.445343:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985247616:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746066824.445384:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5b0f480 reply state ffff8800973d7000 transno 8589937969 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.445400:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.445409:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.445411:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066824.445416:0:17253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.445424:0:17253:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.445430:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.445451:0:17253:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.445461:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985247744:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.445508:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.445517:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.445522:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.445538:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.445554:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985247360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.445556:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246336 00000100:00100000:3.0:1746066824.445559:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246336 00000100:00100000:2.0:1746066824.445568:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.445574:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246848 00000100:00100000:3.0:1746066824.445575:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246848 00000100:00100000:3.0:1746066824.445584:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247360 00000004:00080000:2.0:1746066824.445585:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f55c00/2, rc 0, transno 21474842882 00000100:00100000:3.0:1746066824.445586:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247360 00000100:00100000:2.0:1746066824.445588:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985245824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.445595:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1746066824.445600:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21229 00000100:00100000:2.0:1746066824.445600:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.445605:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882985246336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.445614:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.445625:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.445630:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.445639:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.445643:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985246464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.445649:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985247232:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066824.445651:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:3.0:1746066824.445653:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066824.445655:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066824.445657:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:0.0:1746066824.445658:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746066824.445659:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066824.445667:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246208 00000100:00100000:2.0:1746066824.445670:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246208 00000100:00100000:0.0:1746066824.445671:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985246976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.445677:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985246336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (170us total) trans 17179875542 rc 0/0 00000100:00100000:2.0:1746066824.445682:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985245952 00000100:00100000:0.0:1746066824.445682:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.445683:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21229 00000100:00100000:2.0:1746066824.445684:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985245952 00000100:00100000:0.0:1746066824.445689:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985247488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.445698:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.445701:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246720 00000100:00100000:2.0:1746066824.445703:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246720 00000100:00100000:2.0:1746066824.445710:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246464 00000100:00100000:2.0:1746066824.445712:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246464 00000100:00100000:2.0:1746066824.445717:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985246976 00000100:00100000:2.0:1746066824.445719:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985246976 00000100:00100000:2.0:1746066824.445724:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247488 00000100:00100000:2.0:1746066824.445726:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247488 00000100:00100000:0.0:1746066824.445814:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21230 00000100:00100000:3.0:1746066824.445819:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21231 00000100:00100000:0.0:1746066824.445821:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882985246848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.445823:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985247360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.445825:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21232 00000100:00100000:2.0:1746066824.445830:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21233 00000100:00100000:1.0:1746066824.445831:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3777:x1830882985246208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.445835:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882985245952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066824.445857:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:3.0:1746066824.445859:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066824.445861:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066824.445862:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066824.445864:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:0.0:1746066824.445869:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882985246848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (329us total) trans 21474842885 rc 0/0 00000100:00100000:0.0:1746066824.445874:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21230 00000100:00100000:3.0:1746066824.445877:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882985247360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (308us total) trans 17179875543 rc 0/0 00000100:00100000:3.0:1746066824.445897:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21231 00000100:00100000:0.0:1746066824.445899:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21234 00002000:00010000:2.0:1746066824.445903:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066824.445904:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21235 00002000:00010000:2.0:1746066824.445905:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00000100:00100000:1.0:1746066824.445905:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882985246208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (289us total) trans 17179875544 rc 0/0 00000100:00100000:0.0:1746066824.445905:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882985246720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066824.445907:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00000100:00100000:3.0:1746066824.445908:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3774:x1830882985246464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066824.445909:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:2.0:1746066824.445910:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066824.445911:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21232 00000100:00100000:1.0:1746066824.445921:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21236 00000100:00100000:1.0:1746066824.445925:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3774:x1830882985246976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.445933:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3774:x1830882985245952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (303us total) trans 17179875545 rc 0/0 00000100:00100000:1.0:1746066824.445937:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21237 00000100:00100000:2.0:1746066824.445940:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21233 00000100:00100000:1.0:1746066824.445940:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3774:x1830882985247488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066824.445941:0:13726:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066824.445943:0:13726:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066824.445944:0:13726:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066824.445946:0:13726:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066824 -> 1746066824 00002000:00010000:3.0:1746066824.445948:0:13726:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:0.0:1746066824.445955:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c777b80/2, rc 0, transno 17179875539 00000100:00100000:2.0:1746066824.445956:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.445959:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985245696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.445965:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3774:x1830882985246464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (306us total) trans 21474842887 rc 0/0 00000100:00100000:3.0:1746066824.445970:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21235 00000004:00080000:2.0:1746066824.445975:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c776680/2, rc 0, transno 17179875542 00000100:00100000:3.0:1746066824.445976:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247232 00000100:00100000:3.0:1746066824.445978:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247232 00000100:00100000:2.0:1746066824.445978:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.445984:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89c00/2, rc 0, transno 21474842885 00000100:00100000:2.0:1746066824.445987:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.445990:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21238 00000100:00100000:3.0:1746066824.445993:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882985247232:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.445993:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a8000/2, rc 0, transno 17179875543 00000100:00100000:2.0:1746066824.445996:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985247360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.445998:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3774:x1830882985247488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (298us total) trans 21474842888 rc 0/0 00000004:00080000:2.0:1746066824.446003:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c777800/2, rc 0, transno 17179875544 00000100:00100000:1.0:1746066824.446003:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21237 00000100:00100000:2.0:1746066824.446005:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246208:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.446019:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c776a00/2, rc 0, transno 17179875545 00000100:00100000:2.0:1746066824.446022:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985245952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.446027:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f57480/2, rc 0, transno 21474842887 00000100:00100000:0.0:1746066824.446027:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.446029:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985246464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066824.446035:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e423800/2, rc 0, transno 21474842888 00000100:00100000:3.0:1746066824.446037:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882985247232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (80us total) trans 17179875546 rc 0/0 00000100:00100000:2.0:1746066824.446038:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985247488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.446043:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21238 00000100:00100000:2.0:1746066824.446047:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781248 00000100:00100000:2.0:1746066824.446049:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781248 00000100:00100000:0.0:1746066824.446056:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3777:x1830882985246720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (416us total) trans 21474842886 rc 0/0 00000100:00100000:0.0:1746066824.446061:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21234 00000100:00100000:3.0:1746066824.446064:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21239 00000100:00100000:3.0:1746066824.446069:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3822:x1830882985781248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.446076:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066824.446076:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3774:x1830882985246976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (392us total) trans 21474842889 rc 0/0 00000004:00080000:2.0:1746066824.446078:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098f56a00/2, rc 0, transno 21474842886 00000100:00100000:2.0:1746066824.446081:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985246720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.446081:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21236 00000004:00080000:2.0:1746066824.446086:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a9c00/2, rc 0, transno 17179875546 00000100:00100000:2.0:1746066824.446089:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985247232:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066824.446090:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89dc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746066824.446100:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e422300/2, rc 0, transno 21474842889 00000100:00100000:2.0:1746066824.446103:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985246976:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066824.446104:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd89, atime: 0x6812dd88, ctime: 0x6812dd89, blocks: 0x1000 00000100:00100000:0.0:1746066824.446117:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985247872:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066824.446119:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.446120:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.446127:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.446131:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746066824.446138:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.446146:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095dd1e00, rc 0) 00000100:00100000:3.0:1746066824.446159:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3822:x1830882985781248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.446163:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21239 00000100:00100000:3.0:1746066824.446171:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985247872 00000100:00100000:3.0:1746066824.446174:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985247872 00000100:00100000:3.0:1746066824.446185:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21240 00000100:00100000:3.0:1746066824.446188:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3776:x1830882985247872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.446253:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3776:x1830882985247872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (120us total) trans 17179875547 rc 0/0 00000100:00100000:3.0:1746066824.446258:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21240 00000004:00080000:0.0:1746066824.446291:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a8e00/2, rc 0, transno 17179875547 00000100:00100000:0.0:1746066824.446295:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985247872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.447000:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985247744:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066824.447018:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746066824.447072:0:17253:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066824.447092:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985780352:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 14884us (15065us total) trans 8589937969 rc 0/0 00010000:00010000:1.0:1746066824.447120:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447129:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447136:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447142:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135975e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.447146:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447152:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447167:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.447169:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066824.447172:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.447177:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfb36ad lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066824.447196:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17436 00000100:00100000:2.0:1746066824.447429:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.447484:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781376 00000100:00100000:3.0:1746066824.447488:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781376 00000100:00100000:3.0:1746066824.447519:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6615 00000100:00100000:3.0:1746066824.447525:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3828:x1830882985781376:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:3.0:1746066824.447654:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3828:x1830882985781376:12345-192.168.204.16@tcp:49:cat.0 Request processed in 129us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.447682:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6615 00000100:00100000:0.0:1746066824.449153:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.449298:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781504 00000100:00100000:3.0:1746066824.449303:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781504 00000100:00100000:3.0:1746066824.449379:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17438 00000100:00100000:3.0:1746066824.449386:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3822:x1830882985781504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.449408:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.449425:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89e3 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.449512:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.449524:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.449539:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.449542:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066824.449545:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c200, rc 0) 00000100:00100000:0.0:1746066824.449556:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.449587:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3822:x1830882985781504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 201us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.449594:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17438 00000100:00100000:2.0:1746066824.449600:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781632 00000100:00100000:2.0:1746066824.449603:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781632 00000100:00100000:2.0:1746066824.449622:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17439 00000100:00100000:2.0:1746066824.449627:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985781632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066824.449635:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.449642:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89ea expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.449663:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.449671:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.449785:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.449787:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066824.449789:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0000, rc 0) 00000100:00100000:2.0:1746066824.449811:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985781632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 184us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.449820:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17439 00000100:00100000:0.0:1746066824.454556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.454660:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.454753:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985781888 00000100:00100000:2.0:1746066824.454763:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985781888 00002000:00100000:2.0:1746066824.454819:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009677c000 x1830882985781888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.454829:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882985781888 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.454836:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:2.0:1746066824.454857:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8092 00000100:00100000:2.0:1746066824.454864:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985781888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.454938:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782016 00000100:00100000:3.0:1746066824.454943:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782016 00000100:00100000:3.0:1746066824.454970:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17440 00000100:00100000:3.0:1746066824.454975:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985782016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066824.454985:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.455001:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2de00/0xf1867c21abfb36d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89f1 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.455080:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.455093:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.455103:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066824.455129:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:3.0:1746066824.455133:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066824.455145:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.455165:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2de00/0xf1867c21abfb36d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f1 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.455360:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f1 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.455368:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.455372:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066824.455375:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d400, rc 0) 00000100:00100000:3.0:1746066824.455603:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3825:x1830882985782016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 626us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.455609:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17440 00000100:00100000:0.0:1746066824.458948:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.458981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.459006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.459049:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782272 00000100:00100000:1.0:1746066824.459059:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782272 00000100:00100000:0.0:1746066824.459061:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.459076:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782528 00000100:00100000:0.0:1746066824.459079:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782528 00000100:00100000:1.0:1746066824.459097:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782784 00000100:00100000:1.0:1746066824.459099:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782784 00000100:00100000:0.0:1746066824.459157:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782144 00000100:00100000:0.0:1746066824.459160:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782144 00000100:00100000:0.0:1746066824.459177:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21241 00000100:00100000:0.0:1746066824.459184:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985782272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.459202:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.459235:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89ff expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066824.459259:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd89, atime: 0x6812dd89, ctime: 0x6812dd89, blocks: 0x808 00010000:00010000:0.0:1746066824.459276:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459278:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459287:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.459302:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.459312:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77400, rc 0) 00000100:00100000:0.0:1746066824.459352:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985782272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 169us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.459358:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21241 00000100:00100000:0.0:1746066824.459372:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21242 00000100:00100000:0.0:1746066824.459376:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985782528:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.459382:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.459395:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a0d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.459398:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21243 00000100:00100000:1.0:1746066824.459404:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985782784:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.459406:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459407:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.459409:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.459411:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.459415:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a1b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.459420:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.459423:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.459424:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459427:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76c00, rc 0) 00010000:00010000:1.0:1746066824.459428:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 10 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.459436:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 10 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066824.459441:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985782528:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 64us (460us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066824.459443:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83800, rc 0) 00000100:00100000:0.0:1746066824.459445:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21242 00000100:00100000:1.0:1746066824.459455:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985782784:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 53us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.459460:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21244 00000100:00100000:1.0:1746066824.459463:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21243 00000100:00100000:0.0:1746066824.459465:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985782144:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066824.459470:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.459477:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d89f8 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066824.459488:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd89, atime: 0x6812dd89, ctime: 0x6812dd89, blocks: 0x800 00010000:00010000:0.0:1746066824.459495:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459496:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.459500:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.459507:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.459513:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77e00, rc 0) 00000100:00100000:0.0:1746066824.459525:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985782144:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.459529:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21244 00000100:00100000:0.0:1746066824.461443:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.461475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.461740:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782400 00000100:00100000:2.0:1746066824.461748:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782400 00000100:00100000:2.0:1746066824.461776:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985782656 00000100:00100000:2.0:1746066824.461778:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985782656 00000100:00100000:2.0:1746066824.461790:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21245 00000100:00100000:2.0:1746066824.461797:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985782400:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066824.461811:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.461826:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a06 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.461844:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.461846:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.461853:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.461866:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.461900:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:2.0:1746066824.461948:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985782400:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 151us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.461954:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21245 00000100:00100000:2.0:1746066824.461965:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21246 00000100:00100000:2.0:1746066824.461969:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985782656:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066824.461975:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.461983:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a14 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.461993:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.461995:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.461998:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.462007:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.462014:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0600, rc 0) 00000100:00100000:2.0:1746066824.462025:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985782656:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 56us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.462030:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21246 00000100:00100000:2.0:1746066824.462358:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882985781888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7493us (7814us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.462366:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8092 00002000:00100000:2.0:1746066824.462375:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009677c000 x1830882985781888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.462384:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882985781888 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.462389:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:0.0:1746066824.462431:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.462557:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783040 00000100:00100000:2.0:1746066824.462560:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783040 00002000:00100000:2.0:1746066824.462579:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88008e437b80 x1830882985783040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.462588:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437b80 with x1830882985783040 ext(3145728->4194303) 00002000:00010000:2.0:1746066824.462591:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e437b80 00000100:00100000:2.0:1746066824.462609:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8093 00000100:00100000:2.0:1746066824.462614:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985783040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.471563:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.471608:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.471637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.471656:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783168 00000100:00100000:2.0:1746066824.471664:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783168 00000100:00100000:2.0:1746066824.471698:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783424 00000100:00100000:2.0:1746066824.471700:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783424 00000100:00100000:2.0:1746066824.471727:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783680 00000100:00100000:2.0:1746066824.471730:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783680 00000100:00100000:2.0:1746066824.471744:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21247 00000100:00100000:2.0:1746066824.471751:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985783168:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066824.471861:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985783168:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 111us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.471868:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21247 00000100:00100000:2.0:1746066824.471881:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21248 00000100:00100000:2.0:1746066824.471896:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985783424:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066824.471929:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985783424:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.471934:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21248 00000100:00100000:3.0:1746066824.472041:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21249 00000100:00100000:3.0:1746066824.472049:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985783680:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066824.472087:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985783680:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.472092:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21249 00000100:00100000:1.0:1746066824.472341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.472518:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.472549:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783936 00000100:00100000:0.0:1746066824.472553:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783936 00000100:00100000:1.0:1746066824.472555:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.472572:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784192 00000100:00100000:0.0:1746066824.472574:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784192 00000100:00100000:0.0:1746066824.472581:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783296 00000100:00100000:0.0:1746066824.472583:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783296 00000100:00100000:0.0:1746066824.472599:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21250 00000100:00100000:0.0:1746066824.472603:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985783936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066824.472613:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.472629:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a22 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.472651:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.472653:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.472661:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.472675:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.472684:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:0.0:1746066824.472701:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985783936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.472706:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21250 00000100:00100000:0.0:1746066824.472717:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21251 00000100:00100000:0.0:1746066824.472721:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985784192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066824.472727:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.472733:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a30 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.472743:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.472744:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.472748:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.472757:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066824.472763:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21252 00010000:00010000:0.0:1746066824.472763:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77c00, rc 0) 00000100:00100000:1.0:1746066824.472771:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985783296:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066824.472778:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985784192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.472783:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21251 00000100:00100000:1.0:1746066824.472809:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985783296:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.473085:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.473097:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783552 00000100:00100000:2.0:1746066824.473100:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783552 00000100:00100000:2.0:1746066824.473113:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21253 00000100:00100000:2.0:1746066824.473117:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985783552:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066824.473124:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21252 00000100:00100000:2.0:1746066824.473151:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985783552:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.473154:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.473156:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21253 00000100:00100000:2.0:1746066824.473164:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985783808 00000100:00100000:2.0:1746066824.473165:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985783808 00000100:00100000:1.0:1746066824.473170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.473175:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784064 00000100:00100000:2.0:1746066824.473177:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784064 00000100:00100000:1.0:1746066824.473182:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.473186:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784320 00000100:00100000:2.0:1746066824.473187:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784320 00000100:00100000:2.0:1746066824.473204:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21254 00000100:00100000:2.0:1746066824.473209:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985783808:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066824.473210:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21255 00000100:00100000:1.0:1746066824.473216:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882985784064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.473236:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.473246:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a29 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.473248:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985783808:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 38us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.473253:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21254 00010000:00010000:1.0:1746066824.473260:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.473261:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066824.473266:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21256 00010000:00010000:1.0:1746066824.473266:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066824.473271:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985784320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.473276:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.473277:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.473284:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a37 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.473287:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357aa00, rc 0) 00010000:00010000:2.0:1746066824.473295:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.473296:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.473300:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 42 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066824.473302:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985784064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.473307:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21255 00010000:00010000:2.0:1746066824.473310:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 42 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.473316:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0e00, rc 0) 00000100:00100000:2.0:1746066824.473330:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985784320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.473341:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21256 00000100:00100000:1.0:1746066824.473392:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985783040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10777us (10961us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.473400:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8093 00002000:00100000:1.0:1746066824.473410:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff88008e437b80 x1830882985783040/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.473520:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437b80 with x1830882985783040 ext(3145728->4194303) 00002000:00010000:1.0:1746066824.473525:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e437b80 00000100:00100000:0.0:1746066824.479320:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.479363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.479400:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784576 00000100:00100000:2.0:1746066824.479410:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784576 00000100:00100000:2.0:1746066824.479460:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784832 00000100:00100000:2.0:1746066824.479463:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784832 00000100:00100000:2.0:1746066824.479953:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21257 00000100:00100000:0.0:1746066824.479989:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21258 00000100:00100000:0.0:1746066824.479998:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985784832:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066824.480106:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985784832:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 110us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.480114:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21258 00000100:00100000:2.0:1746066824.480115:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985784576:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066824.480159:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985784576:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 200us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.480166:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21257 00000100:00100000:0.0:1746066824.480175:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.480191:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785088 00000100:00100000:2.0:1746066824.480194:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785088 00000100:00100000:2.0:1746066824.480214:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21259 00000100:00100000:2.0:1746066824.480227:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985785088:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066824.480247:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.480257:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784448 00000100:00100000:0.0:1746066824.480259:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784448 00000100:00100000:2.0:1746066824.480261:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985785088:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 42us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.480267:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21259 00000100:00100000:0.0:1746066824.480275:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21260 00000100:00100000:1.0:1746066824.480454:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.480464:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784704 00000100:00100000:1.0:1746066824.480467:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784704 00000100:00100000:1.0:1746066824.480482:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21261 00000100:00100000:1.0:1746066824.480487:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985784704:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066824.480527:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985784704:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.480532:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21261 00000100:00100000:1.0:1746066824.480574:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.480620:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985784960 00000100:00100000:2.0:1746066824.480623:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985784960 00000100:00100000:2.0:1746066824.480637:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21262 00000100:00100000:2.0:1746066824.480642:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985784960:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066824.480676:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985784960:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.480682:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21262 00000100:00100000:0.0:1746066824.481806:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985784448:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066824.481854:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.481863:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985784448:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 1582us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.481869:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21260 00000100:00100000:0.0:1746066824.481894:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785344 00000100:00100000:0.0:1746066824.481897:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785344 00000100:00100000:2.0:1746066824.481899:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.481926:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.482171:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785600 00000100:00100000:0.0:1746066824.482173:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785600 00000100:00100000:0.0:1746066824.482185:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785216 00000100:00100000:0.0:1746066824.482186:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785216 00000100:00100000:0.0:1746066824.482200:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21263 00000100:00100000:0.0:1746066824.482205:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985785344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066824.482212:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.482237:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a45 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.482251:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.482266:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785472 00000100:00100000:2.0:1746066824.482269:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785472 00000100:00100000:2.0:1746066824.482286:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21264 00000100:00100000:2.0:1746066824.482292:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985785600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066824.482299:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.482308:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a53 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.482327:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.482329:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.482336:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482347:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.482348:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.482351:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482354:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.482361:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0a00, rc 0) 00010000:00010000:0.0:1746066824.482364:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482372:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135975400, rc 0) 00000100:00100000:2.0:1746066824.482375:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985785600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.482380:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21264 00000100:00100000:2.0:1746066824.482390:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21265 00000100:00100000:0.0:1746066824.482390:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985785344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 184us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.482394:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985785216:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066824.482395:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21263 00010000:00010000:2.0:1746066824.482401:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.482406:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a3e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.482406:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21266 00000100:00100000:0.0:1746066824.482411:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2015:x1830882985785472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066824.482416:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.482416:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.482417:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.482421:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482423:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a4c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.482430:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482432:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.482433:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.482436:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1e00, rc 0) 00010000:00010000:0.0:1746066824.482437:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.482446:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066824.482448:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985785216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.482453:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21265 00010000:00010000:0.0:1746066824.482453:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135974e00, rc 0) 00000100:00100000:0.0:1746066824.482464:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985785472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 53us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.482469:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21266 00000100:00100000:0.0:1746066824.488661:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.488704:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.488743:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.489550:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985785984 00000100:00100000:1.0:1746066824.489560:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985785984 00000100:00100000:1.0:1746066824.489630:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985786112 00000100:00100000:1.0:1746066824.489632:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985786112 00000100:00100000:3.0:1746066824.489648:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985786368 00002000:00100000:1.0:1746066824.489650:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88008e434700 x1830882985786112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066824.489653:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985786368 00002000:00100000:1.0:1746066824.489660:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434700 with x1830882985786112 ext(4194304->5074943) 00002000:00010000:1.0:1746066824.489665:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e434700 00000100:00100000:1.0:1746066824.489679:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8094 00000100:00100000:3.0:1746066824.489686:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8095 00000100:00100000:1.0:1746066824.489686:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985785984:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:3.0:1746066824.489692:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985786112:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066824.489724:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.489739:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.489740:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.489746:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.489959:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.490051:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8096 00000100:00100000:0.0:1746066824.490061:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985786368:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066824.490083:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.490093:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.490094:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.490098:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.490106:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.490359:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.490376:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985786880 00000100:00100000:3.0:1746066824.490379:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985786880 00002000:00100000:3.0:1746066824.490395:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012e421180 x1830882985786880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.490403:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882985786880 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.490406:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421180 00000100:00100000:3.0:1746066824.490417:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8097 00000100:00100000:3.0:1746066824.490422:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985786880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.490867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.490920:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985787136 00000100:00100000:1.0:1746066824.490923:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985787136 00000100:00100000:1.0:1746066824.490946:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8098 00000100:00100000:1.0:1746066824.490950:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985787136:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066824.490965:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.490973:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.490974:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.490977:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.490985:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.491648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.491659:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985787264 00000100:00100000:0.0:1746066824.491661:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985787264 00000100:00100000:0.0:1746066824.491680:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8099 00000100:00100000:0.0:1746066824.491684:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985787264:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066824.491699:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.491707:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.491709:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.491712:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.491721:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.493376:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.493408:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985787520 00000100:00100000:1.0:1746066824.493415:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.493416:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985787520 00002000:00100000:2.0:1746066824.493449:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800930e0a80 x1830882985787520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.493458:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0a80 with x1830882985787520 ext(2097152->4194303) 00002000:00010000:2.0:1746066824.493464:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0a80 00000100:00100000:2.0:1746066824.493477:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985787648 00000100:00100000:2.0:1746066824.493480:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985787648 00000100:00100000:2.0:1746066824.493498:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8100 00000100:00100000:2.0:1746066824.493505:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985787520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.493511:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8101 00000100:00100000:3.0:1746066824.493519:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31c94c27-8194-4112-9e80-db222abc766f+17:2015:x1830882985787648:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066824.493543:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.493554:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.493556:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.493559:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.493570:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.495564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.495607:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.495640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.495688:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985787904 00000100:00100000:3.0:1746066824.495695:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985787904 00000100:00100000:3.0:1746066824.495737:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985788160 00000100:00100000:3.0:1746066824.495739:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985788160 00000100:00100000:3.0:1746066824.495749:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985788416 00000100:00100000:3.0:1746066824.495750:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985788416 00000100:00100000:3.0:1746066824.495760:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8102 00000100:00100000:3.0:1746066824.495835:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985787904:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066824.495868:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.495898:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.495900:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.495905:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.495916:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.502605:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985786112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12901us (13889us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066824.502617:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8095 00002000:00100000:3.0:1746066824.502629:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88008e434700 x1830882985786112/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.502638:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434700 with x1830882985786112 ext(4194304->5074943) 00002000:00010000:3.0:1746066824.502644:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e434700 00000100:00100000:3.0:1746066824.502670:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8103 00000100:00100000:3.0:1746066824.502680:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985788160:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066824.502718:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.502733:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.502735:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.502741:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.502755:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506699:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506715:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506724:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506730:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135975200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066824.506734:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506741:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506758:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506763:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135975200/0xf1867c21abfb374e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.506834:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985786368:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16770us (18084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066824.506844:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8096 00000100:00100000:0.0:1746066824.506874:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8104 00000100:00100000:0.0:1746066824.506917:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985788416:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066824.506981:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.506991:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.506993:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.506999:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.507009:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507391:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507399:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507406:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507410:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.507413:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507418:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507428:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.507433:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfb3747 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.507472:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31c94c27-8194-4112-9e80-db222abc766f+19:2016:x1830882985785984:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 17785us (18821us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.507478:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8094 00010000:00010000:2.0:1746066824.517652:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517669:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517677:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517684:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357b600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066824.517688:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517695:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517715:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.517725:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357b600/0xf1867c21abfb3755 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.517826:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985787136:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26868us (26953us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.517836:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8098 00000100:00100000:3.0:1746066824.519970:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985786880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29538us (29602us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066824.519981:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8097 00002000:00100000:3.0:1746066824.519994:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012e421180 x1830882985786880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.520008:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882985786880 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.520013:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421180 00010000:00010000:2.0:1746066824.521678:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521693:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521702:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521709:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135974200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066824.521713:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521721:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521740:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.521748:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135974200/0xf1867c21abfb375c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.521816:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:31c94c27-8194-4112-9e80-db222abc766f+17:2016:x1830882985787264:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 30125us (30162us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.521826:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8099 00010000:00010000:2.0:1746066824.528198:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528226:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528235:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528242:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2c000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066824.528245:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528253:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528273:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.528279:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfb3763 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.528364:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985787648:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 34840us (34942us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.528377:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8101 00010000:00010000:3.0:1746066824.537428:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.537449:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.537457:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.537465:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2de00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066824.537469:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.537478:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.537500:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.537504:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985787520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 43990us (44126us total) trans 0 rc 2097152/2097152 00010000:00010000:3.0:1746066824.537506:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfb376a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.537516:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8100 00002000:00100000:2.0:1746066824.537528:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800930e0a80 x1830882985787520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.537536:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0a80 with x1830882985787520 ext(2097152->4194303) 00002000:00010000:2.0:1746066824.537540:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0a80 00000100:00100000:3.0:1746066824.537549:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985787904:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 41781us (41992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.537555:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8102 00010000:00010000:3.0:1746066824.541138:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541154:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541162:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541169:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ed600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066824.541174:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541181:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541200:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.541206:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfb3771 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.541415:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985788160:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 38730us (45799us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.541425:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8103 00010000:00010000:1.0:1746066824.544193:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544210:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544227:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544234:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135975e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066824.544238:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544246:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544264:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.544270:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135975e00/0xf1867c21abfb3778 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.545012:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985788416:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 38122us (49363us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.545023:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8104 00000100:00100000:2.0:1746066824.548924:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.549249:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.549318:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985788672 00000100:00100000:3.0:1746066824.549328:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985788672 00000100:00100000:3.0:1746066824.549389:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17441 00000100:00100000:3.0:1746066824.549398:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3825:x1830882985788672:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746066824.549451:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.549479:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2d400/0xf1867c21abfb36de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f1 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.549507:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.549511:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066824.549555:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.549568:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.549577:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00010000:3.0:1746066824.549692:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094371f80 reply state ffff88006e275000 transno 8589937970 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.549701:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066824.549706:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.549708:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746066824.549710:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066824.549749:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985788928 00000100:00100000:1.0:1746066824.549763:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985788928 00000100:00100000:3.0:1746066824.549781:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3825:x1830882985788672:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 385us (869us total) trans 8589937970 rc 0/0 00000100:00100000:3.0:1746066824.549787:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17441 00002000:00100000:1.0:1746066824.549810:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094372d80 x1830882985788928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.549819:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372d80 with x1830882985788928 ext(4194304->5074943) 00002000:00010000:1.0:1746066824.549824:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094372d80 00000100:00100000:1.0:1746066824.549850:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8105 00000100:00100000:1.0:1746066824.549856:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985788928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.552993:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553029:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553045:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553057:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553068:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553095:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.553115:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789184 00000100:00100000:1.0:1746066824.553121:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789184 00000100:00100000:1.0:1746066824.553160:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789056 00000100:00100000:1.0:1746066824.553163:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789056 00000100:00100000:1.0:1746066824.553180:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789440 00000100:00100000:1.0:1746066824.553182:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789440 00000100:00100000:1.0:1746066824.553190:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789312 00000100:00100000:1.0:1746066824.553192:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789312 00000100:00100000:1.0:1746066824.553200:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789696 00000100:00100000:1.0:1746066824.553201:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789696 00000100:00100000:1.0:1746066824.553208:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789568 00000100:00100000:1.0:1746066824.553210:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789568 00000100:00100000:1.0:1746066824.553234:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21267 00000100:00100000:1.0:1746066824.553241:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985789184:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066824.553304:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21268 00000100:00100000:0.0:1746066824.553310:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985789056:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066824.553372:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066824.553372:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066824.553374:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553375:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.553376:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553377:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553378:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.553378:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553380:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746066824.553380:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066824.553417:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985789056:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 107us (388us total) trans 17179875548 rc 0/0 00000100:00100000:1.0:1746066824.553419:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985789184:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 180us (435us total) trans 21474842890 rc 0/0 00000100:00100000:0.0:1746066824.553422:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21268 00000100:00100000:1.0:1746066824.553425:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21267 00000100:00100000:1.0:1746066824.553436:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21269 00000100:00100000:1.0:1746066824.553439:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985789440:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066824.553477:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066824.553479:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553481:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553483:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553484:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066824.553499:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985789440:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 58us (453us total) trans 17179875549 rc 0/0 00000100:00100000:1.0:1746066824.553503:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21269 00000100:00100000:1.0:1746066824.553510:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21270 00000100:00100000:1.0:1746066824.553514:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2016:x1830882985789312:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066824.553548:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066824.553550:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553552:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553553:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553555:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066824.553569:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2016:x1830882985789312:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 54us (511us total) trans 21474842891 rc 0/0 00000100:00100000:1.0:1746066824.553574:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21270 00000100:00100000:1.0:1746066824.553582:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21271 00000100:00100000:1.0:1746066824.553585:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985789696:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066824.553610:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21272 00002000:00010000:1.0:1746066824.553615:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746066824.553615:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985789568:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066824.553617:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553619:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066824 -> 1746066825 00002000:00010000:1.0:1746066824.553621:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.553622:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066824.553635:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985789696:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 49us (566us total) trans 21474842892 rc 0/0 00000100:00100000:1.0:1746066824.553639:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21271 00002000:00010000:0.0:1746066824.553654:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:0.0:1746066824.553656:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.553658:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066824 -> 1746066825 00002000:00010000:0.0:1746066824.553660:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.553661:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:0.0:1746066824.553675:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985789568:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 60us (580us total) trans 17179875550 rc 0/0 00000100:00100000:0.0:1746066824.553680:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21272 00000100:00100000:0.0:1746066824.558436:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.558497:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985788928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8631us (9239us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066824.558508:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8105 00002000:00100000:1.0:1746066824.558519:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094372d80 x1830882985788928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.558527:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372d80 with x1830882985788928 ext(4194304->5074943) 00002000:00010000:1.0:1746066824.558533:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094372d80 00000100:00100000:3.0:1746066824.558576:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985789952 00000100:00100000:3.0:1746066824.558585:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985789952 00000100:00100000:3.0:1746066824.558670:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6616 00000100:00100000:3.0:1746066824.558678:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3825:x1830882985789952:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746066824.558753:0:10554:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x59:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b9 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.558802:0:10554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066824.558817:0:10554:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.558824:0:10554:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.558830:0:10554:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.558837:0:10554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066824.558873:0:10554:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.558902:0:10554:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.558920:0:10554:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248000:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.559516:0:10554:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.559529:0:10554:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 8 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.559538:0:10554:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248128:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.559569:0:10554:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.559821:0:10554:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 27 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.559831:0:10554:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248256:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.560322:0:10554:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.561261:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.561294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.561343:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985790080 00000100:00100000:3.0:1746066824.561348:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985790080 00010000:00010000:3.0:1746066824.561374:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 11 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.561392:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985790208 00000100:00100000:3.0:1746066824.561393:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985790208 00010000:00010000:3.0:1746066824.561403:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.561422:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9819 00000100:00100000:3.0:1746066824.561428:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985790080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.561438:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.561442:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 11 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.561450:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 11 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.561468:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.561472:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066824.561480:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.561501:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985790080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.561506:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9819 00000100:00100000:3.0:1746066824.561519:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9820 00000100:00100000:3.0:1746066824.561523:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985790208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.561527:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.561529:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.561535:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 9 pid: 17253 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.561543:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.561545:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066824.561549:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.561558:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985790208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.561562:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9820 00010000:00010000:3.0:1746066824.561608:0:10554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfb36d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ea expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.561626:0:10554:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248000:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.561633:0:10554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c200/0xf1867c21abfb36c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89e3 expref: 8 pid: 17253 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.561639:0:10554:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.563305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.563380:0:10554:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985248256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.563409:0:10554:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000100:00100000:1.0:1746066824.563523:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985790336 00000100:00100000:1.0:1746066824.563530:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985790336 00010000:00010000:1.0:1746066824.563555:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 28 pid: 7245 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.563940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9821 00000100:00100000:1.0:1746066824.563947:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985790336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.563961:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.563967:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 28 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.563977:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 28 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.563997:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfb36bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89d5 expref: 28 pid: 7245 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.564023:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.564028:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066824.564037:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066824.564044:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066824.564561:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.564613:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985790336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 665us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.564621:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9821 00010000:00010000:2.0:1746066824.564683:0:10554:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066824.564689:0:10554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000040:00080000:2.0:1746066824.564974:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1330, 88 off124640 00000004:00080000:2.0:1746066824.564981:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776096700ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565005:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1325, 88 off124112 00000004:00080000:2.0:1746066824.565008:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776124264ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565031:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1326, 88 off124200 00000004:00080000:2.0:1746066824.565082:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776198529ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565107:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1331, 88 off124728 00000004:00080000:2.0:1746066824.565110:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776226909ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565130:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1332, 88 off124816 00000004:00080000:2.0:1746066824.565132:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776249225ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565140:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1327, 88 off124288 00000004:00080000:2.0:1746066824.565142:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776258997ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565150:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1328, 88 off124376 00000004:00080000:2.0:1746066824.565153:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776270147ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565162:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1329, 88 off124464 00000004:00080000:2.0:1746066824.565164:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776281027ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565173:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1333, 88 off124904 00000004:00080000:2.0:1746066824.565176:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776292327ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565182:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1330, 88 off124552 00000004:00080000:2.0:1746066824.565184:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776301135ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565192:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1334, 88 off124992 00000004:00080000:2.0:1746066824.565195:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776311324ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565201:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1331, 88 off124640 00000004:00080000:2.0:1746066824.565203:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776320187ns, next at 733263917711ns, rc = 0 00000040:00080000:2.0:1746066824.565211:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1335, 88 off125080 00000004:00080000:2.0:1746066824.565214:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776330797ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565230:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1336, 88 off125168 00000004:00080000:2.0:1746066824.565233:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776350094ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565240:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1337, 88 off125256 00000004:00080000:2.0:1746066824.565242:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776358415ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565247:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1338, 88 off125344 00000004:00080000:2.0:1746066824.565249:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792776366119ns, next at 733263941116ns, rc = 0 00000040:00080000:2.0:1746066824.565255:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1332, 88 off124728 00000004:00080000:2.0:1746066824.565258:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792776374367ns, next at 733263917711ns, rc = 0 00000001:00080000:0.0:1746066824.566662:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937971 is committed 00000004:00080000:0.0:1746066824.566671:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1305 committed 00000004:00080000:0.0:1746066824.566686:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1313 committed 00000004:00080000:0.0:1746066824.566690:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1312 committed 00010000:00010000:1.0:1746066824.566692:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000004:00080000:0.0:1746066824.566692:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1311 committed 00000004:00080000:0.0:1746066824.566693:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1310 committed 00000004:00080000:0.0:1746066824.566695:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1304 committed 00000004:00080000:0.0:1746066824.566697:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1309 committed 00000004:00080000:0.0:1746066824.566698:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1303 committed 00000004:00080000:0.0:1746066824.566699:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1308 committed 00000004:00080000:0.0:1746066824.566700:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1302 committed 00010000:00010000:1.0:1746066824.566701:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000004:00080000:0.0:1746066824.566702:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1301 committed 00000004:00080000:0.0:1746066824.566703:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1300 committed 00000004:00080000:0.0:1746066824.566706:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1307 committed 00010000:00010000:1.0:1746066824.566708:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000004:00080000:0.0:1746066824.566708:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1306 committed 00000004:00080000:0.0:1746066824.566709:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1299 committed 00000004:00080000:0.0:1746066824.566711:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1298 committed 00000004:00080000:0.0:1746066824.566713:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1305 committed 00010000:00010000:1.0:1746066824.566714:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ec000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.566718:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.566725:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.566739:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.566741:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.566745:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.566749:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfb377f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066824.566775:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066824.566790:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985248384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.566845:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.566870:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985248640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.566871:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985248768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.566908:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.566920:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985249280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.566933:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.566946:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985249792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.566961:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.566974:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985250304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.566983:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.566993:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248384 00000100:00100000:3.0:1746066824.566995:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985249152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.567000:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248384 00000100:00100000:3.0:1746066824.567009:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.567020:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985249664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.567023:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248768 00000100:00100000:1.0:1746066824.567026:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248768 00000100:00100000:3.0:1746066824.567033:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.567037:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249280 00000100:00100000:1.0:1746066824.567038:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249280 00000100:00100000:1.0:1746066824.567047:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249792 00000100:00100000:3.0:1746066824.567048:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985250176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.567048:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249792 00000100:00100000:1.0:1746066824.567058:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248640 00000100:00100000:1.0:1746066824.567059:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248640 00000100:00100000:3.0:1746066824.567061:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.567104:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985248896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.567124:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.567337:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249152 00000100:00100000:1.0:1746066824.567340:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249152 00000100:00100000:2.0:1746066824.567343:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985249408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.567349:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249664 00000100:00100000:1.0:1746066824.567351:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249664 00000100:00100000:1.0:1746066824.567358:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250176 00000100:00100000:2.0:1746066824.567359:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.567360:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250176 00000100:00100000:2.0:1746066824.567365:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985249920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.567365:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248896 00000100:00100000:1.0:1746066824.567367:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248896 00000100:00100000:1.0:1746066824.567372:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249408 00000100:00100000:1.0:1746066824.567374:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249408 00000100:00100000:2.0:1746066824.567377:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.567379:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249920 00000100:00100000:1.0:1746066824.567381:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249920 00000100:00100000:1.0:1746066824.567390:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21273 00000100:00100000:2.0:1746066824.567393:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985248512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.567396:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3776:x1830882985248384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.567406:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.567413:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985249024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.567423:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.567428:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985249536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.567438:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.567444:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.567454:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746066824.567492:0:10554:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095800000 reply state ffff8800938a7c00 transno 8589937971 ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066824.567504:0:10554:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00002000:00010000:1.0:1746066824.567504:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066824.567506:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.567509:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00010000:00010000:2.0:1746066824.567510:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00002000:00010000:1.0:1746066824.567511:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00010000:00010000:2.0:1746066824.567512:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00002000:00010000:1.0:1746066824.567513:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066824.567514:0:10554:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746066824.567519:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.567520:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066824.567525:0:10554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfb3667 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89b9 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.567536:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985248384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (691us total) trans 17179875551 rc 0/0 00000100:00100000:1.0:1746066824.567540:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21273 00000100:00100000:1.0:1746066824.567551:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985248512 00000100:00100000:1.0:1746066824.567553:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985248512 00000100:00100000:1.0:1746066824.567560:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249024 00000100:00100000:1.0:1746066824.567562:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249024 00000100:00100000:1.0:1746066824.567567:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985249536 00000100:00100000:1.0:1746066824.567569:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985249536 00000100:00100000:1.0:1746066824.567573:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250048 00000100:00100000:1.0:1746066824.567575:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250048 00000100:00100000:1.0:1746066824.567582:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21274 00000100:00100000:1.0:1746066824.567585:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3776:x1830882985248768:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746066824.567586:0:10554:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066824.567595:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985789952:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 8918us (9169us total) trans 8589937971 rc 0/0 00000100:00100000:2.0:1746066824.567602:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6616 00010000:00010000:2.0:1746066824.567620:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066824.567626:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066824.567631:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00000100:00100000:1.0:1746066824.567635:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882985248768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (728us total) trans 17179875552 rc 0/0 00010000:00010000:2.0:1746066824.567636:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.567639:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00000100:00100000:1.0:1746066824.567640:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21274 00010000:00010000:2.0:1746066824.567644:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10554 initiator: MDT0 00000100:00100000:1.0:1746066824.567648:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21275 00010000:00010000:2.0:1746066824.567650:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:1.0:1746066824.567651:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3776:x1830882985249280:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066824.567653:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066824.567655:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066824.567659:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfb3786 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00002000:00010000:1.0:1746066824.567684:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00002000:00010000:1.0:1746066824.567686:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066824.567688:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066824.567689:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:1.0:1746066824.567691:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000100:00100000:1.0:1746066824.567706:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882985249280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (771us total) trans 17179875553 rc 0/0 00000100:00100000:1.0:1746066824.567710:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21275 00000100:00100000:1.0:1746066824.567718:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21276 00000100:00100000:1.0:1746066824.567721:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3776:x1830882985249792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.567784:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882985249792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (821us total) trans 21474842893 rc 0/0 00000100:00100000:1.0:1746066824.567788:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21276 00000100:00100000:3.0:1746066824.567821:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21277 00000100:00100000:3.0:1746066824.567826:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985248640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066824.567871:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:3.0:1746066824.567874:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.567876:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.567877:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.567880:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:3.0:1746066824.567927:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3775:x1830882985248640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (943us total) trans 17179875554 rc 0/0 00000100:00100000:3.0:1746066824.567932:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21277 00000100:00100000:3.0:1746066824.567940:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21278 00000100:00100000:3.0:1746066824.567944:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3775:x1830882985249152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.567988:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3775:x1830882985249152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (978us total) trans 17179875555 rc 0/0 00000100:00100000:3.0:1746066824.567993:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21278 00000100:00100000:3.0:1746066824.568000:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21279 00000100:00100000:3.0:1746066824.568004:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3775:x1830882985249664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066824.568039:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066824.568041:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568043:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568045:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568046:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066824.568063:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3775:x1830882985249664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1029us total) trans 21474842894 rc 0/0 00000100:00100000:3.0:1746066824.568067:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21279 00000100:00100000:1.0:1746066824.568071:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21280 00000100:00100000:3.0:1746066824.568075:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21281 00000100:00100000:1.0:1746066824.568076:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882985250176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.568079:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3777:x1830882985248896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066824.568110:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:3.0:1746066824.568112:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066824.568113:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066824.568115:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:3.0:1746066824.568118:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:1.0:1746066824.568122:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3775:x1830882985250176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1060us total) trans 21474842895 rc 0/0 00000100:00100000:1.0:1746066824.568127:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21280 00000100:00100000:1.0:1746066824.568135:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21282 00000100:00100000:1.0:1746066824.568139:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882985249408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.568146:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882985248896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1021us total) trans 17179875556 rc 0/0 00000100:00100000:3.0:1746066824.568151:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21281 00000100:00100000:3.0:1746066824.568159:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21283 00000100:00100000:3.0:1746066824.568163:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882985249920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.568175:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21284 00000100:00100000:3.0:1746066824.568178:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3774:x1830882985248512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066824.568178:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066824.568180:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.568182:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.568184:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.568185:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066824.568202:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882985249408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (842us total) trans 21474842896 rc 0/0 00000100:00100000:1.0:1746066824.568207:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21282 00002000:00010000:3.0:1746066824.568213:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746066824.568215:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21285 00002000:00010000:3.0:1746066824.568216:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568228:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568230:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00000100:00100000:1.0:1746066824.568230:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882985249024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066824.568232:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066824.568251:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882985248512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (845us total) trans 17179875557 rc 0/0 00000100:00100000:3.0:1746066824.568256:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21284 00000100:00100000:3.0:1746066824.568265:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21286 00000100:00100000:3.0:1746066824.568268:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882985249536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.568277:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882985249024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (853us total) trans 17179875558 rc 0/0 00000100:00100000:1.0:1746066824.568282:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21285 00000100:00100000:1.0:1746066824.568289:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21287 00000100:00100000:1.0:1746066824.568293:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882985250048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066824.568302:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066824.568304:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568305:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568307:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:3.0:1746066824.568309:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066824.568323:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882985249536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (883us total) trans 21474842897 rc 0/0 00000100:00100000:1.0:1746066824.568330:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882985250048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (876us total) trans 21474842898 rc 0/0 00000100:00100000:3.0:1746066824.568331:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21286 00000100:00100000:1.0:1746066824.568335:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21287 00000100:00100000:3.0:1746066824.568343:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066824.569337:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803100/2, rc 0, transno 17179875557 00000100:00100000:2.0:1746066824.569348:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985248512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.569355:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800a80/2, rc 0, transno 17179875558 00000100:00100000:2.0:1746066824.569358:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985249024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.569366:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e422d80/2, rc 0, transno 21474842897 00000100:00100000:2.0:1746066824.569369:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985249536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066824.569374:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421f80/2, rc 0, transno 21474842898 00000100:00100000:2.0:1746066824.569376:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.569422:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985250432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.569451:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420000/2, rc 0, transno 21474842894 00000100:00100000:2.0:1746066824.569454:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985249664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.569587:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250304 00000100:00100000:1.0:1746066824.569593:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250304 00000100:00100000:1.0:1746066824.569616:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21288 00000100:00100000:1.0:1746066824.569621:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882985250304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066824.569739:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882985250304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (1394us total) trans 21474842899 rc 0/0 00000100:00100000:1.0:1746066824.569744:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21288 00000004:00080000:3.0:1746066824.569746:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421500/2, rc 0, transno 21474842899 00000100:00100000:3.0:1746066824.569749:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985250304:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066824.569756:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420e00/2, rc 0, transno 21474842893 00000100:00100000:3.0:1746066824.569759:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985249792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066824.569765:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800380/2, rc 0, transno 17179875552 00000100:00100000:3.0:1746066824.569767:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985248768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.569773:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802300/2, rc 0, transno 17179875553 00000100:00100000:3.0:1746066824.569775:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985249280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.569783:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803b80/2, rc 0, transno 17179875551 00000100:00100000:3.0:1746066824.569785:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985248384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.569827:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882985249920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1663us (2448us total) trans 21474842900 rc 0/0 00000100:00100000:1.0:1746066824.569832:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21283 00000004:00080000:2.0:1746066824.569842:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421c00/2, rc 0, transno 21474842895 00000100:00100000:2.0:1746066824.569845:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985250176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066824.569854:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802680/2, rc 0, transno 17179875554 00000100:00100000:2.0:1746066824.569856:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985248640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.569861:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095801180/2, rc 0, transno 17179875555 00000100:00100000:2.0:1746066824.569863:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985249152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.569875:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066824.569932:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803800/2, rc 0, transno 17179875556 00000100:00100000:2.0:1746066824.569935:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985248896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066824.569942:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421880/2, rc 0, transno 21474842896 00000100:00100000:2.0:1746066824.569945:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985249408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066824.569950:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420380/2, rc 0, transno 21474842900 00000100:00100000:2.0:1746066824.569952:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985249920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.570165:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.570273:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250432 00000100:00100000:1.0:1746066824.570276:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250432 00000100:00100000:1.0:1746066824.570289:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21289 00000100:00100000:1.0:1746066824.570293:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882985250432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.570347:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3777:x1830882985250432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (471us total) trans 17179875559 rc 0/0 00000100:00100000:1.0:1746066824.570351:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21289 00000100:00100000:1.0:1746066824.570367:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985790464 00000100:00100000:1.0:1746066824.570369:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985790464 00000100:00100000:1.0:1746066824.570385:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17442 00000100:00100000:1.0:1746066824.570389:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:3825:x1830882985790464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066824.570402:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.570413:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a5a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.570457:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.570469:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.570485:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.570487:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066824.570490:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea000, rc 0) 00000100:00100000:1.0:1746066824.570513:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985790464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.570518:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17442 00000004:00080000:2.0:1746066824.570760:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c68700/2, rc 0, transno 17179875559 00000100:00100000:2.0:1746066824.570764:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985250432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.572756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.572841:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985790720 00000100:00100000:2.0:1746066824.572848:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985790720 00000100:00100000:2.0:1746066824.572909:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6617 00000100:00100000:2.0:1746066824.572915:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3825:x1830882985790720:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066824.573097:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:31c94c27-8194-4112-9e80-db222abc766f+8:3825:x1830882985790720:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 180us (346us total) trans 8589937972 rc 0/0 00000100:00100000:3.0:1746066824.573107:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6617 00000100:00100000:0.0:1746066824.594422:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.594491:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791104 00000100:00100000:1.0:1746066824.594501:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791104 00000100:00100000:0.0:1746066824.594528:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.594769:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791232 00000100:00100000:2.0:1746066824.594774:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791232 00000100:00100000:1.0:1746066824.594776:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17443 00000100:00100000:1.0:1746066824.594783:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:3836:x1830882985791104:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746066824.594796:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17444 00000100:00100000:2.0:1746066824.594800:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3837:x1830882985791232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066824.594804:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.594805:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.594820:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428400/0xf1867c21abfb3794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a68 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.594820:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb379b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a61 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.594912:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.594912:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595172:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595186:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595201:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595206:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595211:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595229:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595236:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595244:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595248:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595253:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595314:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595314:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb37c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595321:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb37c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595335:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb37c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595336:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595341:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066824.595344:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:2.0:1746066824.595346:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066824.595405:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595405:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595410:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595416:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595420:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595421:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595424:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595428:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e428a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.595428:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595431:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595431:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbeac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.595433:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595436:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595436:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595445:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066824.595448:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.595451:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595451:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066824.595452:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.595454:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066824.595455:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428a00/0xf1867c21abfb37a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.595462:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595480:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595484:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595489:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595493:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbeb800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066824.595496:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595500:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595506:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9f00) 00010000:00010000:1.0:1746066824.595508:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066824.595510:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595514:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb800/0xf1867c21abfb37b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066824.595543:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb379b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a61 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.595553:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb37c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a61 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.595562:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.595564:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066824.595566:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea200, rc 0) 00010000:00010000:2.0:1746066824.595604:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595610:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595614:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595618:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e428c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.595620:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595623:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595736:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9f00) 00010000:00010000:2.0:1746066824.595738:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.595741:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595744:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.595767:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428400/0xf1867c21abfb3794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.595774:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.595779:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.595782:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066824.595783:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429800, rc 0) 00000100:00100000:1.0:1746066824.595839:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:3836:x1830882985791104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1056us (1428us total) trans 8589937974 rc 0/0 00000100:00100000:1.0:1746066824.595846:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17443 00000100:00100000:2.0:1746066824.595903:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3837:x1830882985791232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1081us (1352us total) trans 8589937973 rc 0/0 00000100:00100000:2.0:1746066824.595909:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17444 00000100:00100000:0.0:1746066824.629586:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.629698:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791488 00000100:00100000:2.0:1746066824.629708:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791488 00000100:00100000:2.0:1746066824.629918:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17445 00000100:00100000:2.0:1746066824.629926:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3836:x1830882985791488:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066824.630015:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.630019:0:10125:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066824.630052:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea200/0xf1867c21abfb37c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a61 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.630082:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.630086:0:10125:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066824.630100:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428400/0xf1867c21abfb37da lrc: 2/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a6f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.630149:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.630161:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.630168:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.630174:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.630203:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.630214:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 9 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.630239:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985250560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.631382:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.631391:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 7 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.631399:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985250688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.631663:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.633680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.633703:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985250560:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.633713:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985250688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.633736:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066824.634717:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.634762:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791744 00000100:00100000:2.0:1746066824.634769:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791744 00010000:00010000:2.0:1746066824.634798:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 8 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.635346:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791616 00000100:00100000:1.0:1746066824.635350:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791616 00000100:00100000:2.0:1746066824.635361:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9822 00010000:00010000:1.0:1746066824.635364:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.635369:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+8:2013:x1830882985791744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.635386:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.635392:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 8 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.635401:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 8 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.635567:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbea000/0xf1867c21abfb378d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a5a expref: 8 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.635583:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.635587:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066824.635590:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9823 00010000:00010000:2.0:1746066824.635595:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066824.635597:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2013:x1830882985791616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.635600:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066824.635603:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.635606:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.635613:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.635624:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429800/0xf1867c21abfb37be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a68 expref: 10 pid: 10125 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.635642:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066824.635645:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066824.635646:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+7:2013:x1830882985791744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 278us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.635653:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9822 00010000:00010000:1.0:1746066824.635654:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.635659:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066824.635675:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.635690:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2013:x1830882985791616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.635695:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9823 00010000:00010000:3.0:1746066824.635697:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.635703:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000040:00080000:3.0:1746066824.636282:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1339, 88 off125432 00000004:00080000:3.0:1746066824.636288:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847404200ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636448:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1333, 88 off124816 00000004:00080000:3.0:1746066824.636452:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847568377ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636474:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1334, 88 off124904 00000004:00080000:3.0:1746066824.636477:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847593777ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636484:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1340, 88 off125520 00000004:00080000:3.0:1746066824.636487:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847603464ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636493:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1341, 88 off125608 00000004:00080000:3.0:1746066824.636495:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847612090ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636501:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1335, 88 off124992 00000004:00080000:3.0:1746066824.636503:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847620284ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636509:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1336, 88 off125080 00000004:00080000:3.0:1746066824.636511:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847627649ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636516:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1337, 88 off125168 00000004:00080000:3.0:1746066824.636518:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847634864ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636524:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1342, 88 off125696 00000004:00080000:3.0:1746066824.636525:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847642287ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636531:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1338, 88 off125256 00000004:00080000:3.0:1746066824.636533:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847649799ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636538:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1343, 88 off125784 00000004:00080000:3.0:1746066824.636540:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847656997ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636545:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1339, 88 off125344 00000004:00080000:3.0:1746066824.636548:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847665084ns, next at 733263917711ns, rc = 0 00000040:00080000:3.0:1746066824.636554:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1344, 88 off125872 00000004:00080000:3.0:1746066824.636556:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847672510ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636561:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1345, 88 off125960 00000004:00080000:3.0:1746066824.636563:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847679579ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636568:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1346, 88 off126048 00000004:00080000:3.0:1746066824.636570:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847686840ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636575:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1347, 88 off126136 00000004:00080000:3.0:1746066824.636578:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792847694649ns, next at 733263941116ns, rc = 0 00000040:00080000:3.0:1746066824.636583:0:10125:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1340, 88 off125432 00000004:00080000:3.0:1746066824.636585:0:10125:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 792847702170ns, next at 733263917711ns, rc = 0 00000001:00080000:2.0:1746066824.637801:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937975 is committed 00000004:00080000:2.0:1746066824.637808:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1313 committed 00000004:00080000:2.0:1746066824.637813:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1322 committed 00000004:00080000:2.0:1746066824.637825:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1321 committed 00000004:00080000:2.0:1746066824.637827:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1320 committed 00000004:00080000:2.0:1746066824.637828:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1319 committed 00000004:00080000:2.0:1746066824.637829:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1312 committed 00000004:00080000:2.0:1746066824.637830:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1318 committed 00000004:00080000:2.0:1746066824.637832:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1311 committed 00000004:00080000:2.0:1746066824.637834:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1317 committed 00000004:00080000:2.0:1746066824.637835:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1310 committed 00000004:00080000:2.0:1746066824.637837:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1309 committed 00000004:00080000:2.0:1746066824.637838:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1308 committed 00000004:00080000:2.0:1746066824.637839:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1316 committed 00000004:00080000:2.0:1746066824.637841:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1315 committed 00000004:00080000:2.0:1746066824.637842:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1307 committed 00000004:00080000:2.0:1746066824.637843:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1306 committed 00000004:00080000:2.0:1746066824.637845:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1314 committed 00000001:00080000:2.0:1746066824.637849:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937973 is committed 00000001:00080000:2.0:1746066824.637856:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937972 is committed 00000100:00100000:2.0:1746066824.637873:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.637946:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.637968:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.637988:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251072 00000100:00100000:3.0:1746066824.637989:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.637993:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251072 00000100:00100000:3.0:1746066824.638000:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.638021:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251584 00000100:00100000:0.0:1746066824.638023:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251584 00000100:00100000:3.0:1746066824.638025:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066824.638034:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.638034:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21290 00000100:00100000:0.0:1746066824.638040:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882985251072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.638047:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.638059:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.638074:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066824.638126:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251200 00000100:00100000:1.0:1746066824.638130:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251200 00000100:00100000:1.0:1746066824.638148:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250816 00000100:00100000:1.0:1746066824.638149:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250816 00000100:00100000:1.0:1746066824.638160:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21291 00000100:00100000:1.0:1746066824.638164:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882985251584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.638193:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.638244:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638260:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.638275:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638286:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746066824.638290:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250944:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066824.638295:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066824.638298:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638301:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00000100:00100000:2.0:1746066824.638302:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066824.638303:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638305:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066824.638310:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.638324:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638333:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.638343:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638367:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251328 00000100:00100000:2.0:1746066824.638373:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251328 00000100:00100000:2.0:1746066824.638396:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251840 00000100:00100000:2.0:1746066824.638398:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251840 00000100:00100000:2.0:1746066824.638405:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985250944 00000100:00100000:2.0:1746066824.638407:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985250944 00000100:00100000:2.0:1746066824.638412:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251456 00000100:00100000:2.0:1746066824.638414:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251456 00000100:00100000:2.0:1746066824.638419:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251968 00000100:00100000:2.0:1746066824.638420:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251968 00000100:00100000:2.0:1746066824.638429:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21292 00000100:00100000:2.0:1746066824.638436:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882985251200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.638456:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.638457:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882985251072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 416us (487us total) trans 21474842902 rc 0/0 00000100:00100000:0.0:1746066824.638464:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21290 00000100:00100000:0.0:1746066824.638476:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985251712 00000100:00100000:0.0:1746066824.638478:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985251712 00000004:00080000:3.0:1746066824.638482:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677ce00/2, rc 0, transno 21474842902 00000100:00100000:3.0:1746066824.638486:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.638488:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21293 00000100:00100000:0.0:1746066824.638491:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882985250816:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066824.638493:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4fb80/2, rc 0, transno 21474842901 00000100:00100000:3.0:1746066824.638495:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.638502:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.638518:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.638525:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.638531:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252096 00000100:00100000:0.0:1746066824.638534:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252096 00000100:00100000:3.0:1746066824.638538:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066824.638544:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066824.638544:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252608 00000100:00100000:0.0:1746066824.638546:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252608 00000100:00100000:3.0:1746066824.638548:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.638554:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21294 00000100:00100000:0.0:1746066824.638558:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3774:x1830882985251328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066824.638564:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638572:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3776:x1830882985251200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (522us total) trans 21474842903 rc 0/0 00000100:00100000:3.0:1746066824.638573:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.638578:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21292 00000100:00100000:3.0:1746066824.638591:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066824.638591:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252224 00000100:00100000:2.0:1746066824.638594:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252224 00000004:00080000:3.0:1746066824.638603:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677e680/2, rc 0, transno 21474842903 00000100:00100000:2.0:1746066824.638603:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252736 00000100:00100000:2.0:1746066824.638605:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252736 00000100:00100000:3.0:1746066824.638606:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.638609:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3774:x1830882985251328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (365us total) trans 21474842905 rc 0/0 00000100:00100000:2.0:1746066824.638612:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21295 00000100:00100000:0.0:1746066824.638616:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21294 00000100:00100000:2.0:1746066824.638617:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985251840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.638627:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21296 00000100:00100000:0.0:1746066824.638631:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3774:x1830882985250944:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066824.638649:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a6f expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.638661:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.638663:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00002000:00010000:0.0:1746066824.638665:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066824.638667:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638669:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638670:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638672:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00010000:00010000:3.0:1746066824.638675:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428400/0xf1867c21abfb37da lrc: 0/0,0 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a6f expref: 29 pid: 10125 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746066824.638688:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3774:x1830882985250944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (385us total) trans 21474842906 rc 0/0 00010000:00010000:3.0:1746066824.638689:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a6f expref: 28 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.638693:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21296 00000100:00100000:0.0:1746066824.638701:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21297 00000100:00100000:0.0:1746066824.638705:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3774:x1830882985251456:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066824.638712:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.638713:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066824.638715:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428c00, rc 0) 00002000:00010000:2.0:1746066824.638716:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066824.638719:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638721:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638723:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638724:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066824.638745:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3836:x1830882985791488:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8820us (9171us total) trans 8589937975 rc 0/0 00000100:00100000:3.0:1746066824.638751:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17445 00000100:00100000:2.0:1746066824.638751:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3774:x1830882985251840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (475us total) trans 17179875560 rc 0/0 00000100:00100000:0.0:1746066824.638752:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3774:x1830882985251456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (427us total) trans 21474842907 rc 0/0 00000100:00100000:2.0:1746066824.638757:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21295 00000100:00100000:0.0:1746066824.638760:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21297 00000100:00100000:2.0:1746066824.638770:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21298 00000100:00100000:0.0:1746066824.638774:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21299 00000100:00100000:2.0:1746066824.638775:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3774:x1830882985251968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.638778:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3776:x1830882985251712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066824.638812:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066824.638815:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638816:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638818:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:2.0:1746066824.638819:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066824.638836:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3776:x1830882985251712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (379us total) trans 21474842908 rc 0/0 00000100:00100000:2.0:1746066824.638840:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3774:x1830882985251968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (495us total) trans 17179875561 rc 0/0 00000100:00100000:0.0:1746066824.638841:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21299 00000100:00100000:2.0:1746066824.638846:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21298 00000100:00100000:0.0:1746066824.638851:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21300 00000004:00080000:3.0:1746066824.638853:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4ce00/2, rc 0, transno 21474842908 00000100:00100000:0.0:1746066824.638855:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3776:x1830882985252096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.638857:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985251712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.638857:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21301 00000100:00100000:2.0:1746066824.638862:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3776:x1830882985252608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.638878:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.638911:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066824.638919:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00000100:00100000:3.0:1746066824.638921:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00010000:0.0:1746066824.638921:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638923:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00000100:00100000:3.0:1746066824.638925:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252352:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066824.638925:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:0.0:1746066824.638928:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:3.0:1746066824.638938:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.638944:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985252096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (425us total) trans 17179875562 rc 0/0 00000100:00100000:0.0:1746066824.638950:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21300 00000004:00080000:3.0:1746066824.638954:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e0000/2, rc 0, transno 17179875562 00000100:00100000:0.0:1746066824.638957:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252480 00000100:00100000:0.0:1746066824.638959:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252480 00000100:00100000:3.0:1746066824.638960:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.638962:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985252608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (422us total) trans 17179875563 rc 0/0 00000100:00100000:0.0:1746066824.638967:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252352 00000004:00080000:3.0:1746066824.638968:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d180/2, rc 0, transno 17179875563 00000100:00100000:2.0:1746066824.638968:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21301 00000100:00100000:0.0:1746066824.638969:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252352 00000100:00100000:3.0:1746066824.638971:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066824.638976:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21302 00000100:00100000:0.0:1746066824.638980:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985252224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.638981:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21303 00000100:00100000:2.0:1746066824.638986:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3776:x1830882985252736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.638994:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066824.638999:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066824.639015:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746066824.639029:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb size from disk: 7360512 -> 7360512 00000100:00100000:0.0:1746066824.639030:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3776:x1830882985252224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (464us total) trans 17179875564 rc 0/0 00002000:00010000:2.0:1746066824.639031:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066824.639033:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066824.639035:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00000100:00100000:0.0:1746066824.639035:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21302 00002000:00010000:2.0:1746066824.639037:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x86:0x0] updating lvb blocks from disk: 5448 -> 5448 00000004:00080000:3.0:1746066824.639041:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677fb80/2, rc 0, transno 21474842906 00000100:00100000:0.0:1746066824.639043:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985252864 00000100:00100000:3.0:1746066824.639044:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.639045:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985252864 00000004:00080000:3.0:1746066824.639051:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c4f480/2, rc 0, transno 21474842907 00000100:00100000:3.0:1746066824.639054:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066824.639054:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21304 00000100:00100000:0.0:1746066824.639057:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985252480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.639060:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3776:x1830882985252736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (467us total) trans 17179875565 rc 0/0 00000004:00080000:3.0:1746066824.639061:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e3100/2, rc 0, transno 17179875561 00000100:00100000:3.0:1746066824.639063:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.639066:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21303 00000004:00080000:3.0:1746066824.639069:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677c380/2, rc 0, transno 21474842905 00000100:00100000:3.0:1746066824.639072:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066824.639077:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21305 00000004:00080000:3.0:1746066824.639078:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2680/2, rc 0, transno 17179875560 00000100:00100000:3.0:1746066824.639080:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985251840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.639082:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3775:x1830882985252352:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.639093:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c776d80/2, rc 0, transno 17179875564 00000100:00100000:3.0:1746066824.639095:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.639102:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0c000/2, rc 0, transno 17179875565 00000100:00100000:3.0:1746066824.639104:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985252736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.639117:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21306 00000100:00100000:2.0:1746066824.639123:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985252864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066824.639185:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:3776:x1830882985251584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1019us (1182us total) trans 21474842901 rc 0/0 00000100:00100000:1.0:1746066824.639190:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21291 00002000:00010000:1.0:1746066824.639244:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066824.639247:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.639248:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.639250:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066825 -> 1746066825 00002000:00010000:1.0:1746066824.639251:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066824.639271:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882985250816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 779us (1203us total) trans 21474842904 rc 0/0 00000100:00100000:1.0:1746066824.639275:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21293 00000100:00100000:0.0:1746066824.639612:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985252480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 553us (700us total) trans 17179875566 rc 0/0 00000100:00100000:0.0:1746066824.639617:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21304 00000100:00100000:2.0:1746066824.639737:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985252864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 612us (719us total) trans 17179875567 rc 0/0 00000100:00100000:2.0:1746066824.639742:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21306 00002000:00010000:2.0:1746066824.639791:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb size from disk: 3166208 -> 3166208 00002000:00010000:2.0:1746066824.639793:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066824.639795:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066824.639796:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:2.0:1746066824.639798:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x84:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:2.0:1746066824.639816:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3775:x1830882985252352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 734us (876us total) trans 17179875568 rc 0/0 00000100:00100000:2.0:1746066824.639820:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21305 00000004:00080000:3.0:1746066824.639842:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677ed80/2, rc 0, transno 21474842904 00000100:00100000:3.0:1746066824.639847:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985250816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066824.639864:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009666ca80/2, rc 0, transno 17179875567 00000100:00100000:3.0:1746066824.639872:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.639880:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0f800/2, rc 0, transno 17179875568 00000100:00100000:3.0:1746066824.639911:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252352:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066824.639919:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0d500/2, rc 0, transno 17179875566 00000100:00100000:3.0:1746066824.639921:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985252480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066824.641955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.642020:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985791872 00000100:00100000:0.0:1746066824.642026:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985791872 00000100:00100000:0.0:1746066824.642070:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21307 00000100:00100000:0.0:1746066824.642077:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:3836:x1830882985791872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066824.642092:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.642109:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a76 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.642142:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.642150:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.642157:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.642163:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.642165:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.642168:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.642196:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.642208:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 13 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.642253:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985252992:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.642346:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066824.642354:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 29 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.642362:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985253120:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.642387:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.642394:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746066824.642402:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985253248:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.642417:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.643012:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.643069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.643641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.643706:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.643812:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985792128 00000100:00100000:1.0:1746066824.643821:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985792128 00000100:00100000:3.0:1746066824.643851:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985792384 00000100:00100000:3.0:1746066824.643855:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985792384 00002000:00100000:1.0:1746066824.643864:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5d81f80 x1830882985792128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.643873:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830882985792384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.643873:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882985792128 ext(0->1048575) 00002000:00010000:1.0:1746066824.643878:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00002000:00100000:3.0:1746066824.643880:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830882985792384 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.643902:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80700 00000100:00100000:3.0:1746066824.644019:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985792640 00000100:00100000:3.0:1746066824.644022:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985792640 00000100:00100000:1.0:1746066824.644023:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985792896 00000100:00100000:1.0:1746066824.644028:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985792896 00002000:00100000:3.0:1746066824.644037:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5d83480 x1830882985792640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.644043:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830882985792640 ext(1048576->2097151) 00002000:00100000:1.0:1746066824.644048:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012b165500 x1830882985792896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066824.644049:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00002000:00100000:1.0:1746066824.644055:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985792896 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.644058:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165500 00010000:00010000:3.0:1746066824.644059:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00002000:00010000:3.0:1746066824.644064:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d83480 00000100:00100000:1.0:1746066824.644079:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2315 00000100:00100000:3.0:1746066824.644084:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8106 00000100:00100000:1.0:1746066824.644087:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985792640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.644090:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985792384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.644104:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8107 00000100:00100000:3.0:1746066824.644108:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985792128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.644767:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8108 00000100:00100000:3.0:1746066824.644773:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985792896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.647642:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985252992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.647654:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985253120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.647661:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985253248:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.647688:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.647705:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135974200, rc 0) 00000100:00100000:1.0:1746066824.647733:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:3836:x1830882985791872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5657us (5786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.647741:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21307 00000100:00100000:0.0:1746066824.649367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.649406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.649432:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793152 00000100:00100000:2.0:1746066824.649441:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793152 00010000:00010000:2.0:1746066824.649474:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.649507:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793024 00000100:00100000:2.0:1746066824.649509:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793024 00000100:00100000:1.0:1746066824.649516:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9824 00010000:00010000:2.0:1746066824.649518:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 14 pid: 9591 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.649526:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985793152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066824.649531:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9825 00000100:00100000:2.0:1746066824.649536:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985793024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.649538:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.649542:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.649557:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 14 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.649558:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.649568:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 14 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.649576:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.649597:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1c00/0xf1867c21abfb3701 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a06 expref: 14 pid: 9591 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.649603:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ed800/0xf1867c21abfb3698 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c0 expref: 42 pid: 20361 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.649623:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.650227:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985793024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 680us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.650234:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9825 00010000:00010000:1.0:1746066824.650288:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.650308:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985793152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 784us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.650314:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9824 00000100:00100000:3.0:1746066824.659508:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985792128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15387us (16488us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.659520:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8107 00002000:00100000:3.0:1746066824.659535:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5d81f80 x1830882985792128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.659545:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882985792128 ext(0->1048575) 00002000:00010000:3.0:1746066824.659551:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00000100:00100000:1.0:1746066824.659695:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985792640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15608us (16054us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.659702:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2315 00002000:00100000:1.0:1746066824.659707:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800a5d83480 x1830882985792640/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.659714:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830882985792640 ext(1048576->2097151) 00010000:00010000:1.0:1746066824.659722:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 32 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.659737:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 32 pid: 12237 timeout: 892 lvb_type: 1 00002000:00010000:1.0:1746066824.659748:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d83480 00000100:00100000:3.0:1746066824.665141:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985792896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20356us (21424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.665154:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8108 00002000:00100000:3.0:1746066824.665166:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88012b165500 x1830882985792896/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.665176:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165500 with x1830882985792896 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.665182:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165500 00000100:00100000:1.0:1746066824.666598:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985792384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22500us (23522us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.666609:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8106 00002000:00100000:1.0:1746066824.666618:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830882985792384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.666626:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830882985792384 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.666631:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80700 00000100:00100000:0.0:1746066824.668564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.669569:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793280 00000100:00100000:1.0:1746066824.669578:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793280 00010000:00010000:1.0:1746066824.669611:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.669650:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9826 00000100:00100000:1.0:1746066824.669657:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985793280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.669669:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.669685:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.669695:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.669714:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135974e00/0xf1867c21abfb3740 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a4c expref: 30 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.669745:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.669747:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.669753:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.669761:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.669789:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.669800:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985253376:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.669877:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.671580:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985253376:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.671597:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.671622:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2013:x1830882985793280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1966us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.671630:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9826 00000100:00100000:0.0:1746066824.672358:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.674001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.674181:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793536 00000100:00100000:1.0:1746066824.674188:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793536 00002000:00100000:1.0:1746066824.674235:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->1908735) req@ffff88012b167b80 x1830882985793536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.674244:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167b80 with x1830882985793536 ext(1904640->1908735) 00002000:00010000:1.0:1746066824.674248:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167b80 00000100:00100000:1.0:1746066824.674275:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8109 00000100:00100000:1.0:1746066824.674281:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985793536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.674387:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985793536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 106us (2031us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066824.674393:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8109 00002000:00100000:1.0:1746066824.674397:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->1908735) req@ffff88012b167b80 x1830882985793536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.674404:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167b80 with x1830882985793536 ext(1904640->1908735) 00002000:00010000:1.0:1746066824.674406:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167b80 00000100:00100000:3.0:1746066824.674679:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793664 00000100:00100000:3.0:1746066824.674688:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793664 00000100:00100000:3.0:1746066824.674741:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17446 00000100:00100000:3.0:1746066824.674748:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:3840:x1830882985793664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.674767:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.674783:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb37ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a7d expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.674833:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb37ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a7d expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.674844:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb37ef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a7d expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.674857:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.674860:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066824.674863:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:3.0:1746066824.674934:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3840:x1830882985793664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 187us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.674940:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17446 00010000:00010000:3.0:1746066824.678018:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066824.678167:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.678699:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793792 00000100:00100000:1.0:1746066824.678706:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793792 00000100:00100000:1.0:1746066824.679590:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21308 00000100:00100000:1.0:1746066824.679600:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:3836:x1830882985793792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066824.679615:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.679630:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a84 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.679655:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.679664:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.679670:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.679680:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.679682:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.679685:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.679709:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.679720:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 15 pid: 12255 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.679730:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253504:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.679814:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.679822:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 21 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.679829:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253632:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.679851:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.679857:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.679869:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.679908:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.681341:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.681349:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253632:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.681353:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985253760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.681377:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.681388:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb200, rc 0) 00000100:00100000:1.0:1746066824.682683:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:3836:x1830882985793792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3081us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.682690:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21308 00000100:00100000:0.0:1746066824.683749:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.683782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.683817:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.683899:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985793920 00000100:00100000:1.0:1746066824.683905:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985793920 00010000:00010000:1.0:1746066824.683930:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 16 pid: 12255 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.683951:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985794048 00000100:00100000:1.0:1746066824.683953:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985794048 00010000:00010000:1.0:1746066824.683963:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.683974:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985794176 00000100:00100000:1.0:1746066824.683976:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985794176 00010000:00010000:1.0:1746066824.683983:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.683996:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9827 00000100:00100000:1.0:1746066824.684001:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985793920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.684010:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.684025:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 16 pid: 12255 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.684035:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 16 pid: 12255 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746066824.684051:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db76c00/0xf1867c21abfb36ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a0d expref: 16 pid: 12255 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.684065:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9828 00010000:00010000:1.0:1746066824.684070:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.684081:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985794048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.684096:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066824.684109:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985793920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.684114:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9827 00010000:00010000:3.0:1746066824.684120:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746066824.684132:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.684152:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9829 00010000:00010000:3.0:1746066824.684156:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0a00/0xf1867c21abfb3732 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a53 expref: 22 pid: 1893 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746066824.684157:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985794176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.684163:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.684169:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.684178:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.684189:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066824.684195:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eb200/0xf1867c21abfb36b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ce expref: 42 pid: 12233 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.684203:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.684204:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.684209:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.684226:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.684238:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985794048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 163us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.684244:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9828 00010000:00010000:1.0:1746066824.684257:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.684267:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985253888:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.685335:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.686529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.686600:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985794432 00000100:00100000:2.0:1746066824.686606:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985794432 00002000:00100000:2.0:1746066824.686640:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88008e437800 x1830882985794432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.686649:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437800 with x1830882985794432 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.686653:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e437800 00000100:00100000:2.0:1746066824.686679:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8110 00000100:00100000:2.0:1746066824.686685:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985794432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.692205:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882985253888:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066824.692206:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066824.692233:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.692279:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e436300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985794176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8120us (8461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.692289:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9829 00000100:00100000:2.0:1746066824.692360:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985794688 00000100:00100000:2.0:1746066824.692366:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985794688 00002000:00100000:2.0:1746066824.692395:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1232896->1236991) req@ffff88008e437100 x1830882985794688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.692405:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437100 with x1830882985794688 ext(1232896->1236991) 00002000:00010000:2.0:1746066824.692409:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e437100 00000100:00100000:2.0:1746066824.692464:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8111 00000100:00100000:2.0:1746066824.692470:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985794688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066824.692578:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882985794688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 107us (377us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066824.692583:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8111 00002000:00100000:2.0:1746066824.692588:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x81:0x0] (1232896->1236991) req@ffff88008e437100 x1830882985794688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.692595:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437100 with x1830882985794688 ext(1232896->1236991) 00002000:00010000:2.0:1746066824.692598:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e437100 00000100:00100000:3.0:1746066824.693860:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985794432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7171us (7331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.693867:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8110 00002000:00100000:3.0:1746066824.693873:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88008e437800 x1830882985794432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.693880:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e437800 with x1830882985794432 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.693899:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e437800 00000100:00100000:0.0:1746066824.697034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.697108:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.697128:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985794944 00000100:00100000:3.0:1746066824.697138:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985794944 00000100:00100000:3.0:1746066824.697181:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6618 00000100:00100000:3.0:1746066824.697188:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:3836:x1830882985794944:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066824.697382:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3836:x1830882985794944:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 194us (361us total) trans 8589937976 rc 0/0 00000100:00100000:3.0:1746066824.697389:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6618 00000100:00100000:1.0:1746066824.697972:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795072 00000100:00100000:1.0:1746066824.697979:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795072 00000100:00100000:1.0:1746066824.698020:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21309 00000100:00100000:1.0:1746066824.698026:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3840:x1830882985795072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.698042:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.698057:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a8b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.698128:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.698135:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.698138:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.698141:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.698173:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.698186:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 40 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.698200:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985254016:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.698302:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.700702:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.700781:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795200 00000100:00100000:3.0:1746066824.700791:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795200 00002000:00100000:3.0:1746066824.700828:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->2097151) req@ffff88008e435180 x1830882985795200/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.700837:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435180 with x1830882985795200 ext(1904640->2097151) 00000100:00100000:1.0:1746066824.700840:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985254016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.700845:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 41 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.700857:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 41 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.700864:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e435180 00010000:00010000:1.0:1746066824.700873:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.700923:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeac00, rc 0) 00000100:00100000:1.0:1746066824.700974:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3840:x1830882985795072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2945us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.700984:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21309 00000100:00100000:0.0:1746066824.701168:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2316 00000100:00100000:0.0:1746066824.701180:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985795200:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066824.706789:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985795200:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5598us (6079us total) trans 21474842909 rc 0/0 00000100:00100000:0.0:1746066824.706802:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2316 00002000:00100000:0.0:1746066824.706818:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1904640->2097151) req@ffff88008e435180 x1830882985795200/t21474842909(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.706828:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e435180 with x1830882985795200 ext(1904640->2097151) 00010000:00010000:0.0:1746066824.706839:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746066824.706856:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746066824.706863:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e435180 00000100:00100000:0.0:1746066824.709259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.709428:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795328 00000100:00100000:1.0:1746066824.709438:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795328 00010000:00010000:1.0:1746066824.709475:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.710184:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9830 00000100:00100000:1.0:1746066824.710196:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985795328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.710215:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.710248:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.710262:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.710287:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135974200/0xf1867c21abfb37e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a76 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746066824.710437:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.710440:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.710449:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.710459:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.710499:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.710516:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985254144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.710623:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.716708:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.716788:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795584 00000100:00100000:2.0:1746066824.716797:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795584 00002000:00100000:2.0:1746066824.716848:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88008e434380 x1830882985795584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.716858:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434380 with x1830882985795584 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.716864:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434380 00000100:00100000:1.0:1746066824.717146:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985254144:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.717172:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.717434:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8112 00000100:00100000:2.0:1746066824.717446:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985795584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.718504:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985795328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8307us (9251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.718514:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9830 00000100:00100000:2.0:1746066824.729388:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985795584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11932us (12682us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066824.729402:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8112 00002000:00100000:2.0:1746066824.729414:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88008e434380 x1830882985795584/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.729424:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e434380 with x1830882985795584 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.729432:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e434380 00000100:00100000:0.0:1746066824.736678:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.736730:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.736819:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795712 00000100:00100000:1.0:1746066824.736830:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795712 00000100:00100000:2.0:1746066824.736847:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795840 00000100:00100000:2.0:1746066824.736852:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795840 00000100:00100000:1.0:1746066824.736880:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21310 00000100:00100000:2.0:1746066824.736898:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21311 00000100:00100000:1.0:1746066824.736900:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3840:x1830882985795712:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066824.736904:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3837:x1830882985795840:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066824.736918:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.736918:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.736936:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a99 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.736936:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8a92 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.736964:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.736964:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.736971:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066824.736972:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.736973:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.736976:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 22 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.737006:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.737022:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 40 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.737034:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985254272:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.737079:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.737085:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.737086:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.737089:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.737106:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066824.737107:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066824.737115:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 41 pid: 12233 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066824.737129:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254400:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.737159:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.737462:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066824.737471:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.737499:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 12 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.737507:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 12 pid: 12255 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746066824.737514:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.737527:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.738696:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.738781:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985254272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.738804:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 22 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.738816:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0a00, rc 0) 00000100:00100000:1.0:1746066824.738842:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3840:x1830882985795712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1944us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.738848:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21310 00000100:00100000:3.0:1746066824.738920:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796096 00000100:00100000:3.0:1746066824.738925:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796096 00002000:00100000:3.0:1746066824.738955:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1236991) req@ffff88009d89d180 x1830882985796096/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.738964:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985796096 ext(1048576->1236991) 00010000:00010000:3.0:1746066824.738970:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 41 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.738979:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 41 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.738984:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d89d180 00000100:00100000:3.0:1746066824.738998:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2317 00000100:00100000:3.0:1746066824.739002:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882985796096:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066824.739160:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254400:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.739168:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066824.739174:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985254656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.739189:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.739203:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36400, rc 0) 00000100:00100000:2.0:1746066824.739228:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3837:x1830882985795840:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2313us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.739233:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21311 00000100:00100000:0.0:1746066824.739641:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.739664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.739680:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796224 00000100:00100000:0.0:1746066824.739683:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796224 00010000:00010000:0.0:1746066824.739702:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 13 pid: 12255 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.739720:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985795968 00000100:00100000:0.0:1746066824.739722:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985795968 00010000:00010000:0.0:1746066824.739730:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 42 pid: 12233 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746066824.739743:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9831 00000100:00100000:0.0:1746066824.739748:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985796224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.739757:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.739773:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 13 pid: 12255 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739782:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 13 pid: 12255 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739802:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfb36e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89ff expref: 13 pid: 12255 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739818:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.739835:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985796224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.739841:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9831 00000100:00100000:0.0:1746066824.739851:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9832 00000100:00100000:0.0:1746066824.739855:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985795968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.739861:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.739869:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 42 pid: 12233 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739876:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 42 pid: 12233 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739910:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfb371d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a29 expref: 42 pid: 12233 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746066824.739918:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.739930:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985795968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.739935:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9832 00000100:00100000:0.0:1746066824.742070:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.742138:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796352 00000100:00100000:2.0:1746066824.742143:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796352 00010000:00010000:2.0:1746066824.742171:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746066824.742483:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985796096:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3478us (3788us total) trans 17179875569 rc 0/0 00000100:00100000:3.0:1746066824.742492:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2317 00002000:00100000:3.0:1746066824.742501:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->1236991) req@ffff88009d89d180 x1830882985796096/t17179875569(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.742509:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d180 with x1830882985796096 ext(1048576->1236991) 00010000:00010000:3.0:1746066824.742516:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746066824.742526:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746066824.742532:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d89d180 00000100:00100000:2.0:1746066824.742646:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9833 00000100:00100000:2.0:1746066824.742653:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985796352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.742665:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.742680:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.742690:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.742710:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135975400/0xf1867c21abfb372b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a45 expref: 31 pid: 12237 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746066824.742739:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.742741:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.742748:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.742760:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.742793:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.742805:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985254784:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.742876:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.744162:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985254784:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.744180:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.744358:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985796352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1702us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.744366:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9833 00000100:00100000:0.0:1746066824.744997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.745022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.745064:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796736 00000100:00100000:3.0:1746066824.745068:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796736 00002000:00100000:3.0:1746066824.745099:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2060287) req@ffff88009d89ca80 x1830882985796736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.745106:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ca80 with x1830882985796736 ext(2056192->2060287) 00002000:00010000:3.0:1746066824.745109:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89ca80 00000100:00100000:3.0:1746066824.745121:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8113 00000100:00100000:3.0:1746066824.745125:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985796736:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066824.745246:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985796736:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066824.745251:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8113 00002000:00100000:3.0:1746066824.745255:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2060287) req@ffff88009d89ca80 x1830882985796736/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.745262:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ca80 with x1830882985796736 ext(2056192->2060287) 00002000:00010000:3.0:1746066824.745265:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89ca80 00000100:00100000:2.0:1746066824.745314:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796480 00000100:00100000:2.0:1746066824.745317:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796480 00010000:00010000:2.0:1746066824.745336:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.745367:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9834 00000100:00100000:2.0:1746066824.745372:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985796480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.745385:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.745399:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.745417:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.745436:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb200/0xf1867c21abfb37f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a84 expref: 43 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.745450:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.745452:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.745458:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.745466:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.745496:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 21 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.745508:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985254912:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.745573:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.748418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.748510:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.748624:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985254912:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.748643:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.748657:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985796864 00000100:00100000:3.0:1746066824.748662:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985796864 00000100:00100000:2.0:1746066824.748681:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985796480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3308us (3684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.748690:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9834 00000100:00100000:3.0:1746066824.748692:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21312 00000100:00100000:3.0:1746066824.748697:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3837:x1830882985796864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.748711:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.748724:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8aa0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.748751:0:13726:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.748756:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.748757:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.748759:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.748780:0:13726:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.748787:0:13726:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746066824.748795:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985255040:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.748839:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.748913:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985797120 00000100:00100000:1.0:1746066824.748918:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985797120 00002000:00100000:1.0:1746066824.748942:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89ea00 x1830882985797120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.748951:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985797120 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.748955:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00000100:00100000:1.0:1746066824.748968:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8114 00000100:00100000:1.0:1746066824.748974:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985797120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066824.751384:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13726:1830882985255040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.751409:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 31 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.751428:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419800, rc 0) 00000100:00100000:3.0:1746066824.752032:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3837:x1830882985796864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3332us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.752041:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21312 00000100:00100000:0.0:1746066824.754065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.754236:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985797248 00000100:00100000:2.0:1746066824.754245:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985797248 00010000:00010000:2.0:1746066824.754277:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746066824.754305:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9835 00000100:00100000:2.0:1746066824.754311:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2015:x1830882985797248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.754324:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.754342:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.754352:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746066824.754379:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbeac00/0xf1867c21abfb37fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a8b expref: 31 pid: 9592 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746066824.754385:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985797120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5410us (5874us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746066824.754394:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.754395:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066824.754397:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8114 00010000:00010000:2.0:1746066824.754402:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066824.754406:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff88009d89ea00 x1830882985797120/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066824.754410:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066824.754416:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89ea00 with x1830882985797120 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.754420:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89ea00 00010000:00010000:2.0:1746066824.754440:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 30 pid: 13726 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.754453:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985255168:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.754515:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.755621:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985255168:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.755638:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.755828:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985797248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1351us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.755837:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9835 00000100:00100000:0.0:1746066824.761586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.761998:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985797504 00000100:00100000:1.0:1746066824.762006:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985797504 00002000:00100000:1.0:1746066824.762055:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1921024->1925119) req@ffff88009d89f480 x1830882985797504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.762064:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985797504 ext(1921024->1925119) 00002000:00010000:1.0:1746066824.762070:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:1.0:1746066824.762105:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8115 00000100:00100000:1.0:1746066824.762114:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985797504:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.762290:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985797504:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 176us (715us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066824.762297:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8115 00002000:00100000:1.0:1746066824.762302:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1921024->1925119) req@ffff88009d89f480 x1830882985797504/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.762309:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89f480 with x1830882985797504 ext(1921024->1925119) 00002000:00010000:1.0:1746066824.762312:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89f480 00000100:00100000:3.0:1746066824.764068:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746066824.764167:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066824.764257:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985255296 00000100:00100000:0.0:1746066824.764262:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985255296 00000100:00100000:0.0:1746066824.764410:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1746066824.764417:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985255296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746066824.764435:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1294912832 pending 3121152 free 3906187264 avail 3674664960 00000100:00100000:0.0:1746066824.764470:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985255296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.764477:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00080000:2.0:1746066824.764531:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066824.764791:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066824.768608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.768688:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985797760 00000100:00100000:2.0:1746066824.768698:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985797760 00000100:00100000:2.0:1746066824.768756:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6619 00000100:00100000:2.0:1746066824.768765:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:3837:x1830882985797760:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066824.769097:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3837:x1830882985797760:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 332us (498us total) trans 8589937977 rc 0/0 00000100:00100000:2.0:1746066824.769104:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6619 00000100:00100000:0.0:1746066824.771063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.771118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.771168:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985798016 00000100:00100000:3.0:1746066824.771177:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985798016 00002000:00100000:3.0:1746066824.771212:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89fb80 x1830882985798016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.771233:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89fb80 with x1830882985798016 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.771239:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89fb80 00000100:00100000:3.0:1746066824.771262:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985798272 00000100:00100000:3.0:1746066824.771265:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985798272 00002000:00100000:3.0:1746066824.771276:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89d880 x1830882985798272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.771283:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985798272 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.771285:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:3.0:1746066824.771303:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8116 00000100:00100000:3.0:1746066824.771309:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985798016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.771399:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8117 00000100:00100000:1.0:1746066824.771408:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985798272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.783299:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.783386:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985798528 00000100:00100000:3.0:1746066824.783396:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985798528 00000100:00100000:3.0:1746066824.783458:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17447 00000100:00100000:3.0:1746066824.783467:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3845:x1830882985798528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066824.783493:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.783510:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb3819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8aa7 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.783589:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783603:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783614:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783626:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783631:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783635:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783732:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783738:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783744:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066824.783753:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066824.783824:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783830:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783835:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783840:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783844:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea4000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.783847:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783853:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783864:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066824.783866:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.783870:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783875:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfb3820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783932:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783937:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783942:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783950:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea5400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066824.783952:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783957:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783963:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0fa00) 00010000:00010000:3.0:1746066824.783965:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066824.783967:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.783970:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.784004:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb3819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 32 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.784014:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 31 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.784020:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066824.784022:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066824.784024:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5200, rc 0) 00000100:00100000:3.0:1746066824.784192:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:3845:x1830882985798528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 612us (791us total) trans 8589937978 rc 0/0 00000100:00100000:3.0:1746066824.784204:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17447 00000100:00100000:3.0:1746066824.786400:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985798016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15083us (15337us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066824.786414:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8116 00002000:00100000:3.0:1746066824.786426:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88009d89fb80 x1830882985798016/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.786435:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89fb80 with x1830882985798016 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.786441:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d89fb80 00000100:00100000:1.0:1746066824.796142:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985798272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24723us (25011us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066824.796153:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8117 00002000:00100000:1.0:1746066824.796164:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88009d89d880 x1830882985798272/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.796174:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d89d880 with x1830882985798272 ext(2097152->4194303) 00002000:00010000:1.0:1746066824.796180:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d89d880 00000100:00100000:0.0:1746066824.796523:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.796608:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985798784 00000100:00100000:3.0:1746066824.796615:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985798784 00000100:00100000:3.0:1746066824.797287:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6620 00000100:00100000:3.0:1746066824.797295:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:3845:x1830882985798784:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066824.797469:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:3845:x1830882985798784:12345-192.168.204.16@tcp:35:cat.0 Request processed in 176us (948us total) trans 8589937979 rc 0/0 00000100:00100000:3.0:1746066824.797475:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6620 00000100:00100000:0.0:1746066824.808794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.808841:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.808869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.808924:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985798912 00000100:00100000:0.0:1746066824.808933:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985798912 00000100:00100000:1.0:1746066824.808952:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985799040 00000100:00100000:1.0:1746066824.808957:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985799040 00000100:00100000:0.0:1746066824.808997:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985799168 00000100:00100000:0.0:1746066824.808999:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985799168 00000100:00100000:1.0:1746066824.809004:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21313 00000100:00100000:1.0:1746066824.809013:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985798912:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066824.809018:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21314 00000100:00100000:0.0:1746066824.809023:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985799040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.809033:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.809033:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066824.809049:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfb383c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ab5 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.809052:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfb3843 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8aae expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066824.809086:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21315 00000100:00100000:3.0:1746066824.809094:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882985799168:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066824.809099:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985255552:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066824.809099:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985255424:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066824.809103:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.809113:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8abc expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.809126:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.809127:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.809135:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 43 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.809150:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 43 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.809164:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5e00, rc 0) 00000100:00100000:1.0:1746066824.809174:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.809474:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066824.809479:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985799168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 384us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.809486:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21315 00000100:00100000:1.0:1746066824.809565:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.809606:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985799424 00000100:00100000:2.0:1746066824.809610:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985799424 00002000:00100000:2.0:1746066824.809638:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012d802680 x1830882985799424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.809647:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802680 with x1830882985799424 ext(4194304->5074943) 00002000:00010000:2.0:1746066824.809652:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d802680 00000100:00100000:2.0:1746066824.809677:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8118 00000100:00100000:2.0:1746066824.809683:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985799424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066824.814481:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985255424:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066824.814515:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfb383c lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ab5 expref: 44 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.814531:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfb383c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ab5 expref: 44 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066824.814552:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1400, rc 0) 00000100:00100000:2.0:1746066824.814600:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985799040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5575us (5757us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066824.814605:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985255552:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066824.814608:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21314 00010000:00010000:1.0:1746066824.814623:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfb3843 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aae expref: 42 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.814631:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfb3843 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aae expref: 42 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.814645:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3c00, rc 0) 00000100:00100000:1.0:1746066824.814664:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882985798912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5652us (5882us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066824.814669:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21313 00000100:00100000:2.0:1746066824.816408:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985799424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6717us (6835us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066824.816418:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8118 00002000:00100000:2.0:1746066824.816428:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012d802680 x1830882985799424/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.816438:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d802680 with x1830882985799424 ext(4194304->5074943) 00002000:00010000:2.0:1746066824.816443:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d802680 00000100:00100000:2.0:1746066824.828184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.828286:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.828359:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985799936 00000100:00100000:3.0:1746066824.828368:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985799936 00000100:00100000:3.0:1746066824.828421:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17448 00000100:00100000:3.0:1746066824.828429:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:3847:x1830882985799936:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.828456:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.828474:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb3851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ac3 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.828578:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.828594:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.828601:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066824.828630:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.828640:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 33 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066824.828656:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985255680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.828729:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.828913:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985799680 00000100:00100000:2.0:1746066824.828917:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985799680 00002000:00100000:2.0:1746066824.828947:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5884a80 x1830882985799680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.828957:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884a80 with x1830882985799680 ext(0->1048575) 00002000:00010000:2.0:1746066824.828963:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884a80 00000100:00100000:2.0:1746066824.828977:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8119 00000100:00100000:2.0:1746066824.828982:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985799680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.838393:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.838581:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985799680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9596us (10293us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066824.838592:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8119 00002000:00100000:0.0:1746066824.838604:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800a5884a80 x1830882985799680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.838612:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884a80 with x1830882985799680 ext(0->1048575) 00002000:00010000:0.0:1746066824.838618:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884a80 00000100:00100000:2.0:1746066824.838778:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800064 00000100:00100000:2.0:1746066824.838786:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800064 00010000:00010000:2.0:1746066824.838815:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 34 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066824.838851:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9836 00000100:00100000:2.0:1746066824.838857:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882985800064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066824.838859:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985255680:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066824.838869:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.838875:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 34 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066824.838879:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.838901:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 34 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066824.839512:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb382e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa7 expref: 34 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066824.839539:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.839543:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.839553:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.839559:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.839825:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066824.839830:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066824.839837:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066824.839856:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:2.0:1746066824.839860:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985800064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1003us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.839870:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9836 00010000:00010000:0.0:1746066824.839988:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb3851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 34 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.840010:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 33 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.840017:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066824.840022:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066824.840025:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5400, rc 0) 00000100:00100000:0.0:1746066824.840047:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:3847:x1830882985799936:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11620us (11875us total) trans 8589937980 rc 0/0 00000100:00100000:0.0:1746066824.840054:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17448 00000100:00100000:0.0:1746066824.847991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.849989:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800192 00000100:00100000:1.0:1746066824.850002:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800192 00000100:00100000:1.0:1746066824.850237:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21316 00000100:00100000:1.0:1746066824.850246:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:3845:x1830882985800192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066824.850267:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.850285:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8aca expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.850316:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.850324:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.850325:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.850329:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.850361:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.850374:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 29 pid: 13726 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066824.850392:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985255808:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.851973:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.852368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.852504:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800320 00000100:00100000:3.0:1746066824.852512:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800320 00000100:00100000:3.0:1746066824.852549:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21317 00000100:00100000:3.0:1746066824.852556:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:3847:x1830882985800320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066824.852570:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066824.852585:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ad1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.852614:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.852625:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.852634:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.852639:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.852641:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066824.852647:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.852673:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.852683:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 14 pid: 9591 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066824.852692:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985255936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.852845:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066824.852854:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066824.852861:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985256064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.852906:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.852915:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 21 pid: 3528 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066824.852922:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985256192:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.853782:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.857699:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.857785:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.857824:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800448 00000100:00100000:0.0:1746066824.857832:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800448 00002000:00100000:0.0:1746066824.857880:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2097151) req@ffff8800a5886d80 x1830882985800448/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.857916:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985800448 ext(2056192->2097151) 00010000:00010000:0.0:1746066824.857925:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 30 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066824.857938:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 30 pid: 13726 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746066824.857945:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886d80 00000100:00100000:0.0:1746066824.857964:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2318 00000100:00100000:0.0:1746066824.857971:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985800448:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066824.858204:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985255936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.858223:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985256064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066824.858230:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985256192:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066824.858259:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066824.858273:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4c00, rc 0) 00000100:00100000:3.0:1746066824.858300:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:3847:x1830882985800320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5746us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.858308:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21317 00000100:00100000:2.0:1746066824.858380:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800704 00000100:00100000:2.0:1746066824.858384:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800704 00010000:00010000:2.0:1746066824.858401:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 15 pid: 9591 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066824.858419:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9837 00000100:00100000:2.0:1746066824.858424:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985800704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.858433:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.858450:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 15 pid: 9591 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066824.858459:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 15 pid: 9591 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066824.858480:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfb3708 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a14 expref: 15 pid: 9591 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066824.858495:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.858510:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985800704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.858516:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9837 00000100:00100000:1.0:1746066824.858927:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985255808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.858945:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.858954:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06200, rc 0) 00000100:00100000:1.0:1746066824.858972:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:3845:x1830882985800192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8728us (10994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.858978:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21316 00000100:00100000:0.0:1746066824.861389:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.861430:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.861475:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800576 00000100:00100000:2.0:1746066824.861483:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800576 00010000:00010000:2.0:1746066824.861515:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066824.862113:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985800832 00000100:00100000:2.0:1746066824.862117:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985800832 00010000:00010000:2.0:1746066824.862131:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 22 pid: 3528 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066824.862658:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9838 00000100:00100000:3.0:1746066824.862668:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985800576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066824.862687:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.862705:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066824.862716:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066824.862738:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfb3716 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a30 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066824.862755:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9839 00010000:00010000:3.0:1746066824.862757:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.862762:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985800832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066824.862770:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066824.862778:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 22 pid: 3528 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066824.862789:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 22 pid: 3528 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066824.862790:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985800576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.862796:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9838 00010000:00010000:2.0:1746066824.862802:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82c00/0xf1867c21abfb36a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89c7 expref: 22 pid: 3528 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066824.862833:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.862835:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066824.862842:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.862850:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.862909:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066824.862924:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985256320:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066824.863449:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.864197:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985800448:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6224us (6506us total) trans 21474842910 rc 0/0 00000100:00100000:2.0:1746066824.864206:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2318 00002000:00100000:2.0:1746066824.864228:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2097151) req@ffff8800a5886d80 x1830882985800448/t21474842910(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.864238:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886d80 with x1830882985800448 ext(2056192->2097151) 00010000:00010000:2.0:1746066824.864246:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066824.864259:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066824.864266:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886d80 00000100:00100000:3.0:1746066824.866942:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.867031:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985256320:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.867058:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066824.867165:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801088 00000100:00100000:0.0:1746066824.867172:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801088 00002000:00100000:0.0:1746066824.867225:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3096575) req@ffff88009666ed80 x1830882985801088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.867235:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882985801088 ext(3092480->3096575) 00002000:00010000:0.0:1746066824.867239:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:0.0:1746066824.867267:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8120 00000100:00100000:0.0:1746066824.867275:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985801088:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066824.867552:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985800832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4789us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.867561:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9839 00000100:00100000:0.0:1746066824.867648:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985801088:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 374us (716us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066824.867654:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8120 00002000:00100000:0.0:1746066824.867660:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (3092480->3096575) req@ffff88009666ed80 x1830882985801088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.867667:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882985801088 ext(3092480->3096575) 00002000:00010000:0.0:1746066824.867671:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:2.0:1746066824.868346:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.868420:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801216 00000100:00100000:0.0:1746066824.868423:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801216 00010000:00010000:0.0:1746066824.868442:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066824.868473:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9840 00000100:00100000:0.0:1746066824.868479:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985801216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066824.868489:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066824.868505:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066824.868516:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066824.868537:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfb3804 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a99 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066824.868556:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.868559:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066824.868567:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.868575:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.868606:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066824.868618:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985256448:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066824.868682:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.870663:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.870713:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801344 00000100:00100000:1.0:1746066824.870719:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801344 00000100:00100000:1.0:1746066824.870755:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21318 00000100:00100000:1.0:1746066824.870760:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:3847:x1830882985801344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066824.870773:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066824.870786:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ad8 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.870806:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.870811:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 43 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.870819:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.870822:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.870823:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.870826:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.870844:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.870852:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 11 pid: 12233 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066824.870858:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256576:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.870931:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 43 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066824.870936:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 43 pid: 1893 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066824.870941:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256704:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.870956:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.870964:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066824.870969:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.870976:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066824.871128:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5884380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985256448:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066824.871143:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066824.871168:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985801216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2689us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066824.871177:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9840 00000100:00100000:0.0:1746066824.872653:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.872732:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801600 00000100:00100000:2.0:1746066824.872738:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801600 00002000:00100000:2.0:1746066824.872778:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5884700 x1830882985801600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.872789:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884700 with x1830882985801600 ext(1048576->2097151) 00002000:00010000:2.0:1746066824.872794:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5884700 00000100:00100000:2.0:1746066824.872809:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8121 00000100:00100000:2.0:1746066824.872815:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985801600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066824.873454:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256576:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.873465:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066824.873511:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985256704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066824.873692:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066824.873708:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07e00, rc 0) 00000100:00100000:0.0:1746066824.873754:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:3847:x1830882985801344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2993us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066824.873762:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21318 00000100:00100000:0.0:1746066824.874796:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066824.874838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.874864:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801728 00000100:00100000:3.0:1746066824.874870:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801728 00000100:00100000:1.0:1746066824.875179:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801856 00000100:00100000:1.0:1746066824.875183:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801856 00010000:00010000:3.0:1746066824.875185:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 12 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066824.875199:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 45 pid: 1893 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066824.875224:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9841 00000100:00100000:1.0:1746066824.875236:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9842 00000100:00100000:1.0:1746066824.875242:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985801856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066824.875248:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+12:2016:x1830882985801728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.875253:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.875255:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066824.875270:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 12 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066824.875270:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 45 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066824.875280:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 12 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066824.875301:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83800/0xf1867c21abfb36f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a1b expref: 12 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066824.875316:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066824.875336:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2016:x1830882985801728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066824.875342:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9841 00010000:00010000:1.0:1746066824.875467:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 45 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066824.875480:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfb3724 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a37 expref: 45 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066824.875491:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.875505:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985801856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 264us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.875625:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9842 00000100:00100000:2.0:1746066824.879545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.879657:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985801984 00000100:00100000:1.0:1746066824.879666:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985801984 00010000:00010000:1.0:1746066824.879702:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066824.879744:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9843 00000100:00100000:1.0:1746066824.879753:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2016:x1830882985801984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.879769:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.879789:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.879801:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.879824:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095dd1e00/0xf1867c21abfb36c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89dc expref: 31 pid: 9591 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.879848:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.879850:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.879858:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.879866:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.879923:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.879936:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985256960:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.880046:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066824.880338:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985801600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7521us (7688us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066824.880347:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8121 00002000:00100000:0.0:1746066824.880356:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a5884700 x1830882985801600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066824.880365:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884700 with x1830882985801600 ext(1048576->2097151) 00002000:00010000:0.0:1746066824.880369:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5884700 00000100:00100000:1.0:1746066824.884153:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985256960:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.884173:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.884229:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985801984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4475us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.884240:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9843 00000100:00100000:0.0:1746066824.885397:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.885456:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985802240 00000100:00100000:2.0:1746066824.885463:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985802240 00000100:00100000:0.0:1746066824.885465:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066824.885503:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2297856->2301951) req@ffff8800a5885500 x1830882985802240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066824.885513:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885500 with x1830882985802240 ext(2297856->2301951) 00002000:00010000:2.0:1746066824.885518:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885500 00000100:00100000:2.0:1746066824.885536:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8122 00000100:00100000:2.0:1746066824.885543:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985802240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.885638:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985802368 00000100:00100000:1.0:1746066824.885642:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985802368 00000100:00100000:2.0:1746066824.885671:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985802240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 127us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066824.885674:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21319 00000100:00100000:2.0:1746066824.885676:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8122 00000100:00100000:1.0:1746066824.885678:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:3845:x1830882985802368:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:2.0:1746066824.885681:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2297856->2301951) req@ffff8800a5885500 x1830882985802240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746066824.885687:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746066824.885693:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5885500 with x1830882985802240 ext(2297856->2301951) 00002000:00010000:2.0:1746066824.885695:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5885500 00010000:00010000:1.0:1746066824.885701:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8adf expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.885858:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.885867:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.885869:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066824.885872:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.885917:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 29 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.885934:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 29 pid: 13726 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066824.886041:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985257088:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066824.886109:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.889105:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985257088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066824.889135:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.889207:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:1.0:1746066824.889274:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:3845:x1830882985802368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3592us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.889282:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21319 00000100:00100000:0.0:1746066824.889373:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.889397:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985802496 00000100:00100000:1.0:1746066824.889403:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985802496 00002000:00100000:1.0:1746066824.889437:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1925119) req@ffff8800a5886680 x1830882985802496/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.889444:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886680 with x1830882985802496 ext(1048576->1925119) 00010000:00010000:1.0:1746066824.889511:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 30 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.889524:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 30 pid: 13726 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066824.889535:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886680 00000100:00100000:1.0:1746066824.889558:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2319 00000100:00100000:1.0:1746066824.889565:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985802496:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066824.896844:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2016:x1830882985802496:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7265us (7459us total) trans 21474842911 rc 0/0 00000100:00100000:1.0:1746066824.896858:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2319 00002000:00100000:1.0:1746066824.896870:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1925119) req@ffff8800a5886680 x1830882985802496/t21474842911(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:230/0 lens 488/448 e 0 to 0 dl 1746066835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.896880:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886680 with x1830882985802496 ext(1048576->1925119) 00010000:00010000:1.0:1746066824.896915:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.896931:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066824.896938:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5886680 00000100:00100000:0.0:1746066824.898578:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.898660:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985802624 00000100:00100000:1.0:1746066824.898669:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985802624 00010000:00010000:1.0:1746066824.898701:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066824.898779:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9844 00000100:00100000:1.0:1746066824.898787:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2014:x1830882985802624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066824.898803:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066824.898820:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.898831:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.898851:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfb3812 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aa0 expref: 32 pid: 13726 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066824.899000:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.899003:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066824.899012:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.899021:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066824.899058:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066824.899070:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985257216:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066824.899157:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066824.901790:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985257216:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066824.901811:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066824.901860:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:2014:x1830882985802624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3072us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066824.901872:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9844 00000100:00100000:2.0:1746066824.905650:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.907293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.907415:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985802880 00000100:00100000:3.0:1746066824.907426:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985802880 00002000:00100000:3.0:1746066824.907501:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880093c6b100 x1830882985802880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.907512:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b100 with x1830882985802880 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.907518:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6b100 00000100:00100000:1.0:1746066824.907632:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985803136 00000100:00100000:3.0:1746066824.907636:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8123 00000100:00100000:1.0:1746066824.907636:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985803136 00000100:00100000:3.0:1746066824.907644:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985802880:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:1.0:1746066824.907654:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880093c68000 x1830882985803136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.907660:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68000 with x1830882985803136 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.907664:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68000 00000100:00100000:1.0:1746066824.907865:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8124 00000100:00100000:1.0:1746066824.907870:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985803136:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066824.917565:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985803136:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9683us (10266us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066824.917576:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8124 00002000:00100000:1.0:1746066824.917588:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x81:0x0] (1048576->2097151) req@ffff880093c68000 x1830882985803136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.917597:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68000 with x1830882985803136 ext(1048576->2097151) 00002000:00010000:1.0:1746066824.917603:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68000 00000100:00100000:3.0:1746066824.920035:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985802880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12379us (14383us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066824.920046:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8123 00002000:00100000:3.0:1746066824.920056:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff880093c6b100 x1830882985802880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.920064:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b100 with x1830882985802880 ext(1048576->2097151) 00002000:00010000:3.0:1746066824.920070:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6b100 00000100:00100000:0.0:1746066824.933208:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066824.933327:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985803392 00000100:00100000:3.0:1746066824.933337:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985803392 00002000:00100000:3.0:1746066824.933385:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5884000 x1830882985803392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 504/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.933395:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884000 with x1830882985803392 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.933400:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884000 00000100:00100000:3.0:1746066824.933437:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8125 00000100:00100000:3.0:1746066824.933445:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985803392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066824.934461:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.934576:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985803648 00000100:00100000:1.0:1746066824.934582:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985803648 00002000:00100000:1.0:1746066824.934608:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2301952->4194303) req@ffff8800a5886a00 x1830882985803648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.934617:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985803648 ext(2301952->4194303) 00002000:00010000:1.0:1746066824.934621:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:1.0:1746066824.934645:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8126 00000100:00100000:1.0:1746066824.934651:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985803648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066824.947179:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882985803392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13721us (13970us total) trans 0 rc 2043904/2043904 00000100:00100000:3.0:1746066824.947193:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8125 00002000:00100000:3.0:1746066824.947205:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5884000 x1830882985803392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 504/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 2043904/2043904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066824.947235:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884000 with x1830882985803392 ext(2097152->4194303) 00002000:00010000:3.0:1746066824.947241:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884000 00000100:00100000:1.0:1746066824.952144:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985803648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17484us (17676us total) trans 0 rc 1892352/1892352 00000100:00100000:1.0:1746066824.952156:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8126 00002000:00100000:1.0:1746066824.952167:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2301952->4194303) req@ffff8800a5886a00 x1830882985803648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 1892352/1892352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.952177:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5886a00 with x1830882985803648 ext(2301952->4194303) 00002000:00010000:1.0:1746066824.952182:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5886a00 00000100:00100000:0.0:1746066824.961358:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066824.961452:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985803904 00000100:00100000:1.0:1746066824.961460:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985803904 00002000:00100000:1.0:1746066824.961499:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5884380 x1830882985803904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/0 e 0 to 0 dl 1746066835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.961509:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884380 with x1830882985803904 ext(4194304->5074943) 00002000:00010000:1.0:1746066824.961514:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884380 00000100:00100000:1.0:1746066824.961543:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8127 00000100:00100000:1.0:1746066824.961551:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985803904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066824.966042:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882985803904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4484us (4681us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066824.966052:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8127 00002000:00100000:1.0:1746066824.966061:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5884380 x1830882985803904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:230/0 lens 488/440 e 0 to 0 dl 1746066835 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066824.966069:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5884380 with x1830882985803904 ext(4194304->5074943) 00002000:00010000:1.0:1746066824.966073:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5884380 00000100:00100000:0.0:1746066824.989073:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066824.989171:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985804160 00000100:00100000:2.0:1746066824.989181:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985804160 00000100:00100000:2.0:1746066824.989239:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17449 00000100:00100000:2.0:1746066824.989245:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:3852:x1830882985804160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066824.989264:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066824.989275:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb3882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ae6 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.989327:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989336:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989342:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989349:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989353:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989356:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989426:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb3897 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989433:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb3897 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989438:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb3897 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066824.989445:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066824.989506:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989512:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989517:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989522:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989527:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf56800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.989530:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989536:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989545:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066824.989548:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.989551:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989559:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56800/0xf1867c21abfb3889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989585:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989590:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989594:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989599:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf56c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066824.989601:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989605:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989624:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9300) 00010000:00010000:2.0:1746066824.989626:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066824.989628:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989632:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfb3890 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066824.989660:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb3882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ae6 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.989669:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb3897 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ae6 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066824.989679:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066824.989680:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066824.989682:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56400, rc 0) 00000100:00100000:2.0:1746066824.989740:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3852:x1830882985804160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 494us (680us total) trans 8589937981 rc 0/0 00000100:00100000:2.0:1746066824.989745:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17449 00000100:00100000:0.0:1746066825.004250:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.004378:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985804416 00000100:00100000:2.0:1746066825.004391:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985804416 00000100:00080000:0.0:1746066825.004460:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066825.004661:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17450 00000100:00100000:2.0:1746066825.004672:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:3854:x1830882985804416:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.004692:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.004707:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb38a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8aed expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.004770:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004781:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004789:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004800:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004805:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004813:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004964:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb38ba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004973:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb38ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.004979:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb38ba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066825.004986:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066825.005046:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005051:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005055:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005061:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005066:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf56a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.005069:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005074:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005083:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066825.005086:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.005089:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005093:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005119:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005124:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005128:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005132:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf57800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.005134:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005138:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005143:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9400) 00010000:00010000:2.0:1746066825.005145:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.005147:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005150:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.005179:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb38a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aed expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.005193:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb38ba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aed expref: 35 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.005198:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.005200:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066825.005202:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57a00, rc 0) 00000100:00100000:2.0:1746066825.005274:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:3854:x1830882985804416:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 604us (1034us total) trans 8589937982 rc 0/0 00000100:00100000:2.0:1746066825.005280:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17450 00000100:00100000:0.0:1746066825.008749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.008791:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.008903:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985804800 00000100:00100000:3.0:1746066825.008909:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985804672 00000100:00100000:3.0:1746066825.008916:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985804672 00000100:00100000:1.0:1746066825.008916:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985804800 00000100:00100000:3.0:1746066825.008956:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6621 00000100:00100000:3.0:1746066825.008963:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:3854:x1830882985804672:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066825.008964:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21320 00000100:00100000:1.0:1746066825.008969:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+31:3852:x1830882985804800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066825.008982:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.008998:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8af4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.009021:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.009029:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.009030:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.009034:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1220608->1626111] (req 1220608->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.009062:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.009075:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 42 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.009088:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985257344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.009154:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:3854:x1830882985804672:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 191us (413us total) trans 8589937983 rc 0/0 00000100:00100000:3.0:1746066825.009160:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6621 00000100:00100000:1.0:1746066825.009168:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.011645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.011755:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985257344:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.011785:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1220608->1626111] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.011812:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6600, rc 0) 00000100:00100000:2.0:1746066825.011822:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985804928 00000100:00100000:2.0:1746066825.011828:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985804928 00000100:00100000:1.0:1746066825.011859:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:3852:x1830882985804800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2889us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.011868:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21320 00010000:00010000:2.0:1746066825.011872:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 43 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.011929:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9845 00000100:00100000:2.0:1746066825.011935:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882985804928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.011945:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.011963:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 43 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.011973:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 43 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.012000:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfb3866 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aca expref: 43 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.012026:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.012028:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.012035:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.012043:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.012071:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.012082:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985257472:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.012142:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00080000:0.0:1746066825.012232:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066825.013278:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985257472:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.013293:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.013331:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882985804928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1392us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.013339:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9845 00000100:00100000:0.0:1746066825.013687:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.013751:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985805184 00000100:00100000:1.0:1746066825.013757:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985805184 00002000:00100000:1.0:1746066825.013790:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1224703) req@ffff8800958a5180 x1830882985805184/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.013799:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882985805184 ext(1220608->1224703) 00002000:00010000:1.0:1746066825.013804:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:1.0:1746066825.013877:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8128 00000100:00100000:1.0:1746066825.013902:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985805184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.014020:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985805184:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 137us (337us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.014026:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8128 00002000:00100000:1.0:1746066825.014031:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1224703) req@ffff8800958a5180 x1830882985805184/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.014038:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882985805184 ext(1220608->1224703) 00002000:00010000:1.0:1746066825.014041:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:0.0:1746066825.018753:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.018856:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985805440 00000100:00100000:1.0:1746066825.018866:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985805440 00002000:00100000:1.0:1746066825.018944:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1622016->1626111) req@ffff8800958a6680 x1830882985805440/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.018960:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882985805440 ext(1622016->1626111) 00002000:00010000:1.0:1746066825.018964:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:1.0:1746066825.018995:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8129 00000100:00100000:1.0:1746066825.019004:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985805440:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066825.019360:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985805440:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 355us (617us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066825.019369:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8129 00002000:00100000:0.0:1746066825.019376:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1622016->1626111) req@ffff8800958a6680 x1830882985805440/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.019382:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882985805440 ext(1622016->1626111) 00002000:00010000:0.0:1746066825.019386:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:0.0:1746066825.021742:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.021855:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985805696 00000100:00100000:3.0:1746066825.021862:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985805696 00000100:00080000:0.0:1746066825.021905:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066825.021942:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6622 00000100:00100000:3.0:1746066825.021950:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+12:3852:x1830882985805696:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066825.022194:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3852:x1830882985805696:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 245us (460us total) trans 8589937984 rc 0/0 00000100:00100000:3.0:1746066825.022201:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6622 00000100:00100000:0.0:1746066825.041731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.041951:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985805952 00000100:00100000:2.0:1746066825.041960:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985805952 00000100:00100000:2.0:1746066825.042021:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17451 00000100:00100000:2.0:1746066825.042029:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+13:3859:x1830882985805952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.042056:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.042078:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb38cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8afb expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.042165:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042179:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042191:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042203:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042220:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042226:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042321:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960d6000/0xf1867c21abfb38e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042331:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960d6000/0xf1867c21abfb38e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042336:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960d6000/0xf1867c21abfb38e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066825.042345:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066825.042422:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042428:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042436:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042441:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042447:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf56a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.042450:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042456:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042467:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066825.042469:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.042474:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042479:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56a00/0xf1867c21abfb38d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042506:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042511:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042516:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042519:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf57800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.042521:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042527:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042531:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9c00) 00010000:00010000:2.0:1746066825.042532:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.042534:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042537:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57800/0xf1867c21abfb38dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.042567:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57600/0xf1867c21abfb38cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8afb expref: 16 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.042574:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960d6000/0xf1867c21abfb38e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8afb expref: 15 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.042579:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.042581:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066825.042583:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960d6000, rc 0) 00000100:00100000:2.0:1746066825.042640:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3859:x1830882985805952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 612us (920us total) trans 8589937985 rc 0/0 00000100:00100000:2.0:1746066825.042647:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17451 00000100:00100000:0.0:1746066825.044088:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.044133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.044141:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985806208 00000100:00100000:3.0:1746066825.044148:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985806208 00000100:00100000:3.0:1746066825.044193:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6623 00000100:00100000:3.0:1746066825.044199:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3859:x1830882985806208:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066825.044201:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985806336 00000100:00100000:2.0:1746066825.044205:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985806336 00000100:00100000:2.0:1746066825.044247:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 977 00000100:00100000:2.0:1746066825.044252:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985806336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.044262:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.044278:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960d6000/0xf1867c21abfb38e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8afb expref: 16 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.044290:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.044293:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.044326:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2014:x1830882985806336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.044331:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 977 00000100:00100000:3.0:1746066825.044335:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3859:x1830882985806208:12345-192.168.204.16@tcp:35:cat.0 Request processed in 136us (250us total) trans 8589937986 rc 0/0 00000100:00100000:3.0:1746066825.044342:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6623 00000100:00100000:0.0:1746066825.046154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.046192:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.046249:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.046271:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985806464 00000100:00100000:2.0:1746066825.046274:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985806720 00000100:00100000:1.0:1746066825.046274:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985806592 00000100:00100000:0.0:1746066825.046277:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985806464 00000100:00100000:2.0:1746066825.046283:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985806720 00000100:00100000:1.0:1746066825.046284:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985806592 00000100:00100000:0.0:1746066825.046327:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21321 00000100:00100000:0.0:1746066825.046333:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2015:x1830882985806464:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066825.046342:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21322 00000100:00100000:2.0:1746066825.046348:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21323 00010000:00010000:0.0:1746066825.046349:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066825.046350:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985806592:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066825.046352:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2016:x1830882985806720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.046363:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.046363:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.046366:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b02 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.046374:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfb38f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b10 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.046375:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb3900 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b09 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.046387:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.046389:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.046397:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.046411:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 35 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066825.046414:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985257600:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.046414:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985257728:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066825.046421:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07800, rc 0) 00000100:00100000:0.0:1746066825.046461:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882985806464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.046467:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21321 00000100:00100000:2.0:1746066825.046498:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.046511:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066825.047976:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime: 1746066825 -> 1746066826 00002000:00010000:2.0:1746066825.047979:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime: 1746066825 -> 1746066826 00000100:00100000:2.0:1746066825.047992:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985257600:192.168.204.16@tcp:106: 00002000:00010000:1.0:1746066825.047996:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066825 -> 1746066826 00002000:00010000:1.0:1746066825.047999:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066825 -> 1746066826 00000100:00100000:1.0:1746066825.048010:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985257728:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.048012:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfb38f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b10 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.048022:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfb38f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b10 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.048027:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb3900 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b09 expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.048035:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfb3900 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b09 expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.048041:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56800, rc 0) 00010000:00010000:1.0:1746066825.048044:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6000, rc 0) 00000100:00100000:2.0:1746066825.048070:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2016:x1830882985806720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1716us (1819us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.048070:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985806592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1722us (1878us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.048075:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21323 00000100:00100000:1.0:1746066825.048078:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21322 00000100:00100000:0.0:1746066825.054176:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.054223:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.054270:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807104 00000100:00100000:2.0:1746066825.054279:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807104 00000100:00100000:0.0:1746066825.054290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066825.054318:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800958a4e00 x1830882985807104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.054327:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882985807104 ext(0->1048575) 00002000:00010000:2.0:1746066825.054332:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4e00 00000100:00100000:2.0:1746066825.054347:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807360 00000100:00100000:2.0:1746066825.054349:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807360 00000100:00100000:3.0:1746066825.054355:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807232 00002000:00100000:2.0:1746066825.054360:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958a4700 x1830882985807360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066825.054362:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807232 00002000:00100000:2.0:1746066825.054366:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882985807360 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.054369:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4700 00002000:00100000:3.0:1746066825.054380:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958a7b80 x1830882985807232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 504/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066825.054384:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8130 00002000:00100000:3.0:1746066825.054387:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882985807232 ext(1048576->2097151) 00000100:00100000:2.0:1746066825.054390:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8131 00002000:00010000:3.0:1746066825.054391:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7b80 00000100:00100000:0.0:1746066825.054392:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985807104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.054396:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2015:x1830882985807360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.054408:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8132 00000100:00100000:3.0:1746066825.054413:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2015:x1830882985807232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.058549:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2015:x1830882985807232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4123us (4245us total) trans 0 rc 643072/643072 00000100:00100000:3.0:1746066825.058562:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8132 00002000:00100000:3.0:1746066825.058575:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800958a7b80 x1830882985807232/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 504/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.058585:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882985807232 ext(1048576->2097151) 00002000:00010000:3.0:1746066825.058591:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7b80 00000100:00100000:2.0:1746066825.060412:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2015:x1830882985807360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6009us (6193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.060420:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8131 00002000:00100000:2.0:1746066825.060427:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff8800958a4700 x1830882985807360/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.060437:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882985807360 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.060441:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4700 00000100:00100000:2.0:1746066825.062546:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985807104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8145us (8368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.062557:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8130 00002000:00100000:2.0:1746066825.062568:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff8800958a4e00 x1830882985807104/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.062577:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882985807104 ext(0->1048575) 00002000:00010000:2.0:1746066825.062582:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4e00 00000100:00100000:0.0:1746066825.070663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.070722:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.070765:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807744 00000100:00100000:2.0:1746066825.070777:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807744 00000100:00100000:1.0:1746066825.070797:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807616 00000100:00100000:1.0:1746066825.070805:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807616 00000100:00100000:1.0:1746066825.070843:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21324 00000100:00100000:1.0:1746066825.070850:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985807616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.070867:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066825.070870:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21325 00000100:00100000:2.0:1746066825.070877:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2016:x1830882985807744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.070919:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589a800/0xf1867c21abfb3907 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b17 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.070928:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.070941:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf57600/0xf1867c21abfb390e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b1e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.070963:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985257856:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066825.070980:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985257984:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.071033:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.071061:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.072147:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985257856:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.072170:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a800/0xf1867c21abfb3907 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b17 expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.072181:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a800/0xf1867c21abfb3907 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b17 expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.072192:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985257984:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.072194:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a800, rc 0) 00010000:00010000:3.0:1746066825.072224:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf57600/0xf1867c21abfb390e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b1e expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.072235:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf57600/0xf1867c21abfb390e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b1e expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.072248:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2016:x1830882985807616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1397us (1524us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066825.072254:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57600, rc 0) 00000100:00100000:1.0:1746066825.072255:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21324 00000100:00100000:3.0:1746066825.072280:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:2016:x1830882985807744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1403us (1625us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066825.072289:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21325 00000100:00100000:0.0:1746066825.074298:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.074404:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985807872 00000100:00100000:3.0:1746066825.074413:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985807872 00000100:00100000:3.0:1746066825.074538:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21326 00000100:00100000:3.0:1746066825.074546:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3859:x1830882985807872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.074563:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.074578:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b25 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.074602:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.074608:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.074610:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.074613:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.074638:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.074648:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 42 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.074657:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985258112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.074745:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.076102:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985258112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.076126:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.076141:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066825.076187:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3859:x1830882985807872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1641us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.076194:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21326 00000100:00100000:0.0:1746066825.076406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.076813:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808000 00000100:00100000:2.0:1746066825.076820:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808000 00002000:00100000:2.0:1746066825.076870:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->3145727) req@ffff8800a5960700 x1830882985808000/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 504/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.076900:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960700 with x1830882985808000 ext(2703360->3145727) 00010000:00010000:2.0:1746066825.076907:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 43 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.076921:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 43 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.076928:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5960700 00000100:00100000:2.0:1746066825.076956:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2320 00000100:00100000:2.0:1746066825.076963:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985808000:12345-192.168.204.16@tcp:4:multiop.0 00000100:00080000:0.0:1746066825.077082:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066825.079149:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985808000:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2181us (2741us total) trans 17179875570 rc 0/0 00000100:00100000:2.0:1746066825.079158:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2320 00002000:00100000:2.0:1746066825.079166:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (2703360->3145727) req@ffff8800a5960700 x1830882985808000/t17179875570(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 504/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.079174:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5960700 with x1830882985808000 ext(2703360->3145727) 00010000:00010000:2.0:1746066825.079182:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.079192:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.079198:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5960700 00000100:00100000:0.0:1746066825.083977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.084032:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808128 00000100:00100000:2.0:1746066825.084041:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808128 00010000:00010000:2.0:1746066825.084078:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.084120:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9846 00000100:00100000:2.0:1746066825.084128:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985808128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.084141:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.084158:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.084168:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.084188:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4c00/0xf1867c21abfb386d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3092480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad1 expref: 45 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.084221:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.084223:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.084230:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.084238:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.084264:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.084275:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985258240:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.084408:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.086086:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985258240:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.086107:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.086145:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985808128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2017us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.086152:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9846 00000100:00100000:0.0:1746066825.087741:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.087791:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808384 00000100:00100000:2.0:1746066825.087797:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808384 00002000:00100000:2.0:1746066825.087835:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5961c00 x1830882985808384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.087843:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961c00 with x1830882985808384 ext(2097152->3145727) 00002000:00010000:2.0:1746066825.087847:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5961c00 00000100:00100000:2.0:1746066825.087877:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8133 00000100:00100000:2.0:1746066825.087920:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985808384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.093446:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985808384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5551us (5697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.093459:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8133 00002000:00100000:2.0:1746066825.093471:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a5961c00 x1830882985808384/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.093481:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961c00 with x1830882985808384 ext(2097152->3145727) 00002000:00010000:2.0:1746066825.093488:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5961c00 00000100:00100000:0.0:1746066825.097240:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.097341:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808512 00000100:00100000:3.0:1746066825.097350:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808512 00000100:00100000:3.0:1746066825.097515:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21327 00000100:00100000:3.0:1746066825.097525:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+33:3859:x1830882985808512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.097543:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.097559:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b2c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.097589:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.097597:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.097599:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.097602:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.097632:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.097644:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 41 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.097657:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985258368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.097752:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.098869:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985258368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.098907:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.098921:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac400, rc 0) 00000100:00100000:3.0:1746066825.098964:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:3859:x1830882985808512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1441us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.098972:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21327 00000100:00100000:0.0:1746066825.099467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.099992:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808640 00000100:00100000:3.0:1746066825.099998:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808640 00002000:00100000:3.0:1746066825.100041:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2301951) req@ffff8800a5963800 x1830882985808640/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.100053:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5963800 with x1830882985808640 ext(2097152->2301951) 00010000:00010000:3.0:1746066825.100060:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 42 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.100072:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 42 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.100079:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5963800 00000100:00100000:3.0:1746066825.100109:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2321 00000100:00100000:3.0:1746066825.100116:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882985808640:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066825.103419:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985808640:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3292us (3942us total) trans 21474842912 rc 0/0 00000100:00100000:3.0:1746066825.103430:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2321 00002000:00100000:3.0:1746066825.103441:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->2301951) req@ffff8800a5963800 x1830882985808640/t21474842912(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.103451:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5963800 with x1830882985808640 ext(2097152->2301951) 00010000:00010000:3.0:1746066825.103461:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.103475:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.103482:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5963800 00000100:00100000:0.0:1746066825.107275:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.107342:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985808768 00000100:00100000:2.0:1746066825.107351:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985808768 00010000:00010000:2.0:1746066825.107389:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.107438:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9847 00000100:00100000:2.0:1746066825.107446:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985808768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.107461:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.107480:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.107492:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.107518:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07e00/0xf1867c21abfb3874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ad8 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.108178:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.108181:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.108188:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.108196:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.108241:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.108254:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985258496:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.108342:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.110862:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985258496:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.111014:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.111094:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985808768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3646us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.111106:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9847 00000100:00100000:0.0:1746066825.116387:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.116442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.116539:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985809280 00000100:00100000:3.0:1746066825.116548:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985809280 00002000:00100000:3.0:1746066825.116596:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800a5962d80 x1830882985809280/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.116606:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962d80 with x1830882985809280 ext(3145728->4194303) 00002000:00010000:3.0:1746066825.116611:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962d80 00000100:00100000:1.0:1746066825.116625:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985809152 00000100:00100000:3.0:1746066825.116630:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8134 00000100:00100000:1.0:1746066825.116630:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985809152 00000100:00100000:3.0:1746066825.116638:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985809280:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066825.116652:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5962300 x1830882985809152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.116661:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962300 with x1830882985809152 ext(2097152->4194303) 00002000:00010000:1.0:1746066825.116664:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5962300 00000100:00100000:1.0:1746066825.116693:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8135 00000100:00100000:1.0:1746066825.116698:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2016:x1830882985809152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.125369:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985809280:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8720us (8980us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.125381:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8134 00002000:00100000:3.0:1746066825.125395:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff8800a5962d80 x1830882985809280/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.125403:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962d80 with x1830882985809280 ext(3145728->4194303) 00002000:00010000:3.0:1746066825.125410:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962d80 00000100:00100000:1.0:1746066825.127814:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2016:x1830882985809152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11105us (11360us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066825.127826:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8135 00002000:00100000:1.0:1746066825.127836:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a5962300 x1830882985809152/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.127845:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962300 with x1830882985809152 ext(2097152->4194303) 00002000:00010000:1.0:1746066825.127850:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5962300 00000100:00100000:0.0:1746066825.138094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.138185:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985809536 00000100:00100000:1.0:1746066825.138196:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985809536 00002000:00100000:1.0:1746066825.138281:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5962a00 x1830882985809536/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.138294:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962a00 with x1830882985809536 ext(4194304->5074943) 00002000:00010000:1.0:1746066825.138300:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962a00 00000100:00100000:1.0:1746066825.138344:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8136 00000100:00100000:1.0:1746066825.138352:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985809536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066825.144068:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.144137:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985809792 00000100:00100000:3.0:1746066825.144146:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985809792 00000100:00100000:3.0:1746066825.144199:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17452 00000100:00100000:3.0:1746066825.144206:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+15:3861:x1830882985809792:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:1.0:1746066825.144242:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985809536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5889us (6153us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066825.144251:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8136 00002000:00100000:1.0:1746066825.144260:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a5962a00 x1830882985809536/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.144268:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5962a00 with x1830882985809536 ext(4194304->5074943) 00002000:00010000:1.0:1746066825.144273:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5962a00 00010000:00010000:3.0:1746066825.144388:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.144403:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faca00/0xf1867c21abfb3923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b33 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.144469:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144479:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144488:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144500:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144505:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144510:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144590:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb3938 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144598:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb3938 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144603:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb3938 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066825.144610:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066825.144666:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144672:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144676:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144681:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144686:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.144689:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144695:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144703:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066825.144706:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.144710:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144715:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb392a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144743:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144748:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144753:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144757:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.144759:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144763:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144769:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f000) 00010000:00010000:3.0:1746066825.144770:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.144772:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144776:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac200/0xf1867c21abfb3931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.144806:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faca00/0xf1867c21abfb3923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b33 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.144816:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb3938 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b33 expref: 17 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.144822:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.144824:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066825.144827:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750400, rc 0) 00000100:00100000:3.0:1746066825.144862:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3861:x1830882985809792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 656us (802us total) trans 8589937987 rc 0/0 00000100:00100000:3.0:1746066825.144867:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17452 00000100:00100000:0.0:1746066825.146774:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.146826:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985809920 00000100:00100000:2.0:1746066825.146833:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985809920 00000100:00100000:2.0:1746066825.146914:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 978 00000100:00100000:2.0:1746066825.146921:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:2015:x1830882985809920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.146931:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.146948:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfb3938 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b33 expref: 17 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.146975:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.146979:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.147071:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:2015:x1830882985809920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 149us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.147076:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 978 00000100:00100000:0.0:1746066825.150963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.151046:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810048 00000100:00100000:3.0:1746066825.151056:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810048 00000100:00100000:3.0:1746066825.151116:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21328 00000100:00100000:3.0:1746066825.151123:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:3861:x1830882985810048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.151142:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.151159:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b3a expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.151188:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.151195:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.151197:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.151200:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.151245:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.151256:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.151269:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985258624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.151375:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.152825:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985258624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.152851:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.152864:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5200, rc 0) 00000100:00100000:3.0:1746066825.152958:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:3861:x1830882985810048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1834us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.153112:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21328 00000100:00100000:0.0:1746066825.155936:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.156082:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810176 00000100:00100000:3.0:1746066825.156097:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810176 00010000:00010000:3.0:1746066825.156140:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.156188:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9848 00000100:00100000:3.0:1746066825.156326:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985810176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.156341:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.156363:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.156375:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.156396:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb391c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b2c expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.156414:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.156416:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.156423:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.156429:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.156466:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.156477:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985258752:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.156581:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.158170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.158228:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985258752:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.158228:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810432 00000100:00100000:1.0:1746066825.158235:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810432 00010000:00010000:3.0:1746066825.158248:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746066825.158265:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4005887) req@ffff8800a5961500 x1830882985810432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.158272:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961500 with x1830882985810432 ext(4001792->4005887) 00002000:00010000:1.0:1746066825.158276:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961500 00000100:00100000:3.0:1746066825.158295:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985810176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1973us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.158299:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8137 00000100:00100000:3.0:1746066825.158303:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9848 00000100:00100000:1.0:1746066825.158304:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2013:x1830882985810432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.158415:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2013:x1830882985810432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.158422:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8137 00002000:00100000:1.0:1746066825.158427:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4005887) req@ffff8800a5961500 x1830882985810432/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.158434:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5961500 with x1830882985810432 ext(4001792->4005887) 00002000:00010000:1.0:1746066825.158437:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5961500 00000100:00100000:0.0:1746066825.161401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.161472:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810560 00000100:00100000:3.0:1746066825.161481:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810560 00000100:00100000:3.0:1746066825.161533:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21329 00000100:00100000:3.0:1746066825.161541:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3861:x1830882985810560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.161557:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.161573:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b41 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.161603:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.161610:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.161612:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.161615:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.161645:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.161657:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.161668:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985258880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.161748:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.163052:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985258880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.163070:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.163081:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4200, rc 0) 00000100:00100000:3.0:1746066825.163113:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3861:x1830882985810560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1573us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.163120:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21329 00000100:00100000:0.0:1746066825.166973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.167031:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810688 00000100:00100000:3.0:1746066825.167039:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810688 00010000:00010000:3.0:1746066825.167066:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.167096:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9849 00000100:00100000:3.0:1746066825.167101:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2015:x1830882985810688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.167112:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.167126:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.167134:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.167149:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3915 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b25 expref: 23 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.167161:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.167162:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.167166:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.167171:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.167192:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.167199:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985259008:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.167285:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.168963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.168979:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985259008:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.169001:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.169043:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985810944 00000100:00100000:3.0:1746066825.169049:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5961180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2015:x1830882985810688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1947us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.169049:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985810944 00000100:00100000:3.0:1746066825.169059:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9849 00002000:00100000:1.0:1746066825.169079:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4222976->4227071) req@ffff88011f760e00 x1830882985810944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.169089:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760e00 with x1830882985810944 ext(4222976->4227071) 00002000:00010000:1.0:1746066825.169094:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f760e00 00000100:00100000:1.0:1746066825.169118:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8138 00000100:00100000:1.0:1746066825.169124:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985810944:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.169984:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2016:x1830882985810944:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 858us (1023us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.169992:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8138 00002000:00100000:1.0:1746066825.169998:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4222976->4227071) req@ffff88011f760e00 x1830882985810944/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.170005:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f760e00 with x1830882985810944 ext(4222976->4227071) 00002000:00010000:1.0:1746066825.170009:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f760e00 00000100:00100000:0.0:1746066825.171987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.172089:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985811200 00000100:00100000:3.0:1746066825.172098:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985811200 00000100:00100000:3.0:1746066825.172227:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6624 00000100:00100000:3.0:1746066825.172236:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+16:3861:x1830882985811200:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066825.172801:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3861:x1830882985811200:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 564us (822us total) trans 8589937988 rc 0/0 00000100:00100000:3.0:1746066825.172813:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6624 00000100:00100000:0.0:1746066825.186998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.187194:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985811456 00000100:00100000:3.0:1746066825.187215:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985811456 00000100:00100000:3.0:1746066825.187290:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17453 00000100:00100000:3.0:1746066825.187298:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:3866:x1830882985811456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.187507:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.187527:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3954 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b48 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.187605:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187618:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187628:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187642:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187647:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187652:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187746:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb3969 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187754:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb3969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187759:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb3969 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:3.0:1746066825.187767:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066825.187837:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187843:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187848:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187854:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187859:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.187863:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187869:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187879:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066825.187931:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.187936:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187941:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac600/0xf1867c21abfb395b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187967:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187971:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187976:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187980:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.187982:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187986:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.187991:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f300) 00010000:00010000:3.0:1746066825.187993:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.187995:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.188000:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfb3962 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.188034:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfb3954 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b48 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.188045:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb3969 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b48 expref: 38 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.188119:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.188124:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066825.188127:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac400, rc 0) 00000100:00100000:3.0:1746066825.188220:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3866:x1830882985811456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 922us (1229us total) trans 8589937989 rc 0/0 00000100:00100000:3.0:1746066825.188227:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17453 00000100:00100000:0.0:1746066825.190016:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.190100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.190134:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985811712 00000100:00100000:3.0:1746066825.190142:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985811712 00000100:00100000:2.0:1746066825.190166:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985811840 00000100:00100000:2.0:1746066825.190176:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985811840 00000100:00100000:3.0:1746066825.190217:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6625 00000100:00100000:3.0:1746066825.190225:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:3866:x1830882985811712:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066825.190249:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 979 00000100:00100000:2.0:1746066825.190257:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882985811840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.190270:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.190292:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac400/0xf1867c21abfb3969 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b48 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.190312:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.190316:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.190365:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882985811840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.190371:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 979 00000100:00100000:3.0:1746066825.190450:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:3866:x1830882985811712:12345-192.168.204.16@tcp:35:cat.0 Request processed in 225us (439us total) trans 8589937990 rc 0/0 00000100:00100000:3.0:1746066825.190457:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6625 00000100:00100000:0.0:1746066825.193567:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.193601:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.193628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.193678:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985811968 00000100:00100000:2.0:1746066825.193679:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812096 00000100:00100000:3.0:1746066825.193680:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812224 00000100:00100000:2.0:1746066825.193686:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812096 00000100:00100000:1.0:1746066825.193686:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985811968 00000100:00100000:3.0:1746066825.193690:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812224 00000100:00100000:2.0:1746066825.193733:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21330 00000100:00100000:2.0:1746066825.193741:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.193755:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066825.193762:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21331 00000100:00100000:3.0:1746066825.193769:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.193771:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3977 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b56 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.193782:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.193795:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71a00/0xf1867c21abfb397e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b5d expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.193815:0:13726:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985259136:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066825.193839:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985259264:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.193845:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21332 00000100:00100000:1.0:1746066825.193851:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985811968:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066825.193877:0:13726:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.193911:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00010000:00010000:1.0:1746066825.193980:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.193989:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589b400/0xf1867c21abfb3985 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b4f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.194013:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985259392:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.194046:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066825.194833:0:13726:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066825 -> 1746066826 00000100:00100000:2.0:1746066825.194849:0:13726:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13726:1830882985259136:192.168.204.16@tcp:106: 00002000:00010000:3.0:1746066825.194862:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066825 -> 1746066826 00010000:00010000:2.0:1746066825.194868:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3977 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b56 expref: 45 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.194877:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985259264:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.194905:0:13726:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3977 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b56 expref: 45 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.194921:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d2000, rc 0) 00010000:00010000:3.0:1746066825.194928:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d71a00/0xf1867c21abfb397e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b5d expref: 46 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.194938:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71a00/0xf1867c21abfb397e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b5d expref: 46 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066825.194945:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1205us (1342us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066825.194947:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:2.0:1746066825.194951:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21330 00000100:00100000:3.0:1746066825.194971:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985812224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1203us (1342us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066825.194978:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21331 00002000:00010000:1.0:1746066825.195235:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime: 1746066825 -> 1746066826 00002000:00010000:1.0:1746066825.195238:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime: 1746066825 -> 1746066826 00002000:00010000:1.0:1746066825.195240:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime: 1746066825 -> 1746066826 00000100:00100000:1.0:1746066825.195249:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985259392:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.195266:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589b400/0xf1867c21abfb3985 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b4f expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.195276:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589b400/0xf1867c21abfb3985 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b4f expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.195295:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589b400, rc 0) 00000100:00100000:1.0:1746066825.195320:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985811968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1469us (1760us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.195325:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21332 00000100:00100000:0.0:1746066825.198441:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.198558:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812352 00000100:00100000:1.0:1746066825.198568:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812352 00000100:00100000:1.0:1746066825.198624:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21333 00000100:00100000:1.0:1746066825.198632:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:3866:x1830882985812352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.198647:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.198660:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b64 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.198692:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.198699:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.198700:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.198704:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.198728:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.198743:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 33 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.198755:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985259520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.198854:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.200789:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.200859:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985259520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.200901:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.200915:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a200, rc 0) 00000100:00100000:1.0:1746066825.200947:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:3866:x1830882985812352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2316us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.200959:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21333 00000100:00100000:0.0:1746066825.201004:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812480 00000100:00100000:0.0:1746066825.201011:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812480 00002000:00100000:0.0:1746066825.201044:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1626111) req@ffff880093c69180 x1830882985812480/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.201073:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69180 with x1830882985812480 ext(1220608->1626111) 00010000:00010000:0.0:1746066825.201079:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 34 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.201089:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 34 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746066825.201095:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c69180 00000100:00100000:0.0:1746066825.201117:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2322 00000100:00100000:0.0:1746066825.201122:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+34:2015:x1830882985812480:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066825.204711:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2015:x1830882985812480:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3580us (3918us total) trans 21474842913 rc 0/0 00000100:00100000:2.0:1746066825.204722:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2322 00002000:00100000:2.0:1746066825.204732:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1626111) req@ffff880093c69180 x1830882985812480/t21474842913(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.204742:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c69180 with x1830882985812480 ext(1220608->1626111) 00010000:00010000:2.0:1746066825.204750:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.204764:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.204770:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c69180 00000100:00100000:0.0:1746066825.207246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.207349:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812608 00000100:00100000:2.0:1746066825.207357:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812608 00010000:00010000:2.0:1746066825.207387:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.207444:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9850 00000100:00100000:2.0:1746066825.207451:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+36:2016:x1830882985812608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.207464:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.207480:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.207491:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.207511:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfb38c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8af4 expref: 36 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.207670:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.207673:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.207679:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.207686:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.207713:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.207725:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985259648:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.208236:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.209857:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985259648:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.209879:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.209969:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985812608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2516us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.209979:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9850 00000100:00100000:0.0:1746066825.211834:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.211967:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812864 00000100:00100000:2.0:1746066825.211975:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812864 00002000:00100000:2.0:1746066825.212018:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd7480 x1830882985812864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.212034:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882985812864 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.212039:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd7480 00000100:00100000:2.0:1746066825.212067:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8139 00000100:00100000:2.0:1746066825.212075:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.219771:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7684us (7931us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.219784:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8139 00002000:00100000:2.0:1746066825.219797:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880095dd7480 x1830882985812864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.219806:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882985812864 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.219814:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd7480 00000100:00100000:0.0:1746066825.229076:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.229440:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985812992 00000100:00100000:1.0:1746066825.229449:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985812992 00000100:00100000:1.0:1746066825.229509:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21334 00000100:00100000:1.0:1746066825.229517:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.229537:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.229662:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3993 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b6b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.229719:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985259776:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066825.229974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.230035:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.230173:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.230289:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985813376 00000100:00100000:3.0:1746066825.230293:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985813376 00000100:00100000:3.0:1746066825.230315:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21335 00000100:00100000:3.0:1746066825.230320:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985813376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.230329:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.230338:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb399a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b79 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.230363:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985259904:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066825.230408:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.230440:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985813248 00000100:00100000:1.0:1746066825.230443:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985813248 00000100:00100000:1.0:1746066825.230471:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17454 00000100:00100000:1.0:1746066825.230476:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:3868:x1830882985813248:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066825.230610:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.230623:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b72 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.230746:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230759:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230769:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230779:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230784:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230788:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230877:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a800/0xf1867c21abfb39b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230903:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a800/0xf1867c21abfb39b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230909:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a800/0xf1867c21abfb39b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066825.230920:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066825.230992:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.230998:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231002:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231007:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066825.231321:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985259904:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066825.231338:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb399a lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b79 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.231348:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb399a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b79 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.231374:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:3.0:1746066825.231408:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985813376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1087us (1372us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066825.231415:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21335 00000100:00100000:3.0:1746066825.231459:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985259776:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066825.231476:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3993 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b6b expref: 45 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.231485:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589bc00/0xf1867c21abfb3993 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b6b expref: 45 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.231491:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589bc00, rc 0) 00000100:00100000:3.0:1746066825.231507:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985812992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1991us (2442us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066825.231516:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21334 00010000:00010000:1.0:1746066825.231739:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.231743:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231749:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231759:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066825.231762:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.231765:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231770:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231794:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231798:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231810:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231814:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589be00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.231816:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231820:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231826:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ea200) 00010000:00010000:1.0:1746066825.231828:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.231830:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.231834:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.232408:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b72 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.232419:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a800/0xf1867c21abfb39b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b72 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.232425:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.232426:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066825.232429:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a800, rc 0) 00000100:00100000:1.0:1746066825.232465:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:3868:x1830882985813248:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1988us (2490us total) trans 8589937991 rc 0/0 00000100:00100000:1.0:1746066825.232472:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17454 00000100:00100000:0.0:1746066825.234102:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.234134:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.234315:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985813632 00000100:00100000:3.0:1746066825.234322:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985813632 00000100:00100000:3.0:1746066825.234362:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6626 00000100:00100000:3.0:1746066825.234368:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:3868:x1830882985813632:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066825.234560:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985813760 00000100:00100000:2.0:1746066825.234564:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985813760 00000100:00100000:2.0:1746066825.234594:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 980 00000100:00100000:2.0:1746066825.234598:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882985813760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.234607:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.234626:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589a800/0xf1867c21abfb39b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b72 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.234653:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.234657:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.234760:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:3868:x1830882985813632:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 391us (661us total) trans 8589937992 rc 0/0 00000100:00100000:3.0:1746066825.234765:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6626 00000100:00100000:2.0:1746066825.234837:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882985813760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 237us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.234843:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 980 00000100:00100000:0.0:1746066825.237567:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.237927:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985813888 00000100:00100000:3.0:1746066825.237934:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985813888 00000100:00100000:3.0:1746066825.237965:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21336 00000100:00100000:3.0:1746066825.237970:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:3866:x1830882985813888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.237983:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.237997:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b80 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.238019:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.238025:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.238026:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.238029:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.238053:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.238061:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 21 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.238070:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985260032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.238154:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.240189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.240234:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985260032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.240258:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.240276:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71800, rc 0) 00000100:00100000:3.0:1746066825.240312:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:3866:x1830882985813888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2341us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.240313:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814016 00000100:00100000:3.0:1746066825.240319:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21336 00000100:00100000:2.0:1746066825.240321:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814016 00002000:00100000:2.0:1746066825.240561:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4227071) req@ffff880095dd4700 x1830882985814016/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.240570:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882985814016 ext(4194304->4227071) 00010000:00010000:2.0:1746066825.240576:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 22 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.240587:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 22 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.240592:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095dd4700 00000100:00100000:2.0:1746066825.240848:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2323 00000100:00100000:2.0:1746066825.240858:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2014:x1830882985814016:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066825.243575:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2014:x1830882985814016:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2711us (3386us total) trans 17179875571 rc 0/0 00000100:00100000:2.0:1746066825.243585:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2323 00002000:00100000:2.0:1746066825.243594:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4227071) req@ffff880095dd4700 x1830882985814016/t17179875571(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.243603:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882985814016 ext(4194304->4227071) 00010000:00010000:2.0:1746066825.243610:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.243622:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.243727:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095dd4700 00000100:00100000:0.0:1746066825.245857:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.245979:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814144 00000100:00100000:2.0:1746066825.245988:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814144 00010000:00010000:2.0:1746066825.246086:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.246121:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9851 00000100:00100000:2.0:1746066825.246128:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985814144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.246141:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.246159:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.246169:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.246197:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4200/0xf1867c21abfb394d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b41 expref: 24 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.246232:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.246235:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.246242:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.246251:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.246294:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.246306:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985260160:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.246385:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.251515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.251586:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985260160:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.251615:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814400 00010000:00010000:2.0:1746066825.251616:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.251623:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814400 00000100:00100000:2.0:1746066825.251681:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985814144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5552us (5829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.251692:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9851 00002000:00100000:3.0:1746066825.251787:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880095dd6a00 x1830882985814400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.251797:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6a00 with x1830882985814400 ext(2097152->3145727) 00002000:00010000:3.0:1746066825.251802:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6a00 00000100:00100000:3.0:1746066825.251821:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8140 00000100:00100000:3.0:1746066825.251827:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985814400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.260142:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985814400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8305us (8626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.260154:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8140 00002000:00100000:3.0:1746066825.260164:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880095dd6a00 x1830882985814400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.260173:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6a00 with x1830882985814400 ext(2097152->3145727) 00002000:00010000:3.0:1746066825.260178:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6a00 00000100:00100000:0.0:1746066825.267675:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.267812:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814528 00000100:00100000:3.0:1746066825.267823:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814528 00000100:00100000:3.0:1746066825.267921:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21337 00000100:00100000:3.0:1746066825.267930:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:3866:x1830882985814528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.267946:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.267960:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b87 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.267986:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.267993:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.267995:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.267998:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.268024:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.268035:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 34 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.268047:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985260288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.268147:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.269547:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985260288:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.269575:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.269597:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:3.0:1746066825.269659:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:3866:x1830882985814528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1729us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.269666:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21337 00000100:00100000:0.0:1746066825.270394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.270464:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814656 00000100:00100000:3.0:1746066825.270471:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814656 00002000:00100000:3.0:1746066825.270507:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4194303) req@ffff880095dd5500 x1830882985814656/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.270516:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5500 with x1830882985814656 ext(4001792->4194303) 00010000:00010000:3.0:1746066825.270522:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.270533:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 35 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.270539:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5500 00000100:00100000:3.0:1746066825.270554:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2324 00000100:00100000:3.0:1746066825.270560:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+35:2016:x1830882985814656:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066825.270968:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.271012:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985814912 00000100:00100000:1.0:1746066825.271021:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985814912 00000100:00100000:1.0:1746066825.271062:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17455 00000100:00100000:1.0:1746066825.271069:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+17:3871:x1830882985814912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.271089:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.271103:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589b600/0xf1867c21abfb39d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b8e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.271168:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271179:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271188:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271199:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271215:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271221:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271298:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271305:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271308:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066825.271315:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066825.271367:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271374:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271378:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271384:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271389:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.271393:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271398:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271408:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066825.271411:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.271414:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271419:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589aa00/0xf1867c21abfb39d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271442:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271448:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271456:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271460:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a589be00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.271462:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271467:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271473:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ead00) 00010000:00010000:1.0:1746066825.271475:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.271477:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271482:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589be00/0xf1867c21abfb39e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.271514:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589b600/0xf1867c21abfb39d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b8e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.271523:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b8e expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.271529:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.271530:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066825.271532:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589ac00, rc 0) 00000100:00100000:1.0:1746066825.271582:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3871:x1830882985814912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 513us (614us total) trans 8589937993 rc 0/0 00000100:00100000:1.0:1746066825.271588:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17455 00000100:00100000:0.0:1746066825.273938:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.273977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.274053:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815168 00000100:00100000:2.0:1746066825.274061:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815168 00000100:00100000:2.0:1746066825.274105:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6627 00000100:00100000:2.0:1746066825.274113:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3871:x1830882985815168:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066825.274117:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2016:x1830882985814656:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3555us (3723us total) trans 21474842914 rc 0/0 00000100:00100000:3.0:1746066825.274127:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2324 00002000:00100000:3.0:1746066825.274138:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4194303) req@ffff880095dd5500 x1830882985814656/t21474842914(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.274153:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5500 with x1830882985814656 ext(4001792->4194303) 00010000:00010000:3.0:1746066825.274162:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 37 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.274176:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 37 pid: 12233 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.274183:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5500 00000100:00100000:3.0:1746066825.274231:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815296 00000100:00100000:3.0:1746066825.274234:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815296 00000100:00100000:3.0:1746066825.274260:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 981 00000100:00100000:3.0:1746066825.274265:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985815296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.274275:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.274300:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a589ac00/0xf1867c21abfb39e7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b8e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274319:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.274323:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.274339:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:2015:x1830882985815296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.274345:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 981 00000100:00100000:1.0:1746066825.274501:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.274599:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815424 00000100:00100000:3.0:1746066825.274606:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815424 00000100:00100000:3.0:1746066825.274647:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21338 00000100:00100000:3.0:1746066825.274654:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:3868:x1830882985815424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.274669:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.274682:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b95 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274703:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.274709:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274715:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066825.274718:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->2723839] (req 2207744->2723839) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274749:0:9592:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274765:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->2723839] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.274774:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066825.274807:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:3868:x1830882985815424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 153us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.274812:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3871:x1830882985815168:12345-192.168.204.16@tcp:35:cat.0 Request processed in 699us (880us total) trans 8589937994 rc 0/0 00000100:00100000:3.0:1746066825.274813:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21338 00000100:00100000:2.0:1746066825.274820:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6627 00000100:00100000:0.0:1746066825.276350:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.276387:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.276414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.276450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.276464:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815552 00000100:00100000:2.0:1746066825.276470:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815552 00000100:00100000:2.0:1746066825.276497:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815680 00000100:00100000:2.0:1746066825.276499:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815680 00000100:00100000:2.0:1746066825.276511:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815936 00000100:00100000:2.0:1746066825.276512:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815936 00000100:00100000:3.0:1746066825.276523:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21339 00000100:00100000:3.0:1746066825.276531:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985815552:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066825.276534:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21340 00000100:00100000:2.0:1746066825.276541:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985815680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.276543:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.276548:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.276555:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8b9c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.276578:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.276580:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.276588:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.276600:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.276611:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac400, rc 0) 00000100:00100000:0.0:1746066825.276624:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21341 00000100:00100000:0.0:1746066825.276632:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2014:x1830882985815936:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066825.276637:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2014:x1830882985815552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 108us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066825.276639:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066825.276643:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21339 00010000:00010000:0.0:1746066825.276646:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb3a03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8baa expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066825.276681:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985260544:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.276719:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ba3 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.276733:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.276734:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066825.276737:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066825.276739:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 24 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.276749:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985815808 00010000:00010000:2.0:1746066825.276750:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 24 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.276757:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d2000, rc 0) 00000100:00100000:1.0:1746066825.276758:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985815808 00000100:00100000:2.0:1746066825.276773:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985815680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 233us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.276778:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21340 00010000:00010000:1.0:1746066825.276790:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.276816:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9852 00000100:00100000:1.0:1746066825.276822:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985815808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.276831:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.276847:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.276858:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.276880:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.276910:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.276916:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.276922:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.277050:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.277062:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 45 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.277078:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985260672:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.277152:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00010000:00010000:2.0:1746066825.279254:0:9590:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880096ecaa00 x1830882985260544) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.279286:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfb3946 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b3a expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.279298:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985260544:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.279326:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb3a03 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8baa expref: 39 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.279343:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1dc00/0xf1867c21abfb3a03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8baa expref: 39 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.279349:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dd1dc00, rc 0) 00000100:00100000:2.0:1746066825.279384:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985815936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2752us (2968us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.279391:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21341 00000100:00100000:1.0:1746066825.279693:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985260672:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.279712:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.279755:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2014:x1830882985815808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2932us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.279765:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9852 00000100:00100000:0.0:1746066825.284770:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.284802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.284839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.285022:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985816192 00000100:00100000:2.0:1746066825.285022:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985816448 00000100:00100000:3.0:1746066825.285030:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985816192 00000100:00100000:2.0:1746066825.285031:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985816448 00002000:00100000:3.0:1746066825.285078:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880096ec9c00 x1830882985816192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.285078:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec9180 x1830882985816448/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.285086:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882985816192 ext(2097152->4194303) 00002000:00100000:2.0:1746066825.285087:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882985816448 ext(3145728->4194303) 00002000:00010000:2.0:1746066825.285092:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00010000:00010000:3.0:1746066825.285096:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.285106:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985816704 00000100:00100000:2.0:1746066825.285108:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985816704 00010000:00010000:3.0:1746066825.285111:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.285117:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec9c00 00002000:00100000:2.0:1746066825.285121:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880096ec9f80 x1830882985816704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066825.285122:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8141 00000100:00100000:1.0:1746066825.285139:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985816448:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.285143:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2325 00000100:00100000:3.0:1746066825.285149:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985816192:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:2.0:1746066825.285232:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9f80 with x1830882985816704 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.285235:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9f80 00000100:00100000:2.0:1746066825.285254:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8142 00000100:00100000:2.0:1746066825.285260:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2014:x1830882985816704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.293253:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985816448:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8108us (8437us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066825.293265:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8141 00002000:00100000:1.0:1746066825.293277:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff880096ec9180 x1830882985816448/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.293286:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882985816448 ext(3145728->4194303) 00002000:00010000:1.0:1746066825.293291:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00000100:00100000:2.0:1746066825.299109:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:2014:x1830882985816704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13837us (14256us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.299126:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8142 00002000:00100000:2.0:1746066825.299140:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880096ec9f80 x1830882985816704/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.299149:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9f80 with x1830882985816704 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.299155:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9f80 00000100:00100000:3.0:1746066825.299457:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985816192:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14307us (14697us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066825.299465:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2325 00002000:00100000:3.0:1746066825.299470:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880096ec9c00 x1830882985816192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.299478:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882985816192 ext(2097152->4194303) 00010000:00010000:3.0:1746066825.299486:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.299498:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.299504:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec9c00 00000100:00100000:0.0:1746066825.306556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.306658:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985816832 00000100:00100000:2.0:1746066825.306669:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985816832 00000100:00100000:2.0:1746066825.306728:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21342 00000100:00100000:2.0:1746066825.306736:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:3866:x1830882985816832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.306755:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.306775:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bb1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.306801:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.306803:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.306810:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.306824:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.306835:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3a00, rc 0) 00000100:00100000:2.0:1746066825.306911:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:3866:x1830882985816832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.306916:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21342 00000100:00100000:0.0:1746066825.307793:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.307915:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985816960 00000100:00100000:1.0:1746066825.307920:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985816960 00010000:00010000:1.0:1746066825.307942:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 47 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.308010:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9853 00000100:00100000:1.0:1746066825.308017:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882985816960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.308027:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.308046:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 47 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.308056:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 47 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.308075:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb39cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b87 expref: 47 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.308099:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.308101:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.308105:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.308112:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.308143:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.308154:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985260800:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.308232:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.309470:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985260800:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.309487:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.309525:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985816960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1507us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.309539:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9853 00000100:00100000:0.0:1746066825.314253:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.314310:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.314424:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985817216 00000100:00100000:2.0:1746066825.314581:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985817472 00000100:00100000:3.0:1746066825.314591:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985817216 00000100:00100000:2.0:1746066825.314591:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985817472 00002000:00100000:3.0:1746066825.314637:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880096ec8e00 x1830882985817216/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.314642:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880096ec8380 x1830882985817472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.314648:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882985817216 ext(2097152->3145727) 00002000:00100000:2.0:1746066825.314648:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8380 with x1830882985817472 ext(3145728->4194303) 00002000:00010000:3.0:1746066825.314654:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00002000:00010000:2.0:1746066825.314654:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec8380 00000100:00100000:2.0:1746066825.314682:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8143 00000100:00100000:3.0:1746066825.314686:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8144 00000100:00100000:2.0:1746066825.314689:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985817472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.314690:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985817216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066825.315522:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.315585:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985817728 00000100:00100000:1.0:1746066825.315590:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985817728 00002000:00100000:1.0:1746066825.315611:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2719744->2723839) req@ffff880096ecb800 x1830882985817728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.315618:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb800 with x1830882985817728 ext(2719744->2723839) 00002000:00010000:1.0:1746066825.315621:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb800 00000100:00100000:1.0:1746066825.315634:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8145 00000100:00100000:1.0:1746066825.315639:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985817728:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.315725:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985817728:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 85us (203us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.315737:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8145 00002000:00100000:1.0:1746066825.315741:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa3:0x0] (2719744->2723839) req@ffff880096ecb800 x1830882985817728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.315747:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb800 with x1830882985817728 ext(2719744->2723839) 00002000:00010000:1.0:1746066825.315750:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb800 00000100:00100000:2.0:1746066825.329154:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882985817472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14452us (14831us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.329168:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8143 00002000:00100000:2.0:1746066825.329180:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3145728->4194303) req@ffff880096ec8380 x1830882985817472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.329189:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8380 with x1830882985817472 ext(3145728->4194303) 00002000:00010000:2.0:1746066825.329195:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec8380 00000100:00100000:3.0:1746066825.329742:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985817216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15049us (15499us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.329749:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8144 00002000:00100000:3.0:1746066825.329754:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff880096ec8e00 x1830882985817216/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.329762:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882985817216 ext(2097152->3145727) 00002000:00010000:3.0:1746066825.329765:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066825.332762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.332926:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985817856 00000100:00100000:1.0:1746066825.332935:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985817856 00000100:00100000:0.0:1746066825.332976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.333910:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985817984 00000100:00100000:2.0:1746066825.333915:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985817984 00000100:00100000:1.0:1746066825.333947:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21343 00000100:00100000:2.0:1746066825.333954:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21344 00000100:00100000:1.0:1746066825.333959:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+37:3871:x1830882985817856:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066825.333960:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985817984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.333979:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.333979:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.334000:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3a1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bbf expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.334000:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bb8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.334032:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.334039:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.334040:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.334044:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.334056:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3a1f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bbf expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.334070:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3a1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bbf expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.334073:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.334084:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.334094:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9600, rc 0) 00000100:00100000:1.0:1746066825.334097:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985260928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.334589:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985817984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 628us (1611us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.334595:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21344 00000100:00100000:1.0:1746066825.334793:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.336612:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.336794:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985260928:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.336824:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.336837:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a800, rc 0) 00000100:00100000:1.0:1746066825.336874:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:3871:x1830882985817856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2919us (4122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.336903:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21343 00000100:00100000:3.0:1746066825.337648:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985818112 00000100:00100000:3.0:1746066825.337656:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985818112 00002000:00100000:3.0:1746066825.337688:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2207744->2723839) req@ffff88012ea35180 x1830882985818112/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.337695:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35180 with x1830882985818112 ext(2207744->2723839) 00010000:00010000:3.0:1746066825.337701:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.337711:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 46 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.337716:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea35180 00000100:00100000:3.0:1746066825.337727:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2326 00000100:00100000:3.0:1746066825.337731:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882985818112:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066825.340875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.341243:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985818368 00000100:00100000:3.0:1746066825.341254:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985818368 00002000:00100000:3.0:1746066825.341302:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880093c6b480 x1830882985818368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.341311:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b480 with x1830882985818368 ext(4194304->5074943) 00002000:00010000:3.0:1746066825.341316:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b480 00000100:00100000:3.0:1746066825.341349:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8146 00000100:00100000:3.0:1746066825.341358:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985818368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.347056:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985818112:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8940us (10067us total) trans 21474842915 rc 0/0 00000100:00100000:3.0:1746066825.347073:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2326 00002000:00100000:3.0:1746066825.347089:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2207744->2723839) req@ffff88012ea35180 x1830882985818112/t21474842915(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.347100:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35180 with x1830882985818112 ext(2207744->2723839) 00010000:00010000:3.0:1746066825.347111:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.347126:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746066825.347134:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea35180 00000100:00100000:3.0:1746066825.347934:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985818368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6576us (7067us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066825.347941:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8146 00002000:00100000:3.0:1746066825.347947:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880093c6b480 x1830882985818368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.347965:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6b480 with x1830882985818368 ext(4194304->5074943) 00002000:00010000:3.0:1746066825.347969:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c6b480 00000100:00100000:0.0:1746066825.350167:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.350300:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985818496 00000100:00100000:1.0:1746066825.350309:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985818496 00010000:00010000:1.0:1746066825.350343:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.350385:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9854 00000100:00100000:1.0:1746066825.350393:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985818496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.350406:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.350427:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.350440:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.350465:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fad200/0xf1867c21abfb39f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [2207744->3145727] (req 2207744->2723839) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b95 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.350496:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.350498:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.350506:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 37 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.350515:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 37 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.350549:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 37 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.350560:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985261056:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066825.350613:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.350639:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.351006:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985818624 00000100:00100000:0.0:1746066825.351010:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985818624 00000100:00100000:0.0:1746066825.351043:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21345 00000100:00100000:0.0:1746066825.351049:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985818624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066825.351063:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.351075:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bc6 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.351146:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.351148:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.351152:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 49 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.351163:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 49 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.351172:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a52400, rc 0) 00000100:00100000:0.0:1746066825.351229:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985818624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 155us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.351236:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21345 00000100:00100000:1.0:1746066825.351586:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882985261056:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.351603:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.351630:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985818496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1238us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.351637:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9854 00000100:00100000:0.0:1746066825.358831:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.358929:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.359029:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819008 00000100:00100000:3.0:1746066825.359037:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819008 00000100:00100000:2.0:1746066825.359047:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819136 00000100:00100000:2.0:1746066825.359052:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819136 00002000:00100000:3.0:1746066825.359081:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012ea37480 x1830882985819008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.359081:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012ea35500 x1830882985819136/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.359091:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985819136 ext(3145728->4194303) 00002000:00100000:3.0:1746066825.359095:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37480 with x1830882985819008 ext(2097152->4194303) 00002000:00010000:2.0:1746066825.359097:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea35500 00002000:00010000:3.0:1746066825.359098:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37480 00000100:00100000:3.0:1746066825.359397:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8147 00000100:00100000:3.0:1746066825.359405:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985819008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.359434:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8148 00000100:00100000:2.0:1746066825.359440:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985819136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066825.376198:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985819136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16746us (17257us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066825.376221:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8148 00002000:00100000:0.0:1746066825.376234:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88012ea35500 x1830882985819136/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.376243:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea35500 with x1830882985819136 ext(3145728->4194303) 00002000:00010000:0.0:1746066825.376249:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea35500 00000100:00100000:3.0:1746066825.377581:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2016:x1830882985819008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18170us (18754us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066825.377591:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8147 00002000:00100000:3.0:1746066825.377600:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff88012ea37480 x1830882985819008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.377611:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea37480 with x1830882985819008 ext(2097152->4194303) 00002000:00010000:3.0:1746066825.377616:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea37480 00000100:00100000:0.0:1746066825.387325:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.387438:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819264 00000100:00100000:1.0:1746066825.387447:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819264 00000100:00100000:1.0:1746066825.387504:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17456 00000100:00100000:1.0:1746066825.387513:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+6:3874:x1830882985819264:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.387541:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.387561:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bcd expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.387629:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387642:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387653:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387665:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387670:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387674:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387740:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387751:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.387758:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.387789:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.387801:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 39 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.387814:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985261184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.388498:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.388619:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.388798:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819520 00000100:00100000:3.0:1746066825.388803:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819520 00002000:00100000:3.0:1746066825.388838:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012ea34700 x1830882985819520/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.388848:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea34700 with x1830882985819520 ext(4194304->5074943) 00002000:00010000:3.0:1746066825.388853:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea34700 00000100:00100000:3.0:1746066825.388867:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8149 00000100:00100000:3.0:1746066825.388873:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985819520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.392424:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985261184:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.392433:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066825.392450:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066825.392951:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819776 00000100:00100000:2.0:1746066825.392958:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819776 00000100:00100000:2.0:1746066825.393010:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6628 00000100:00100000:2.0:1746066825.393018:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:8546:x1830882985819776:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066825.393804:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:8546:x1830882985819776:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 785us (1369us total) trans 8589937995 rc 0/0 00000100:00100000:2.0:1746066825.393811:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6628 00000100:00100000:3.0:1746066825.394580:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985819520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5705us (5961us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066825.394589:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8149 00002000:00100000:3.0:1746066825.394600:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff88012ea34700 x1830882985819520/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.394609:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea34700 with x1830882985819520 ext(4194304->5074943) 00002000:00010000:3.0:1746066825.394614:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea34700 00000100:00100000:0.0:1746066825.395042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.395973:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985819904 00000100:00100000:2.0:1746066825.395982:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985819904 00010000:00010000:2.0:1746066825.396016:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 41 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.396057:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9855 00000100:00100000:2.0:1746066825.396065:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882985819904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.396081:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.396087:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 41 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.396098:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 41 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.396120:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfb3858 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ac3 expref: 41 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.396140:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.396145:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.396154:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.396160:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.396194:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.396239:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882985819904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 175us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.396247:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9855 00010000:00010000:1.0:1746066825.396393:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396401:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066825.396452:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066825.396457:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066825.396474:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396485:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396496:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396502:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396508:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396514:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396519:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.396523:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396530:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396538:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066825.396540:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.396543:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396548:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfb3a34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396564:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396572:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396577:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396580:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7ce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.396583:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396587:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396593:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957eac00) 00010000:00010000:1.0:1746066825.396595:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.396597:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396601:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfb3a3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.396635:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d400/0xf1867c21abfb3a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.396647:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 7 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.396654:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.396655:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066825.396657:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7cc00, rc 0) 00000100:00100000:1.0:1746066825.396681:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+7:3874:x1830882985819264:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 9171us (9368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.396688:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17456 00000100:00100000:0.0:1746066825.399580:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.399593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.399623:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.399660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.399710:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820160 00000100:00100000:1.0:1746066825.399719:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820160 00000100:00100000:0.0:1746066825.399772:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820288 00000100:00100000:0.0:1746066825.399774:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820288 00000100:00100000:3.0:1746066825.399804:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820416 00000100:00100000:3.0:1746066825.399808:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820416 00000100:00100000:3.0:1746066825.399829:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820544 00000100:00100000:3.0:1746066825.399831:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820544 00000100:00100000:3.0:1746066825.399849:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21346 00000100:00100000:3.0:1746066825.399856:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985820416:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066825.399873:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.399907:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8be2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.399931:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.399933:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.399943:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.399958:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.399967:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17457 00010000:00010000:3.0:1746066825.399969:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac600, rc 0) 00000100:00100000:1.0:1746066825.399973:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+19:3876:x1830882985820160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066825.399986:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.399996:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb3a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bd4 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.400007:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985820416:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 153us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.400013:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21346 00000100:00100000:3.0:1746066825.400027:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21347 00000100:00100000:3.0:1746066825.400032:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985820544:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066825.400038:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.400046:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faca00/0xf1867c21abfb3a57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8be9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.400055:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.400056:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.400060:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faca00/0xf1867c21abfb3a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be9 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.400062:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.400069:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faca00/0xf1867c21abfb3a57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be9 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.400072:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.400075:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faca00, rc 0) 00010000:00010000:1.0:1746066825.400081:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066825.400089:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985820544:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 57us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.400092:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21347 00010000:00010000:1.0:1746066825.400093:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400098:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400103:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400366:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400376:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400383:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066825.400391:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066825.400461:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400467:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400471:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400477:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400482:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80ea00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.400486:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400491:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400501:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066825.400504:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.400508:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400512:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ea00/0xf1867c21abfb3a5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400522:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400530:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400534:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400543:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80e400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066825.400546:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.400550:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066825.400550:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21348 00010000:00010000:1.0:1746066825.400556:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800957ea400) 00000100:00100000:0.0:1746066825.400556:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985820288:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.400558:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066825.400560:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.400563:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.400564:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3a65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.400569:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bdb expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.400579:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066825.400580:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066825.400581:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.400585:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.400594:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.400598:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb3a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.400602:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cca00, rc 0) 00010000:00010000:1.0:1746066825.400607:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.400612:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:0.0:1746066825.400617:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985820288:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.400621:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21348 00000100:00100000:0.0:1746066825.400630:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820672 00000100:00100000:0.0:1746066825.400632:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820672 00000100:00100000:2.0:1746066825.400633:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.400644:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985820800 00000100:00100000:0.0:1746066825.400646:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985820800 00000100:00100000:3.0:1746066825.400647:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21349 00000100:00100000:3.0:1746066825.400653:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+15:2015:x1830882985820672:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066825.400656:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21350 00010000:00010000:3.0:1746066825.400659:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066825.400664:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985820800:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066825.400670:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.400678:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bf7 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.400688:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.400689:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.400694:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.400703:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 14 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.400709:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4800, rc 0) 00000100:00100000:2.0:1746066825.400723:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985820800:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066825.400745:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066825.400752:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:1.0:1746066825.400773:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3876:x1830882985820160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 801us (1204us total) trans 8589937996 rc 0/0 00000100:00100000:1.0:1746066825.400779:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17457 00000100:00100000:2.0:1746066825.400782:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21350 00000100:00080000:0.0:1746066825.400790:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746066825.400856:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bf0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.400868:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.400869:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.400874:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.400905:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.400912:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:3.0:1746066825.400931:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+16:2015:x1830882985820672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 278us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.400936:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21349 00000100:00100000:0.0:1746066825.403645:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.403870:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821056 00000100:00100000:1.0:1746066825.403879:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821056 00000100:00100000:1.0:1746066825.403968:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17458 00000100:00100000:1.0:1746066825.403975:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+7:3874:x1830882985821056:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.403995:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.404013:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e800/0xf1867c21abfb3a8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8bfe expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.404236:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.404251:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.404258:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.404265:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.404295:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.404306:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 20 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.404318:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.404641:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.404649:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 8 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.404656:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.404683:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.406987:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.406998:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261440:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.407028:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066825.407466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.407511:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.407580:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821184 00000100:00100000:3.0:1746066825.407587:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821184 00010000:00010000:3.0:1746066825.407619:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 21 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.407641:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821312 00000100:00100000:3.0:1746066825.407644:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821312 00010000:00010000:3.0:1746066825.407654:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 9 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.407677:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9856 00000100:00100000:3.0:1746066825.407684:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:2015:x1830882985821184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066825.407686:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9857 00000100:00100000:2.0:1746066825.407694:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985821312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.407695:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.407700:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 21 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.407703:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.407708:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 21 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.407708:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 9 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.407721:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 9 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.407967:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3a6c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bd4 expref: 21 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.407984:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.407989:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.407997:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.408002:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066825.408025:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfb3a42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bcd expref: 9 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.408037:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:2015:x1830882985821184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 354us (573us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066825.408039:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.408042:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066825.408043:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9856 00010000:00010000:2.0:1746066825.408049:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.408055:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.408103:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.408122:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+8:2015:x1830882985821312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 429us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.408128:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9857 00010000:00010000:1.0:1746066825.408290:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.408297:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066825.408315:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066825.408432:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80e800/0xf1867c21abfb3a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.408446:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.408452:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.408454:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066825.408457:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ee00, rc 0) 00000100:00100000:1.0:1746066825.408492:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985821056:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4517us (4857us total) trans 8589937997 rc 0/0 00000100:00100000:1.0:1746066825.408498:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17458 00000100:00100000:0.0:1746066825.410037:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.410085:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821440 00000100:00100000:1.0:1746066825.410091:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821440 00000100:00100000:1.0:1746066825.410130:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17459 00000100:00100000:1.0:1746066825.410136:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985821440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.410157:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.410170:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb3aa4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c05 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.410260:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.410271:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.410277:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.410302:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.410314:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 9 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.410325:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261568:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.410408:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.411015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.411245:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821568 00000100:00100000:3.0:1746066825.411250:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821568 00000100:00100000:3.0:1746066825.411288:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21351 00000100:00100000:3.0:1746066825.411294:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:3876:x1830882985821568:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.411304:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.411316:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c0c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.411337:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411346:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411357:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411363:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.411365:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.411368:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [921600->1048575] (req 921600->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.411386:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411396:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 44 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.411422:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985261568:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.411440:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066825.411454:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261696:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.411507:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411512:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.411517:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.411532:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.411540:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 15 pid: 12255 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.411544:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261952:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.411551:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.411927:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.412237:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821696 00000100:00100000:3.0:1746066825.412241:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821696 00010000:00010000:3.0:1746066825.412259:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.412290:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9858 00000100:00100000:3.0:1746066825.412296:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985821696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.412306:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.412311:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.412319:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.412338:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3a96 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bfe expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.412351:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.412355:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.412367:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.412373:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.412554:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.412583:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985821696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 286us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.412591:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9858 00010000:00010000:1.0:1746066825.412643:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.412649:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066825.412693:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:1.0:1746066825.412697:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066825.412713:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066825.412739:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfb3aa4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.412750:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.412756:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.412758:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066825.412761:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0a00, rc 0) 00000100:00100000:1.0:1746066825.412798:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985821440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2661us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.412803:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17459 00000100:00100000:0.0:1746066825.414236:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.414265:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.414349:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.414378:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261696:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.414382:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.414388:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.414394:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985261952:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.414418:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [921600->1048575] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.414434:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:1.0:1746066825.414436:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985822208 00000100:00100000:1.0:1746066825.414441:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985822208 00000100:00100000:3.0:1746066825.414462:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3876:x1830882985821568:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3169us (3448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.414467:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21352 00000100:00100000:1.0:1746066825.414476:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985822208:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066825.414478:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21351 00010000:00010000:1.0:1746066825.414489:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066825.414499:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821824 00010000:00010000:1.0:1746066825.414500:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3ab9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c13 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.414501:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821824 00010000:00010000:3.0:1746066825.414513:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 18 pid: 12255 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.414514:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.414521:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3ab9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c13 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.414525:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985821952 00000100:00100000:3.0:1746066825.414527:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985821952 00010000:00010000:1.0:1746066825.414528:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3ab9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c13 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.414534:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 45 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.414536:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1a00, rc 0) 00000100:00100000:3.0:1746066825.414544:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985822080 00000100:00100000:3.0:1746066825.414546:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985822080 00000100:00100000:1.0:1746066825.414551:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:31c94c27-8194-4112-9e80-db222abc766f+17:2016:x1830882985822208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 79us (168us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066825.414552:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.414556:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21352 00000100:00100000:3.0:1746066825.414563:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9859 00000100:00100000:3.0:1746066825.414567:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985821824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066825.414569:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9860 00000100:00100000:1.0:1746066825.414573:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985821952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.414575:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.414578:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.414591:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 16 pid: 12255 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.414591:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 45 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.414599:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 45 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.414610:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 16 pid: 12255 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.414624:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77e00/0xf1867c21abfb36fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d89f8 expref: 16 pid: 12255 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.414633:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.414635:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9861 00000100:00100000:2.0:1746066825.414641:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2013:x1830882985822080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066825.414646:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985821824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (418us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066825.414648:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066825.414652:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9859 00010000:00010000:2.0:1746066825.414654:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.414667:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.414678:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfb3739 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a3e expref: 25 pid: 1893 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.414694:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.414712:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2013:x1830882985822080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.414717:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9861 00010000:00010000:1.0:1746066825.414819:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77a00/0xf1867c21abfb370f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a22 expref: 45 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.414831:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.414832:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.414839:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.414846:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.414871:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.414912:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985262080:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.414975:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.415902:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d802d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985262080:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.415916:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.415947:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985821952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1372us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.415953:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9860 00000100:00100000:0.0:1746066825.416431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.416498:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985822464 00000100:00100000:3.0:1746066825.416504:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985822464 00002000:00100000:3.0:1746066825.416534:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (921600->925695) req@ffff880098fbf800 x1830882985822464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.416544:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882985822464 ext(921600->925695) 00002000:00010000:3.0:1746066825.416548:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf800 00000100:00100000:3.0:1746066825.416561:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8150 00000100:00100000:3.0:1746066825.416565:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985822464:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.416678:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2016:x1830882985822464:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 111us (247us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066825.416683:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8150 00002000:00100000:3.0:1746066825.416689:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (921600->925695) req@ffff880098fbf800 x1830882985822464/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.416696:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882985822464 ext(921600->925695) 00002000:00010000:3.0:1746066825.416699:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf800 00000100:00100000:1.0:1746066825.416813:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.416830:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985822720 00000100:00100000:0.0:1746066825.416833:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985822720 00000100:00100000:0.0:1746066825.416865:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17460 00000100:00100000:0.0:1746066825.416871:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985822720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066825.416898:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.416914:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3ac0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c1a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.417012:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417025:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417035:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417121:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417128:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417133:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417139:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03cc800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066825.417142:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417149:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417160:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066825.417163:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066825.417167:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417171:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc800/0xf1867c21abfb3ac7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.417220:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3ac0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c1a expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.417228:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3ac0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c1a expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.417235:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc200, rc 0) 00000100:00100000:0.0:1746066825.417264:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985822720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 393us (451us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066825.417269:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17460 00000100:00100000:0.0:1746066825.419387:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.419576:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.419676:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985822976 00000100:00100000:2.0:1746066825.419684:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985822976 00000100:00100000:1.0:1746066825.419728:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985823104 00000100:00100000:1.0:1746066825.419733:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985823104 00000100:00100000:2.0:1746066825.419736:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6629 00000100:00100000:2.0:1746066825.419743:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+8:3874:x1830882985822976:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066825.419761:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21353 00000100:00100000:1.0:1746066825.419767:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:3876:x1830882985823104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066825.419778:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.419793:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c21 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.419816:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.419824:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.419830:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.419836:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.419838:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.419842:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1212415] (req 1048576->1212415) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.419871:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.419928:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.419940:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.420011:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+9:3874:x1830882985822976:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 267us (630us total) trans 8589937998 rc 0/0 00000100:00100000:2.0:1746066825.420017:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6629 00010000:00010000:1.0:1746066825.420029:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.420037:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 13 pid: 12233 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.420045:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.420070:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.420077:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 47 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.420083:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.420099:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.425370:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.425390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.425398:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.425411:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.425419:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262464:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.425422:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.425442:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985823360 00000100:00100000:0.0:1746066825.425442:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985823232 00000100:00100000:3.0:1746066825.425447:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985823360 00000100:00100000:0.0:1746066825.425447:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985823232 00010000:00010000:1.0:1746066825.425453:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [1048576->1212415] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.425470:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1e00, rc 0) 00010000:00010000:0.0:1746066825.425471:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 14 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.425472:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 40 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746066825.425488:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985823488 00000100:00100000:0.0:1746066825.425490:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985823488 00010000:00010000:0.0:1746066825.425495:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.425515:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:3876:x1830882985823104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5747us (5937us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.425523:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21353 00000100:00100000:0.0:1746066825.425534:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9862 00000100:00100000:3.0:1746066825.425538:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9863 00000100:00100000:0.0:1746066825.425538:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+14:2015:x1830882985823232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066825.425544:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2014:x1830882985823360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066825.425549:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.425551:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.425565:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.425565:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 14 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.425573:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 14 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.425584:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.425602:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3a7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bdb expref: 14 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.425607:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfb39fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b9c expref: 39 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.425612:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066825.425615:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066825.425631:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:31c94c27-8194-4112-9e80-db222abc766f+13:2015:x1830882985823232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.425632:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985823360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.425637:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9862 00000100:00100000:3.0:1746066825.425640:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9863 00000100:00100000:2.0:1746066825.425647:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9864 00000100:00100000:2.0:1746066825.425654:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985823488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.425662:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.425671:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.425681:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.425694:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfb398c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b64 expref: 48 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.425703:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.425705:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.425710:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.425762:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.425794:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.425805:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985262592:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.425871:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7e05e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.426968:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985262592:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.427006:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.427029:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882985823488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1375us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.427036:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9864 00000100:00100000:1.0:1746066825.429228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.429250:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985823744 00000100:00100000:0.0:1746066825.429258:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985823744 00002000:00100000:0.0:1746066825.429301:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1208320->1212415) req@ffff88012d801c00 x1830882985823744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.429310:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801c00 with x1830882985823744 ext(1208320->1212415) 00002000:00010000:0.0:1746066825.429315:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d801c00 00000100:00100000:0.0:1746066825.429371:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8151 00000100:00100000:0.0:1746066825.429378:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985823744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066825.429527:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985823744:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 148us (306us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066825.429533:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8151 00002000:00100000:0.0:1746066825.429539:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1208320->1212415) req@ffff88012d801c00 x1830882985823744/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.429546:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d801c00 with x1830882985823744 ext(1208320->1212415) 00002000:00010000:0.0:1746066825.429548:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d801c00 00000100:00100000:0.0:1746066825.430977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.431034:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824000 00000100:00100000:2.0:1746066825.431041:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824000 00000100:00100000:2.0:1746066825.431078:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6630 00000100:00100000:2.0:1746066825.431085:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+20:3876:x1830882985824000:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066825.431282:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3876:x1830882985824000:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 197us (308us total) trans 8589937999 rc 0/0 00000100:00100000:2.0:1746066825.431288:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6630 00000100:00100000:0.0:1746066825.467460:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.467558:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824256 00000100:00100000:2.0:1746066825.467568:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824256 00000100:00100000:2.0:1746066825.467675:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17461 00000100:00100000:2.0:1746066825.467684:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:3883:x1830882985824256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.467831:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.467852:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4000/0xf1867c21abfb3ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c28 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.468014:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468027:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468037:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468050:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468054:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468059:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468149:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468161:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468165:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066825.468172:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066825.468338:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468344:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468349:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468354:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468360:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.468363:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468369:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468379:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066825.468382:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.468386:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468390:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfb3adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468510:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468515:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468520:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468525:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8d3600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066825.468527:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468532:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468538:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800971a9300) 00010000:00010000:2.0:1746066825.468540:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066825.468542:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468547:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d3600/0xf1867c21abfb3ae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.468582:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091cb4000/0xf1867c21abfb3ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 43 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.468593:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 42 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.468599:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.468602:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066825.468604:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a400, rc 0) 00000100:00100000:2.0:1746066825.468653:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:3883:x1830882985824256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 970us (1202us total) trans 8589938000 rc 0/0 00000100:00100000:2.0:1746066825.468659:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17461 00000100:00100000:0.0:1746066825.469877:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.469927:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824512 00000100:00100000:2.0:1746066825.469933:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824512 00000100:00100000:2.0:1746066825.469968:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6631 00000100:00100000:2.0:1746066825.469975:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:3883:x1830882985824512:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066825.470115:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:3883:x1830882985824512:12345-192.168.204.16@tcp:35:cat.0 Request processed in 139us (240us total) trans 8589938001 rc 0/0 00000100:00100000:2.0:1746066825.470121:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6631 00000100:00100000:0.0:1746066825.472233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.472313:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.472385:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824640 00000100:00100000:2.0:1746066825.472392:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824640 00000100:00100000:1.0:1746066825.472433:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824768 00000100:00100000:1.0:1746066825.472437:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824768 00000100:00100000:2.0:1746066825.472462:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21354 00000100:00100000:2.0:1746066825.472470:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985824640:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066825.472475:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21355 00000100:00100000:1.0:1746066825.472482:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985824768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.472487:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.472490:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.472503:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3af8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c2f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.472504:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb3aff lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c36 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.472549:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985262848:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.472549:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262720:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.472641:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.472857:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc106c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066825.473971:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime: 1746066825 -> 1746066826 00002000:00010000:2.0:1746066825.473975:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime: 1746066825 -> 1746066826 00002000:00010000:2.0:1746066825.473977:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime: 1746066825 -> 1746066826 00000100:00100000:1.0:1746066825.473986:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985262720:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066825.473988:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882985262848:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.474011:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3af8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c2f expref: 45 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.474011:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb3aff lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c36 expref: 48 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.474021:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3af8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c2f expref: 45 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.474022:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfb3aff lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c36 expref: 48 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.474031:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a600, rc 0) 00000100:00100000:2.0:1746066825.474075:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985824640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1605us (1847us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.474082:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21354 00010000:00010000:1.0:1746066825.474126:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1800, rc 0) 00000100:00100000:1.0:1746066825.474146:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985824768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1664us (1832us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.474151:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21355 00000100:00100000:0.0:1746066825.476317:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.476597:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985824896 00000100:00100000:1.0:1746066825.476605:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985824896 00000100:00100000:1.0:1746066825.476653:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21356 00000100:00100000:1.0:1746066825.476661:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:3883:x1830882985824896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.476859:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.476876:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c3d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.477139:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.477147:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.477148:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.477152:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.477182:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.477193:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 23 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.477216:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985262976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.477560:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.479195:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985262976:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.479227:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.479243:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1c00, rc 0) 00000100:00100000:1.0:1746066825.479279:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:3883:x1830882985824896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2619us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.479287:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21356 00000100:00100000:0.0:1746066825.479539:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.479806:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825024 00000100:00100000:1.0:1746066825.479813:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825024 00002000:00100000:1.0:1746066825.479851:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (921600->1048575) req@ffff880098fbce00 x1830882985825024/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.479861:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882985825024 ext(921600->1048575) 00010000:00010000:1.0:1746066825.479868:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 24 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.479879:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 24 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066825.479921:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbce00 00000100:00100000:1.0:1746066825.479989:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2327 00000100:00100000:1.0:1746066825.479997:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+24:2015:x1830882985825024:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066825.482248:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985825024:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2242us (2700us total) trans 17179875572 rc 0/0 00000100:00100000:1.0:1746066825.482260:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2327 00002000:00100000:1.0:1746066825.482270:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (921600->1048575) req@ffff880098fbce00 x1830882985825024/t17179875572(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.482279:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882985825024 ext(921600->1048575) 00010000:00010000:1.0:1746066825.482289:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.482303:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066825.482309:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbce00 00000100:00100000:0.0:1746066825.484503:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.484727:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825152 00000100:00100000:2.0:1746066825.484735:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825152 00010000:00010000:2.0:1746066825.484770:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.484848:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9865 00000100:00100000:2.0:1746066825.484857:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2015:x1830882985825152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.484870:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.484919:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.484931:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.484955:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfb3ab2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c0c expref: 26 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.484973:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.484975:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.484983:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.485044:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.485079:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.485090:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985263104:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.485475:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.487274:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985263104:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.487297:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.487340:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2015:x1830882985825152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2483us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.487351:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9865 00000100:00100000:2.0:1746066825.489281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.489360:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825408 00000100:00100000:1.0:1746066825.489369:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825408 00002000:00100000:1.0:1746066825.489412:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c68380 x1830882985825408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.489422:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68380 with x1830882985825408 ext(0->1048575) 00002000:00010000:1.0:1746066825.489427:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68380 00000100:00100000:1.0:1746066825.489454:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8152 00000100:00100000:1.0:1746066825.489462:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985825408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.494952:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985825408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5478us (5664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066825.494964:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8152 00002000:00100000:1.0:1746066825.494976:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880093c68380 x1830882985825408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.494986:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c68380 with x1830882985825408 ext(0->1048575) 00002000:00010000:1.0:1746066825.494992:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c68380 00000100:00100000:0.0:1746066825.503320:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.503417:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825536 00000100:00100000:1.0:1746066825.503427:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825536 00000100:00100000:1.0:1746066825.503489:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21357 00000100:00100000:1.0:1746066825.503497:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:3883:x1830882985825536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.503511:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.503525:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c44 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.503550:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.503562:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.503563:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.503566:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.503593:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.503604:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 37 pid: 20361 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.503614:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985263232:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.503709:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.504660:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985263232:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.504693:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.504709:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0000, rc 0) 00000100:00100000:1.0:1746066825.504755:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:3883:x1830882985825536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1259us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.504763:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21357 00000100:00100000:0.0:1746066825.505701:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.505771:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825664 00000100:00100000:1.0:1746066825.505777:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825664 00002000:00100000:1.0:1746066825.505821:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1212415) req@ffff880098fbea00 x1830882985825664/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.505836:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882985825664 ext(1048576->1212415) 00010000:00010000:1.0:1746066825.505844:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 38 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.505856:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 38 pid: 20361 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066825.505862:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbea00 00000100:00100000:1.0:1746066825.505916:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2328 00000100:00100000:1.0:1746066825.505927:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2015:x1830882985825664:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066825.508867:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2015:x1830882985825664:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2933us (3157us total) trans 21474842916 rc 0/0 00000100:00100000:1.0:1746066825.508880:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2328 00002000:00100000:1.0:1746066825.508917:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->1212415) req@ffff880098fbea00 x1830882985825664/t21474842916(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.508927:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882985825664 ext(1048576->1212415) 00010000:00010000:1.0:1746066825.508938:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.508952:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746066825.508959:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066825.511716:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.512131:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825792 00000100:00100000:2.0:1746066825.512219:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825792 00010000:00010000:2.0:1746066825.512256:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.513035:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9866 00000100:00100000:2.0:1746066825.513044:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985825792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.513063:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.513089:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.513102:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.513125:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3ace lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1212415) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c21 expref: 40 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.513152:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.513155:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.513162:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.513170:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.513220:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.513236:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985263360:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.513327:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.515129:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985263360:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066825.515152:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.515195:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2016:x1830882985825792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2152us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.515215:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9866 00000100:00100000:0.0:1746066825.515632:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.516006:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.516137:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985825920 00000100:00100000:2.0:1746066825.516143:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985825920 00000100:00100000:2.0:1746066825.516172:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985826048 00000100:00100000:2.0:1746066825.516174:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985826048 00000100:00100000:2.0:1746066825.516448:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21358 00000100:00100000:2.0:1746066825.516455:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:2014:x1830882985825920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.516473:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.516488:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3b14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c4b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.516509:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.516511:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.516517:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c4b expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.516532:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c4b expref: 26 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.516543:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a600, rc 0) 00000100:00100000:1.0:1746066825.516615:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21359 00000100:00100000:1.0:1746066825.516622:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2014:x1830882985826048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.516629:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.516637:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c52 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.516647:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.516649:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.516653:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.516661:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.516667:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0400, rc 0) 00000100:00100000:2.0:1746066825.516733:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2014:x1830882985825920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 278us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.516739:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21358 00000100:00100000:1.0:1746066825.516767:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985826048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.516774:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21359 00000100:00100000:0.0:1746066825.516848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.516936:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985826304 00000100:00100000:1.0:1746066825.516940:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985826304 00002000:00100000:1.0:1746066825.516967:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbca80 x1830882985826304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.516975:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985826304 ext(1048576->2097151) 00002000:00010000:1.0:1746066825.516979:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:1.0:1746066825.517084:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8153 00000100:00100000:1.0:1746066825.517090:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985826304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066825.522955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.522995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.523028:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985826688 00000100:00100000:3.0:1746066825.523037:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985826688 00000100:00100000:1.0:1746066825.523047:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985826816 00000100:00100000:1.0:1746066825.523052:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985826816 00002000:00100000:3.0:1746066825.523079:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098fbf100 x1830882985826688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.523079:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098924a80 x1830882985826816/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.523089:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985826688 ext(0->1048575) 00002000:00100000:1.0:1746066825.523089:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882985826816 ext(1048576->2097151) 00002000:00010000:3.0:1746066825.523094:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00002000:00010000:1.0:1746066825.523094:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098924a80 00000100:00100000:3.0:1746066825.523137:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8154 00000100:00100000:3.0:1746066825.523144:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985826816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.523189:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8155 00000100:00100000:1.0:1746066825.523195:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985826688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.523912:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985826304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6820us (7061us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066825.523920:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8153 00002000:00100000:1.0:1746066825.523926:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098fbca80 x1830882985826304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.523933:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882985826304 ext(1048576->2097151) 00002000:00010000:1.0:1746066825.523936:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:1.0:1746066825.530359:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985826688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7151us (7403us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066825.530370:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8155 00002000:00100000:1.0:1746066825.530381:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7f:0x0] (0->1048575) req@ffff880098fbf100 x1830882985826688/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.530390:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882985826688 ext(0->1048575) 00002000:00010000:1.0:1746066825.530396:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:3.0:1746066825.531933:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985826816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8779us (8926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.531945:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8154 00002000:00100000:3.0:1746066825.531955:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff880098924a80 x1830882985826816/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.531965:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882985826816 ext(1048576->2097151) 00002000:00010000:3.0:1746066825.531971:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098924a80 00000100:00100000:0.0:1746066825.534066:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.534212:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827072 00000100:00100000:3.0:1746066825.534222:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827072 00002000:00100000:3.0:1746066825.534268:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098925c00 x1830882985827072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.534278:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882985827072 ext(2097152->3145727) 00002000:00010000:3.0:1746066825.534284:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925c00 00000100:00100000:3.0:1746066825.534318:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8156 00000100:00100000:3.0:1746066825.534327:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985827072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.540485:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985827072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6145us (6415us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.540499:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8156 00002000:00100000:3.0:1746066825.540512:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->3145727) req@ffff880098925c00 x1830882985827072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.540521:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882985827072 ext(2097152->3145727) 00002000:00010000:3.0:1746066825.540528:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925c00 00000100:00100000:0.0:1746066825.540848:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.541224:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827328 00000100:00100000:3.0:1746066825.541231:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827328 00000100:00100000:3.0:1746066825.542005:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17462 00000100:00100000:3.0:1746066825.542016:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:3888:x1830882985827328:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.542040:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.542057:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c59 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.542164:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.542180:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.542188:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.542195:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.542234:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.542246:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 44 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.542257:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.542523:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.542532:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 8 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.542540:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263616:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.543064:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.544473:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.544564:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.544935:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263616:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.544957:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066825.545039:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827456 00000100:00100000:2.0:1746066825.545045:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827456 00010000:00010000:2.0:1746066825.545073:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 45 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.545108:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9867 00000100:00100000:2.0:1746066825.545114:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985827456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.545125:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.545130:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 45 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.545139:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 45 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.545162:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e0a400/0xf1867c21abfb3aea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c28 expref: 45 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.545188:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.545193:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.545212:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.545218:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.545833:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985827456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 717us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.545841:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9867 00000100:00100000:2.0:1746066825.546215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.546254:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827584 00000100:00100000:3.0:1746066825.546259:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827584 00010000:00010000:3.0:1746066825.546278:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 9 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.546328:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9868 00000100:00100000:3.0:1746066825.546334:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+9:2016:x1830882985827584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.546342:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.546346:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 9 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.546355:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 9 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.546369:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfb3aab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c05 expref: 9 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.546384:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.546387:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.546394:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.546401:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.546422:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066825.546435:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.546441:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066825.546461:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066825.546650:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 45 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.546663:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.546669:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.546671:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066825.546673:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5e00, rc 0) 00000100:00100000:3.0:1746066825.546712:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:3888:x1830882985827328:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4699us (5865us total) trans 8589938002 rc 0/0 00000100:00100000:3.0:1746066825.546719:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17462 00000100:00100000:3.0:1746066825.546758:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+8:2016:x1830882985827584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 424us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.546763:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9868 00000100:00100000:0.0:1746066825.632785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.632920:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827712 00000100:00100000:3.0:1746066825.632930:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827712 00000100:00100000:3.0:1746066825.632977:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17463 00000100:00100000:3.0:1746066825.632985:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+8:3891:x1830882985827712:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066825.633009:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.633026:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5600/0xf1867c21abfb3b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c60 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.633092:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633104:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633114:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633127:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633132:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633138:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633213:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633223:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 43 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.633230:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.633259:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 43 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.633271:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 43 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.633289:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263744:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.633391:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.635356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.635551:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263744:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.635571:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066825.635648:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827840 00000100:00100000:2.0:1746066825.635655:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827840 00010000:00010000:2.0:1746066825.635684:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 44 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.635718:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9869 00000100:00100000:2.0:1746066825.635725:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985827840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.635737:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.635742:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 44 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.635753:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 44 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.635774:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5e00/0xf1867c21abfb3b29 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c59 expref: 44 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.635797:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.635801:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.635809:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.635815:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.635844:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.635877:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882985827840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.635903:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9869 00010000:00010000:3.0:1746066825.635905:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.635912:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066825.635962:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:3.0:1746066825.635967:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066825.635987:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.635997:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636007:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636013:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636019:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636024:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636034:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe5000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.636038:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636044:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636052:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066825.636055:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.636081:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636086:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfb3b3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636098:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636102:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636108:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636112:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe4200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066825.636114:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636118:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636123:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ce0f700) 00010000:00010000:3.0:1746066825.636125:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066825.636127:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636131:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfb3b45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.636157:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5600/0xf1867c21abfb3b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.636168:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.636173:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.636175:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066825.636177:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5800, rc 0) 00000100:00100000:3.0:1746066825.636346:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3891:x1830882985827712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3360us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.636353:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17463 00000100:00100000:0.0:1746066825.638842:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.638967:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985827968 00000100:00100000:1.0:1746066825.638976:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985827968 00000100:00100000:0.0:1746066825.639018:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.639033:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828096 00000100:00100000:1.0:1746066825.639036:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828096 00000100:00100000:1.0:1746066825.639053:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21360 00000100:00100000:1.0:1746066825.639060:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+15:2014:x1830882985827968:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746066825.639060:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21361 00000100:00100000:0.0:1746066825.639065:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985828096:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.639076:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.639076:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.639091:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3b5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c67 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.639091:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c6e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.639111:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.639111:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.639113:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.639113:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.639121:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3b5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c67 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.639121:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.639133:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3b5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c67 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.639133:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.639143:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1a00, rc 0) 00010000:00010000:0.0:1746066825.639143:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cd200, rc 0) 00000100:00100000:1.0:1746066825.639178:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+16:2014:x1830882985827968:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 119us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.639184:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21360 00000100:00100000:0.0:1746066825.639245:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985828096:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 179us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.639249:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21361 00000100:00100000:0.0:1746066825.640685:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.640802:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828352 00000100:00100000:3.0:1746066825.640808:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828352 00000100:00100000:3.0:1746066825.640853:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17464 00000100:00100000:3.0:1746066825.640859:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+9:3891:x1830882985828352:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066825.640874:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.640934:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5400/0xf1867c21abfb3b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c75 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.641038:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.641053:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.641061:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.641089:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.641100:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.641120:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263872:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.641265:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.642864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.642981:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985263872:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.642997:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066825.643052:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828480 00000100:00100000:2.0:1746066825.643057:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828480 00010000:00010000:2.0:1746066825.643082:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 11 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.643115:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9870 00000100:00100000:2.0:1746066825.643121:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+11:2014:x1830882985828480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.643133:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.643139:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 11 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.643149:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 11 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.643166:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfb3b4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c60 expref: 11 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.643186:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.643190:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.643210:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.643216:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066825.643239:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.643269:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31c94c27-8194-4112-9e80-db222abc766f+10:2014:x1830882985828480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.643274:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9870 00010000:00010000:3.0:1746066825.643305:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.643312:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066825.643327:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:1.0:1746066825.643334:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.643397:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828608 00000100:00100000:1.0:1746066825.643400:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828608 00000100:00100000:1.0:1746066825.643418:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21362 00000100:00100000:1.0:1746066825.643422:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:3888:x1830882985828608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066825.643424:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5400/0xf1867c21abfb3b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.643432:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.643437:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.643442:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c7c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.643443:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066825.643446:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066825.643448:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4e00, rc 0) 00010000:00010000:1.0:1746066825.643462:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.643470:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.643472:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985828352:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2613us (2790us total) trans 8589938003 rc 0/0 00010000:00010000:1.0:1746066825.643476:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.643478:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17464 00010000:00010000:1.0:1746066825.643481:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.643483:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.643486:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 49 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.643504:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.643514:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 39 pid: 20361 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.643524:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264000:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.643791:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.643799:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 13 pid: 9590 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.643807:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264128:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.643828:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.643835:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.643842:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.643852:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.645856:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.645986:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828736 00000100:00100000:3.0:1746066825.645994:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828736 00000100:00100000:3.0:1746066825.646034:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17465 00000100:00100000:3.0:1746066825.646040:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985828736:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066825.646062:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.646076:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfb3b7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c83 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.646164:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.646177:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.646183:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066825.646191:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264000:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.646219:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264128:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.646221:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.646227:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.646231:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 11 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.646241:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985264384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.646254:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 49 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.646268:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1e00, rc 0) 00000100:00100000:1.0:1746066825.646313:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:3888:x1830882985828608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2889us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.646320:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21362 00000100:00100000:3.0:1746066825.647441:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.647597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.647601:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.647622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.647624:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828992 00000100:00100000:0.0:1746066825.647631:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828992 00000100:00100000:2.0:1746066825.647642:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985828864 00000100:00100000:2.0:1746066825.647646:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985828864 00000100:00100000:1.0:1746066825.647649:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066825.647656:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.647665:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746066825.647677:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985829376 00000100:00100000:0.0:1746066825.647680:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985829376 00000100:00100000:1.0:1746066825.647686:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985829248 00000100:00100000:2.0:1746066825.647688:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9871 00000100:00100000:1.0:1746066825.647690:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985829248 00010000:00010000:0.0:1746066825.647690:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.647695:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985828992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066825.647705:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9872 00010000:00010000:2.0:1746066825.647706:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066825.647712:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+14:2013:x1830882985828864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066825.647716:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17466 00000100:00100000:1.0:1746066825.647722:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+21:3893:x1830882985829248:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.647724:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.647728:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.647734:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.647737:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.647749:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c8a expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.647752:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfb3b1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c52 expref: 40 pid: 20361 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.647755:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.647764:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.647772:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066825.647784:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3b53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c6e expref: 14 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.647806:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.647811:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2013:x1830882985828992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066825.647827:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066825.647833:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985828864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066825.647837:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066825.647840:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9872 00010000:00010000:1.0:1746066825.647842:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.647853:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066825.647854:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9873 00000100:00100000:0.0:1746066825.647858:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985829376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.647861:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.647864:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066825.647870:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.647878:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.647917:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0000/0xf1867c21abfb3b0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c44 expref: 49 pid: 20361 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.647925:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.647927:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.647932:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.647940:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.647968:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066825.647978:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985264512:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066825.648021:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.648215:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9871 00000100:00100000:1.0:1746066825.650371:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.650372:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985264384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.650377:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985264512:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066825.650389:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066825.650393:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066825.650420:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985829376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2560us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.650428:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9873 00000100:00100000:0.0:1746066825.650447:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985829504 00000100:00100000:0.0:1746066825.650451:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985829504 00010000:00010000:0.0:1746066825.650464:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 12 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066825.650494:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9874 00000100:00100000:0.0:1746066825.650499:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2015:x1830882985829504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066825.650508:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066825.650512:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 12 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.650521:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 12 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.650541:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfb3b68 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c75 expref: 12 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.650553:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066825.650556:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.650649:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.650657:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066825.650664:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.650669:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.650686:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066825.650710:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.650717:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066825.650755:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+11:2015:x1830882985829504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 255us (389us total) trans 0 rc 0/0 00000004:00200000:3.0:1746066825.650758:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000100:00100000:0.0:1746066825.650761:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9874 00000004:00200000:3.0:1746066825.650762:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066825.650774:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066825.650799:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfb3b7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.650813:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.650820:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.650831:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4a00, rc 0) 00000100:00100000:3.0:1746066825.650983:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985828736:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4942us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.650990:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17465 00000100:00100000:2.0:1746066825.651404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.651442:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985829760 00000100:00100000:3.0:1746066825.651446:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985829760 00002000:00100000:3.0:1746066825.651467:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2060287) req@ffff880093c6bb80 x1830882985829760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.651476:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6bb80 with x1830882985829760 ext(2056192->2060287) 00002000:00010000:3.0:1746066825.651479:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6bb80 00000100:00100000:3.0:1746066825.651492:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8157 00000100:00100000:3.0:1746066825.651497:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985829760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.651587:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985829760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 88us (183us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066825.651592:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8157 00002000:00100000:3.0:1746066825.651597:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2060287) req@ffff880093c6bb80 x1830882985829760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.651603:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6bb80 with x1830882985829760 ext(2056192->2060287) 00002000:00010000:3.0:1746066825.651606:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6bb80 00000100:00100000:0.0:1746066825.652642:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.652718:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.652784:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830016 00000100:00100000:1.0:1746066825.652789:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830016 00000100:00100000:1.0:1746066825.652824:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21363 00000100:00100000:1.0:1746066825.652830:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985830016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066825.652839:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.652850:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfb3b99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c91 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.652905:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264640:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066825.652952:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.653037:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985829888 00000100:00100000:2.0:1746066825.653041:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985829888 00010000:00010000:2.0:1746066825.653057:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.653075:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9875 00000100:00100000:2.0:1746066825.653081:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+10:2015:x1830882985829888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.653089:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.653093:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066825.653513:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.653557:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830144 00010000:00010000:2.0:1746066825.653560:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.653561:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830144 00010000:00010000:2.0:1746066825.653576:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfb3b84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c83 expref: 10 pid: 17253 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.653588:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000100:00100000:3.0:1746066825.653589:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21364 00010000:00010000:2.0:1746066825.653591:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:3.0:1746066825.653595:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+48:3888:x1830882985830144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.653599:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.653603:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.653605:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:3.0:1746066825.653611:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c98 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.653628:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.653633:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066825.653640:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.653647:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.653652:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.653654:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.653657:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 6/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.653659:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.653666:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:2.0:1746066825.653667:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2015:x1830882985829888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 585us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.653673:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9875 00010000:00010000:3.0:1746066825.653675:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 38 pid: 13726 timeout: 0 lvb_type: 1 00000004:00200000:0.0:1746066825.653681:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:3.0:1746066825.653685:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 38 pid: 13726 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.653693:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985264768:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.653721:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.653728:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 14 pid: 9590 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.653736:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985264896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.653759:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.653766:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.653772:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985265024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.653790:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746066825.654214:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfb3b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 24 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.654228:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 23 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.654234:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066825.654236:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066825.654238:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ee00, rc 0) 00000100:00100000:1.0:1746066825.654759:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985264640:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.654779:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfb3b99 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c91 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066825.654786:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3893:x1830882985829248:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7063us (7184us total) trans 8589938004 rc 0/0 00010000:00010000:1.0:1746066825.654788:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfb3b99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c91 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066825.654793:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17466 00010000:00010000:1.0:1746066825.654811:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e200, rc 0) 00000100:00100000:1.0:1746066825.654834:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985830016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2004us (2116us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.654838:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21363 00000100:00100000:3.0:1746066825.655748:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985264768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.655757:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985264896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.656780:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.656817:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985265024:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.656843:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830272 00000100:00100000:2.0:1746066825.656849:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830272 00010000:00010000:3.0:1746066825.656851:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [1048576->1925119] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.656866:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00010000:00010000:2.0:1746066825.656870:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066825.656935:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9876 00000100:00100000:2.0:1746066825.656942:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+13:2013:x1830882985830272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066825.656948:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+49:3888:x1830882985830144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3351us (3433us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066825.656952:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066825.656955:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21364 00010000:00010000:2.0:1746066825.656966:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.656974:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.656989:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfb3a49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be2 expref: 13 pid: 9590 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.657000:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.657021:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985830272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.657027:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9876 00000100:00100000:0.0:1746066825.658178:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.658225:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.658249:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830400 00000100:00100000:2.0:1746066825.658253:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830400 00010000:00010000:2.0:1746066825.658269:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 39 pid: 13726 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746066825.658292:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.658296:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830528 00000100:00100000:2.0:1746066825.658298:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830528 00010000:00010000:2.0:1746066825.658309:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066825.658310:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830656 00000100:00100000:0.0:1746066825.658313:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830656 00000100:00100000:1.0:1746066825.658318:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9877 00000100:00100000:1.0:1746066825.658326:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2016:x1830882985830400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066825.658330:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9878 00010000:00010000:1.0:1746066825.658333:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066825.658334:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17467 00000100:00100000:2.0:1746066825.658335:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985830528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066825.658339:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+9:3891:x1830882985830656:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066825.658342:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.658344:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 39 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.658349:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.658352:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.658353:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 39 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746066825.658361:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3bae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8c9f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.658370:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.658383:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfb387b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8adf expref: 49 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.658392:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066825.658395:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3bae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c9f expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.658403:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3bae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c9f expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.658412:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985830528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066825.658412:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066825.658414:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066825.658416:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9878 00010000:00010000:0.0:1746066825.658416:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc200, rc 0) 00000100:00100000:0.0:1746066825.658431:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985830656:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.658435:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17467 00010000:00010000:1.0:1746066825.658477:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abfb38f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b02 expref: 39 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.658491:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.658492:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.658497:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.658504:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.658526:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.658536:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985265152:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.658601:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d9123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.660504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.660580:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985830784 00000100:00100000:3.0:1746066825.660595:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985830784 00000100:00100000:3.0:1746066825.660637:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21365 00000100:00100000:3.0:1746066825.660643:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2013:x1830882985830784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.660653:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.660664:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3bb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ca6 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.660697:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985265280:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066825.660753:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.661467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.661489:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985265152:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066825.661490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066825.661505:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.661511:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831040 00000100:00100000:3.0:1746066825.661515:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831040 00000100:00100000:1.0:1746066825.661526:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985830400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3202us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.661533:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9877 00000100:00100000:0.0:1746066825.661559:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17468 00000100:00100000:0.0:1746066825.661566:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985831040:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066825.661571:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985265280:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066825.661575:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066825.661576:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831168 00000100:00100000:1.0:1746066825.661579:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831168 00010000:00010000:0.0:1746066825.661584:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb3bbc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cad expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.661587:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3bb5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ca6 expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.661593:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21366 00010000:00010000:3.0:1746066825.661597:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3bb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ca6 expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.661597:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2014:x1830882985831168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.661602:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.661605:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00010000:00010000:1.0:1746066825.661608:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3bc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cb4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.661637:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985830784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 994us (1136us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066825.661642:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21365 00010000:00010000:0.0:1746066825.661654:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.661667:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.661673:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 4/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066825.661690:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.661693:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265408:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066825.661700:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 22 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066825.661708:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009586b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985265536:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.661724:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.661728:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.662912:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.662927:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009586b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882985265536:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.662943:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066825.663005:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831296 00000100:00100000:1.0:1746066825.663012:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831296 00010000:00010000:1.0:1746066825.663043:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 23 pid: 10125 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.663067:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9879 00000100:00100000:1.0:1746066825.663073:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:2013:x1830882985831296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.663084:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.663089:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 23 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.663099:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 23 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.663118:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfb3b92 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c8a expref: 23 pid: 10125 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.663131:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066825.663136:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.663149:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.663155:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066825.663173:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066825.663179:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663186:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663211:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663217:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663222:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663228:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03cca00 already unused, calling callback (ffffffffa0f1c690) 00000100:00100000:1.0:1746066825.663228:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:2013:x1830882985831296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 154us (351us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066825.663231:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066825.663235:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9879 00010000:00010000:2.0:1746066825.663237:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663247:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.663250:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066825.663253:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.663257:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00002000:00010000:1.0:1746066825.663275:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime: 1746066825 -> 1746066826 00002000:00010000:1.0:1746066825.663278:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime: 1746066825 -> 1746066826 00002000:00010000:1.0:1746066825.663280:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime: 1746066825 -> 1746066826 00010000:00010000:2.0:1746066825.663281:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb3bbc lrc: 1/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cad expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.663287:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cce00/0xf1867c21abfb3bbc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cad expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.663294:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:1.0:1746066825.663295:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265408:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.663316:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3bc3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cb4 expref: 39 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066825.663320:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985831040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1754us (1852us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066825.663326:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e400/0xf1867c21abfb3bc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cb4 expref: 39 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066825.663327:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17468 00010000:00010000:1.0:1746066825.663334:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e400, rc 0) 00000100:00100000:1.0:1746066825.663357:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:2014:x1830882985831168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1759us (1865us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.663363:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21366 00000100:00100000:0.0:1746066825.666742:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.666954:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831552 00000100:00100000:2.0:1746066825.666963:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831552 00000100:00100000:2.0:1746066825.667002:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6632 00000100:00100000:2.0:1746066825.667010:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+10:3891:x1830882985831552:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066825.667251:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.667270:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:31c94c27-8194-4112-9e80-db222abc766f+11:3891:x1830882985831552:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 260us (535us total) trans 8589938005 rc 0/0 00000100:00100000:2.0:1746066825.667277:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6632 00000100:00100000:0.0:1746066825.667538:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831680 00000100:00100000:0.0:1746066825.667545:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831680 00000100:00100000:2.0:1746066825.667591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.667603:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21367 00000100:00100000:0.0:1746066825.667610:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+38:3896:x1830882985831680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066825.667624:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066825.667689:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985831936 00010000:00010000:0.0:1746066825.667689:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cbb expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.667693:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985831936 00010000:00010000:0.0:1746066825.667713:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.667720:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066825.667721:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066825.667725:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.667750:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.667760:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746066825.667773:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265664:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.667825:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988543c0 going to sleep for 11 seconds 00002000:00100000:3.0:1746066825.667866:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1921024->1925119) req@ffff880093c6a300 x1830882985831936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.667876:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6a300 with x1830882985831936 ext(1921024->1925119) 00002000:00010000:3.0:1746066825.667880:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6a300 00000100:00100000:3.0:1746066825.667918:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8158 00000100:00100000:3.0:1746066825.667924:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985831936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.668041:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882985831936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066825.668047:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8158 00002000:00100000:3.0:1746066825.668052:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1921024->1925119) req@ffff880093c6a300 x1830882985831936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.668058:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6a300 with x1830882985831936 ext(1921024->1925119) 00002000:00010000:3.0:1746066825.668061:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c6a300 00000100:00100000:2.0:1746066825.668799:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.668824:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.668839:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cd200, rc 0) 00000100:00100000:2.0:1746066825.668873:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:3896:x1830882985831680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1265us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.668879:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21367 00000100:00100000:2.0:1746066825.669318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.669389:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832064 00000100:00100000:0.0:1746066825.669395:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832064 00002000:00100000:0.0:1746066825.669423:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2097151) req@ffff880093c6aa00 x1830882985832064/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.669432:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6aa00 with x1830882985832064 ext(2056192->2097151) 00010000:00010000:0.0:1746066825.669439:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746066825.669450:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 48 pid: 9590 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746066825.669456:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c6aa00 00000100:00100000:0.0:1746066825.669485:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2329 00000100:00100000:0.0:1746066825.669491:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985832064:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066825.672408:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985832064:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2907us (3080us total) trans 21474842917 rc 0/0 00000100:00100000:3.0:1746066825.672416:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.672420:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2329 00002000:00100000:2.0:1746066825.672432:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (2056192->2097151) req@ffff880093c6aa00 x1830882985832064/t21474842917(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.672440:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c6aa00 with x1830882985832064 ext(2056192->2097151) 00010000:00010000:2.0:1746066825.672449:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.672459:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832320 00010000:00010000:2.0:1746066825.672461:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.672465:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832320 00002000:00010000:2.0:1746066825.672467:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c6aa00 00000100:00100000:3.0:1746066825.672499:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6633 00000100:00100000:3.0:1746066825.672505:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:3888:x1830882985832320:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066825.672652:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:3888:x1830882985832320:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 146us (236us total) trans 8589938006 rc 0/0 00000100:00100000:3.0:1746066825.672657:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6633 00000100:00100000:0.0:1746066825.677414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.677502:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832448 00000100:00100000:1.0:1746066825.677513:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832448 00010000:00010000:1.0:1746066825.677548:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.677584:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9880 00000100:00100000:1.0:1746066825.677590:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985832448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.677601:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.677616:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.677628:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.677645:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfb3b76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c7c expref: 50 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.677657:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.677659:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.677665:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.677671:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.677697:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.677707:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985265792:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.677796:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00010000:00010000:3.0:1746066825.680150:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066825.680243:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882985265792:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.680265:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.680301:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882985832448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2710us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.680312:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9880 00000100:00100000:0.0:1746066825.681180:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.681227:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832576 00000100:00100000:2.0:1746066825.681235:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832576 00000100:00100000:2.0:1746066825.681276:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21368 00000100:00100000:2.0:1746066825.681283:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:3893:x1830882985832576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.681301:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.681315:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cc2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681343:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681351:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.681358:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.681365:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681376:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.681377:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.681381:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 7/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681405:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681414:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 48 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.681425:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265920:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.681490:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.681495:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066825.681500:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266048:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.681516:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 11 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.681521:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 11 pid: 13726 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746066825.681576:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.681605:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.681612:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 40 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.681619:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.681641:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.682734:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.682785:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832832 00000100:00100000:2.0:1746066825.682791:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832832 00002000:00100000:2.0:1746066825.682831:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009586b480 x1830882985832832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.682841:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586b480 with x1830882985832832 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.682845:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586b480 00000100:00100000:2.0:1746066825.682867:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8159 00000100:00100000:2.0:1746066825.682873:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2013:x1830882985832832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.683213:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985265920:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.683224:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066825.683225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.683232:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266176:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.683306:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985832960 00000100:00100000:1.0:1746066825.683313:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985832960 00010000:00010000:1.0:1746066825.683341:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 49 pid: 9590 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746066825.683375:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9881 00000100:00100000:1.0:1746066825.683381:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882985832960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.683392:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.683408:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 49 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.683511:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 49 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.683530:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d3a00/0xf1867c21abfb3a11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb1 expref: 49 pid: 9590 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.683544:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.683700:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882985832960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 318us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.683708:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9881 00000100:00100000:0.0:1746066825.687646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.687696:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882985266304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.687699:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833216 00000100:00100000:1.0:1746066825.687706:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833216 00010000:00010000:1.0:1746066825.687732:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.687743:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.687759:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cca00, rc 0) 00000100:00100000:1.0:1746066825.687779:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9882 00000100:00100000:0.0:1746066825.687779:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.687786:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882985833216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.687799:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066825.687815:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:3893:x1830882985832576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6531us (6635us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066825.687815:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.687823:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.687825:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21368 00000100:00100000:2.0:1746066825.687830:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833088 00000100:00100000:2.0:1746066825.687835:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833088 00010000:00010000:1.0:1746066825.687840:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a52400/0xf1867c21abfb3a26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bc6 expref: 48 pid: 12233 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.687850:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 12 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746066825.687853:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.687868:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9883 00000100:00100000:2.0:1746066825.687873:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+12:2013:x1830882985833088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.687879:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066825.687901:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882985833216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.687908:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9882 00010000:00010000:2.0:1746066825.687916:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 12 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.687922:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 12 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.687931:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4800/0xf1867c21abfb3a81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf7 expref: 12 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746066825.687939:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066825.687956:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2013:x1830882985833088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.687961:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9883 00000100:00100000:0.0:1746066825.688871:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.688992:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833344 00000100:00100000:2.0:1746066825.688996:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833344 00010000:00010000:2.0:1746066825.689013:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 42 pid: 12233 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746066825.689040:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9884 00000100:00100000:2.0:1746066825.689046:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2013:x1830882985833344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066825.689053:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066825.689062:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 42 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.689070:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 42 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.689083:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a800/0xf1867c21abfb3a18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bb8 expref: 42 pid: 12233 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.689098:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.689100:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.689105:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 41 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.689112:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 41 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.689138:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 41 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.689148:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985266432:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.689231:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.690940:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985266432:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066825.690944:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009586b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985832832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8067us (8213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.690953:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8159 00010000:00010000:3.0:1746066825.690960:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746066825.690960:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88009586b480 x1830882985832832/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.690968:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009586b480 with x1830882985832832 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.690972:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009586b480 00000100:00100000:3.0:1746066825.690988:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2013:x1830882985833344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1942us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.690997:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9884 00000100:00100000:0.0:1746066825.691307:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.691381:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833600 00000100:00100000:2.0:1746066825.691388:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833600 00002000:00100000:2.0:1746066825.691422:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (4075520->4079615) req@ffff88009d9b3480 x1830882985833600/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.691430:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882985833600 ext(4075520->4079615) 00002000:00010000:2.0:1746066825.691433:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:2.0:1746066825.691455:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8160 00000100:00100000:2.0:1746066825.691461:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2016:x1830882985833600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066825.691573:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:2016:x1830882985833600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 112us (267us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066825.691579:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8160 00002000:00100000:2.0:1746066825.691584:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (4075520->4079615) req@ffff88009d9b3480 x1830882985833600/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.691590:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882985833600 ext(4075520->4079615) 00002000:00010000:2.0:1746066825.691592:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:0.0:1746066825.695028:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.695194:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833728 00000100:00100000:3.0:1746066825.695214:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833728 00000100:00100000:0.0:1746066825.695265:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.695282:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833856 00000100:00100000:3.0:1746066825.695284:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833856 00000100:00100000:3.0:1746066825.695305:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21369 00000100:00100000:3.0:1746066825.695316:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3893:x1830882985833728:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:2.0:1746066825.695330:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21370 00010000:00010000:3.0:1746066825.695334:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066825.695340:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+39:3896:x1830882985833856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.695348:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.695352:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cc9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.695359:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cd0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.695380:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 46 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.695385:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.695388:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.695389:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066825.695393:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.695393:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.695399:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.695403:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.695405:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.695408:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->4546559] (req 4194304->4546559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.695424:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.695424:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 46 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.695434:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 46 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.695435:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.695446:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.695446:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985266560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.695745:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066825.695753:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 15 pid: 9592 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.695760:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.695800:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.695808:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 44 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.695815:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266944:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.695836:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.695906:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.698093:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.698119:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882985266560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.698148:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.698165:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb400, rc 0) 00000100:00100000:3.0:1746066825.698166:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266688:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.698175:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266816:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066825.698181:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985266944:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066825.698211:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [4194304->4546559] (req 4194304->4546559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.698218:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:3896:x1830882985833856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2879us (2952us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066825.698220:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:2.0:1746066825.698226:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21370 00000100:00100000:3.0:1746066825.698237:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3893:x1830882985833728:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2927us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.698242:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21369 00000100:00100000:2.0:1746066825.698260:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985834112 00000100:00100000:2.0:1746066825.698265:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985834112 00002000:00100000:2.0:1746066825.698298:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1925119) req@ffff8801310f2680 x1830882985834112/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.698306:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882985834112 ext(1048576->1925119) 00010000:00010000:2.0:1746066825.698312:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 47 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.698326:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 47 pid: 12255 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.698332:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801310f2680 00000100:00100000:2.0:1746066825.698361:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2330 00000100:00100000:2.0:1746066825.698368:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882985834112:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066825.700873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.700929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.700998:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985833984 00000100:00100000:3.0:1746066825.701006:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985833984 00010000:00010000:3.0:1746066825.701040:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.701071:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985834240 00000100:00100000:3.0:1746066825.701074:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985834240 00010000:00010000:3.0:1746066825.701085:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.701099:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9885 00000100:00100000:3.0:1746066825.701105:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+16:2016:x1830882985833984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.701117:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.701137:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.701152:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.701176:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfb3a88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8bf0 expref: 16 pid: 9592 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746066825.701193:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9886 00010000:00010000:3.0:1746066825.701195:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.701211:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985834240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.701218:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.701226:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.701233:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.701241:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31c94c27-8194-4112-9e80-db222abc766f+15:2016:x1830882985833984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.701247:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9885 00010000:00010000:1.0:1746066825.701249:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfb39c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8b80 expref: 45 pid: 9592 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746066825.701261:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.701275:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882985834240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.701281:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9886 00000100:00100000:0.0:1746066825.703235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.703365:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985834368 00000100:00100000:3.0:1746066825.703370:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985834368 00010000:00010000:3.0:1746066825.703389:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746066825.703410:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9887 00000100:00100000:3.0:1746066825.703415:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2016:x1830882985834368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.703424:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.703434:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.703443:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.703632:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d2000/0xf1867c21abfb3a0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ba3 expref: 27 pid: 13726 timeout: 893 lvb_type: 1 00010000:00010000:3.0:1746066825.703645:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.703647:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.703809:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.703818:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.703854:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.703868:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985267072:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.704029:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.705062:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882985834112:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6692us (6974us total) trans 21474842918 rc 0/0 00000100:00100000:2.0:1746066825.705071:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2330 00002000:00100000:2.0:1746066825.705080:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->1925119) req@ffff8801310f2680 x1830882985834112/t21474842918(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.705088:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882985834112 ext(1048576->1925119) 00010000:00010000:2.0:1746066825.705096:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746066825.705107:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746066825.705113:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801310f2680 00000100:00100000:3.0:1746066825.705575:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985267072:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.705690:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.706178:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985834368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2759us (2947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.706187:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9887 00000100:00100000:0.0:1746066825.707306:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.707379:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985834496 00000100:00100000:3.0:1746066825.707386:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985834496 00010000:00010000:3.0:1746066825.707410:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746066825.707475:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9888 00000100:00100000:3.0:1746066825.707484:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882985834496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.707498:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.707518:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.707529:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.707551:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfb3ba0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c98 expref: 49 pid: 12255 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746066825.707564:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.707566:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.707572:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.707580:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.707609:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.707621:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985267200:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.708478:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.708766:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.708982:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985834752 00000100:00100000:2.0:1746066825.708987:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985834752 00002000:00100000:2.0:1746066825.709020:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4542464->4546559) req@ffff88012c491c00 x1830882985834752/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.709030:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882985834752 ext(4542464->4546559) 00002000:00010000:2.0:1746066825.709034:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:2.0:1746066825.709048:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8161 00000100:00100000:2.0:1746066825.709053:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985834752:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066825.709604:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985834752:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 549us (840us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066825.709610:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8161 00002000:00100000:2.0:1746066825.709616:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4542464->4546559) req@ffff88012c491c00 x1830882985834752/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.709623:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882985834752 ext(4542464->4546559) 00002000:00010000:2.0:1746066825.709626:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:3.0:1746066825.709720:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985267200:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.709735:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.709754:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882985834496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2272us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.709764:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9888 00000100:00100000:0.0:1746066825.711068:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.711764:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985835008 00000100:00100000:2.0:1746066825.711776:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985835008 00002000:00100000:2.0:1746066825.711816:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c491180 x1830882985835008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.711825:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985835008 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.711829:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:2.0:1746066825.711871:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8162 00000100:00100000:2.0:1746066825.711879:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985835008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066825.713067:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.713296:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985835264 00000100:00100000:3.0:1746066825.713306:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985835264 00000100:00100000:3.0:1746066825.713424:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6634 00000100:00100000:3.0:1746066825.713432:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+22:3893:x1830882985835264:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066825.714074:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3893:x1830882985835264:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 640us (1009us total) trans 8589938007 rc 0/0 00000100:00100000:3.0:1746066825.714083:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6634 00000100:00100000:2.0:1746066825.717640:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985835008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5753us (6566us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.717651:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8162 00002000:00100000:2.0:1746066825.717661:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c491180 x1830882985835008/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.717670:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491180 with x1830882985835008 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.717675:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491180 00000100:00100000:0.0:1746066825.727669:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.727719:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.727997:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985835776 00000100:00100000:1.0:1746066825.727997:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985835648 00000100:00100000:2.0:1746066825.728005:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985835776 00000100:00100000:1.0:1746066825.728005:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985835648 00002000:00100000:2.0:1746066825.728043:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4075519) req@ffff88012c491500 x1830882985835776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.728043:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012c493800 x1830882985835648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.728051:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882985835776 ext(2097152->4075519) 00002000:00100000:1.0:1746066825.728051:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882985835648 ext(2097152->4194303) 00002000:00010000:2.0:1746066825.728055:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00002000:00010000:1.0:1746066825.728055:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:1.0:1746066825.728084:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8163 00000100:00100000:1.0:1746066825.728091:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985835648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.728102:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8164 00000100:00100000:2.0:1746066825.728107:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985835776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.737051:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2013:x1830882985835648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8946us (9374us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066825.737064:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8163 00002000:00100000:1.0:1746066825.737076:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff88012c493800 x1830882985835648/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.737085:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882985835648 ext(2097152->4194303) 00002000:00010000:1.0:1746066825.737091:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:2.0:1746066825.737690:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985835776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9573us (9961us total) trans 0 rc 1978368/1978368 00000100:00100000:2.0:1746066825.737701:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8164 00002000:00100000:2.0:1746066825.737712:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4075519) req@ffff88012c491500 x1830882985835776/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1978368/1978368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.737721:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882985835776 ext(2097152->4075519) 00002000:00010000:2.0:1746066825.737726:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00000100:00100000:0.0:1746066825.743744:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.743834:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836032 00000100:00100000:2.0:1746066825.743846:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836032 00002000:00100000:2.0:1746066825.743930:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4546560->5074943) req@ffff88012c492300 x1830882985836032/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.743939:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492300 with x1830882985836032 ext(4546560->5074943) 00002000:00010000:2.0:1746066825.743946:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492300 00000100:00100000:2.0:1746066825.743979:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8165 00000100:00100000:2.0:1746066825.743985:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985836032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.747550:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985836032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3553us (3808us total) trans 0 rc 528384/528384 00000100:00100000:2.0:1746066825.747563:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8165 00002000:00100000:2.0:1746066825.747574:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4546560->5074943) req@ffff88012c492300 x1830882985836032/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.747582:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492300 with x1830882985836032 ext(4546560->5074943) 00002000:00010000:2.0:1746066825.747589:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492300 00000100:00100000:0.0:1746066825.762104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.762153:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.762182:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.762223:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.762256:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836160 00000100:00100000:2.0:1746066825.762266:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836160 00000100:00100000:3.0:1746066825.762269:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836416 00000100:00100000:3.0:1746066825.762274:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836416 00000100:00100000:0.0:1746066825.762274:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836288 00000100:00100000:0.0:1746066825.762276:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836288 00000100:00100000:3.0:1746066825.762313:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836544 00000100:00100000:3.0:1746066825.762315:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836544 00000100:00100000:2.0:1746066825.762326:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21371 00000100:00100000:0.0:1746066825.762333:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21372 00000100:00100000:3.0:1746066825.762338:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21373 00000100:00100000:0.0:1746066825.762338:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985836416:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066825.762342:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985836160:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066825.762354:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21374 00010000:00010000:3.0:1746066825.762357:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.762357:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066825.762370:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985836544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.762373:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cd7 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.762373:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb3bed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8ce5 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.762390:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.762395:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.762397:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066825.762403:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985836288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066825.762405:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 51 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.762406:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb3bfb lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cec expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.762416:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066825.762418:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066825.762423:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985267328:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.762425:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cde expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.762428:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a400, rc 0) 00010000:00010000:2.0:1746066825.762439:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.762440:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.762448:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 53 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.762450:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985267456:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.762461:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 53 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.762466:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2015:x1830882985836160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.762472:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21373 00010000:00010000:2.0:1746066825.762473:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dba400, rc 0) 00000100:00100000:0.0:1746066825.762484:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.762499:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.762509:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985836288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.762515:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21371 00000100:00100000:1.0:1746066825.765450:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985267456:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.765477:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb3bfb lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cec expref: 51 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066825.765481:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985267328:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.765488:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fc00/0xf1867c21abfb3bfb lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cec expref: 51 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.765501:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb3bed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ce5 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.765511:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfb3bed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ce5 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.765514:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fc00, rc 0) 00010000:00010000:2.0:1746066825.765525:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d000, rc 0) 00000100:00100000:1.0:1746066825.765543:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882985836544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3179us (3319us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.765544:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882985836416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3205us (3390us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.765549:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21374 00000100:00100000:2.0:1746066825.765556:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21372 00000100:00100000:0.0:1746066825.771010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.771059:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.771114:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836800 00000100:00100000:2.0:1746066825.771126:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836800 00002000:00100000:2.0:1746066825.771172:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c490700 x1830882985836800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.771181:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882985836800 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.771186:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:1.0:1746066825.771186:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985836928 00000100:00100000:1.0:1746066825.771194:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985836928 00000100:00100000:2.0:1746066825.771229:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8166 00000100:00100000:2.0:1746066825.771236:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985836800:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066825.771249:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c490e00 x1830882985836928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.771259:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882985836928 ext(1048576->2097151) 00002000:00010000:1.0:1746066825.771264:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490e00 00000100:00100000:1.0:1746066825.771286:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8167 00000100:00100000:1.0:1746066825.771294:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985836928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.779022:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882985836800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7778us (8015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.779033:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8166 00002000:00100000:2.0:1746066825.779043:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff88012c490700 x1830882985836800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.779051:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882985836800 ext(1048576->2097151) 00002000:00010000:2.0:1746066825.779056:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:1.0:1746066825.779663:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882985836928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8368us (8602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066825.779670:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8167 00002000:00100000:1.0:1746066825.779675:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa2:0x0] (1048576->2097151) req@ffff88012c490e00 x1830882985836928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.779681:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882985836928 ext(1048576->2097151) 00002000:00010000:1.0:1746066825.779684:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490e00 00000100:00100000:0.0:1746066825.785779:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.785837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.785869:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837184 00000100:00100000:2.0:1746066825.785878:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837184 00000100:00100000:1.0:1746066825.785924:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837312 00000100:00100000:1.0:1746066825.785932:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837312 00000100:00100000:2.0:1746066825.785960:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21375 00000100:00100000:2.0:1746066825.785968:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882985837184:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066825.785971:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21376 00000100:00100000:1.0:1746066825.785978:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882985837312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.785985:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.785993:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.786002:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cf3 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.786007:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfb3c10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8cfa expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.786049:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985267584:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066825.786050:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985267712:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066825.786131:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.786142:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.787227:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985267712:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.787251:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c09 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cf3 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.787263:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cf3 expref: 45 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.787278:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb600, rc 0) 00000100:00100000:2.0:1746066825.787302:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882985837184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1335us (1535us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.787308:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21375 00000100:00100000:1.0:1746066825.787335:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985267584:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066825.787351:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfb3c10 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cfa expref: 51 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.787360:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfb3c10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cfa expref: 51 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.787376:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e800, rc 0) 00000100:00100000:1.0:1746066825.787396:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882985837312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1418us (1558us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.787401:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21376 00000100:00100000:0.0:1746066825.789024:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.789120:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837440 00000100:00100000:1.0:1746066825.789128:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837440 00000100:00100000:1.0:1746066825.789174:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21377 00000100:00100000:1.0:1746066825.789180:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:3903:x1830882985837440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.789192:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.789217:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d01 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.789240:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.789246:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.789248:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.789251:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.789273:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.789283:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 25 pid: 9590 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746066825.789298:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985267840:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.789375:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.790186:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985267840:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.790216:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.790225:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e400, rc 0) 00000100:00100000:1.0:1746066825.790256:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:3903:x1830882985837440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1077us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.790261:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21377 00000100:00100000:0.0:1746066825.790724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.790772:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837568 00000100:00100000:1.0:1746066825.790776:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837568 00002000:00100000:1.0:1746066825.790801:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4546559) req@ffff8800a4d27100 x1830882985837568/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.790808:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27100 with x1830882985837568 ext(4194304->4546559) 00010000:00010000:1.0:1746066825.790814:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 26 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.790823:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 26 pid: 9590 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066825.790829:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d27100 00000100:00100000:1.0:1746066825.790851:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2331 00000100:00100000:1.0:1746066825.790857:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2016:x1830882985837568:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066825.793925:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2016:x1830882985837568:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3062us (3196us total) trans 17179875573 rc 0/0 00000100:00100000:0.0:1746066825.793935:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2331 00002000:00100000:0.0:1746066825.793944:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4546559) req@ffff8800a4d27100 x1830882985837568/t17179875573(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.793953:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27100 with x1830882985837568 ext(4194304->4546559) 00010000:00010000:0.0:1746066825.793962:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746066825.793974:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746066825.793986:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d27100 00000100:00100000:0.0:1746066825.797719:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.797790:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837696 00000100:00100000:3.0:1746066825.797799:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837696 00010000:00010000:3.0:1746066825.797831:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066825.797866:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9889 00000100:00100000:3.0:1746066825.797871:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2014:x1830882985837696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.797880:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.797920:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.797932:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.797958:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfb3bdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4546559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc9 expref: 28 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.797976:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.797978:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.797984:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.797991:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.798024:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.798035:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985267968:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.798117:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.799347:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985267968:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.799363:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.799388:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2014:x1830882985837696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1517us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.799395:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9889 00000100:00100000:0.0:1746066825.801151:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.801211:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985837952 00000100:00100000:2.0:1746066825.801218:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985837952 00002000:00100000:2.0:1746066825.801250:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d25500 x1830882985837952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.801259:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25500 with x1830882985837952 ext(2097152->3145727) 00002000:00010000:2.0:1746066825.801263:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25500 00000100:00100000:2.0:1746066825.801285:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8168 00000100:00100000:2.0:1746066825.801291:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985837952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.805422:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985837952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4123us (4266us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.805432:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8168 00002000:00100000:2.0:1746066825.805441:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->3145727) req@ffff8800a4d25500 x1830882985837952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.805449:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25500 with x1830882985837952 ext(2097152->3145727) 00002000:00010000:2.0:1746066825.805454:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d25500 00000100:00100000:0.0:1746066825.807877:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.808033:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985838080 00000100:00100000:1.0:1746066825.808042:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985838080 00000100:00100000:1.0:1746066825.808094:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21378 00000100:00100000:1.0:1746066825.808100:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:3903:x1830882985838080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.808114:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.808128:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d08 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.808151:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.808157:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.808159:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066825.808161:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 51 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.808184:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.808194:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 39 pid: 9590 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746066825.808219:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985268096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.808309:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.809225:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882985268096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.809244:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 51 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.809254:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:1.0:1746066825.809289:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+51:3903:x1830882985838080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1189us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.809295:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21378 00000100:00100000:0.0:1746066825.809457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.809530:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985838208 00000100:00100000:3.0:1746066825.809539:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985838208 00002000:00100000:3.0:1746066825.809579:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4075520->4194303) req@ffff8800a4d25c00 x1830882985838208/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.809588:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25c00 with x1830882985838208 ext(4075520->4194303) 00010000:00010000:3.0:1746066825.809597:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 40 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.809609:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 40 pid: 9590 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.809615:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d25c00 00000100:00100000:3.0:1746066825.809651:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2332 00000100:00100000:3.0:1746066825.809658:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2015:x1830882985838208:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066825.811570:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2015:x1830882985838208:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1906us (2107us total) trans 21474842919 rc 0/0 00000100:00100000:3.0:1746066825.811579:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2332 00002000:00100000:3.0:1746066825.811587:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (4075520->4194303) req@ffff8800a4d25c00 x1830882985838208/t21474842919(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.811595:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25c00 with x1830882985838208 ext(4075520->4194303) 00010000:00010000:3.0:1746066825.811603:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.811614:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.811620:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d25c00 00000100:00100000:0.0:1746066825.814980:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.815077:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985838336 00000100:00100000:3.0:1746066825.815086:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985838336 00010000:00010000:3.0:1746066825.815119:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066825.815158:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9890 00000100:00100000:3.0:1746066825.815166:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2014:x1830882985838336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.815178:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.815194:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.815220:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.815243:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfb3bd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cc2 expref: 42 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.815273:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.815275:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.815280:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 50 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.815288:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 50 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.815315:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 50 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.815325:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985268224:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.815454:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.816824:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985268224:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.816844:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.816911:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2014:x1830882985838336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1745us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.816921:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9890 00000100:00100000:0.0:1746066825.820969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.821062:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985838592 00000100:00100000:3.0:1746066825.821070:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985838592 00002000:00100000:3.0:1746066825.821110:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a4d27480 x1830882985838592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.821126:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27480 with x1830882985838592 ext(2097152->4194303) 00002000:00010000:3.0:1746066825.821131:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27480 00000100:00100000:3.0:1746066825.821155:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8169 00000100:00100000:3.0:1746066825.821163:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985838592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.821271:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.821323:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985838848 00000100:00100000:0.0:1746066825.821327:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985838848 00002000:00100000:0.0:1746066825.821346:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88009677ea00 x1830882985838848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066825.821354:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882985838848 ext(3145728->4194303) 00002000:00010000:0.0:1746066825.821358:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ea00 00000100:00100000:0.0:1746066825.821379:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8170 00000100:00100000:0.0:1746066825.821385:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985838848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066825.829224:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985838848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7827us (7941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066825.829235:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8170 00002000:00100000:2.0:1746066825.829245:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (3145728->4194303) req@ffff88009677ea00 x1830882985838848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066825.829254:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882985838848 ext(3145728->4194303) 00002000:00010000:2.0:1746066825.829260:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ea00 00000100:00100000:0.0:1746066825.831566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.831669:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839104 00000100:00100000:2.0:1746066825.831679:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839104 00000100:00100000:2.0:1746066825.831729:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17469 00000100:00100000:2.0:1746066825.831745:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+23:3905:x1830882985839104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.831763:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.831779:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d0f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.831870:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb3c2c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.831913:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb3c2c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.831925:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb3c2c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066825.831934:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066825.832013:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d0f expref: 26 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.832040:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb3c2c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d0f expref: 25 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.832048:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.832050:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066825.832052:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb200, rc 0) 00000100:00100000:2.0:1746066825.832108:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3905:x1830882985839104:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 371us (553us total) trans 8589938008 rc 0/0 00000100:00100000:2.0:1746066825.832118:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17469 00000100:00100000:3.0:1746066825.832783:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985838592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11620us (11820us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066825.832794:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8169 00002000:00100000:3.0:1746066825.832801:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff8800a4d27480 x1830882985838592/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.832809:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d27480 with x1830882985838592 ext(2097152->4194303) 00002000:00010000:3.0:1746066825.832812:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d27480 00000100:00100000:0.0:1746066825.838141:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.838303:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839232 00000100:00100000:1.0:1746066825.838311:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839232 00000100:00100000:1.0:1746066825.838452:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21379 00000100:00100000:1.0:1746066825.838460:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3905:x1830882985839232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066825.838476:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.838490:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d16 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.838517:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.838524:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.838525:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.838528:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2158592->2342911] (req 2158592->2342911) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.838559:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.838570:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 44 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746066825.838585:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985268352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066825.838732:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.838866:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.838973:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839488 00000100:00100000:3.0:1746066825.838976:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839488 00002000:00100000:3.0:1746066825.839000:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a4d25180 x1830882985839488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.839008:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25180 with x1830882985839488 ext(4194304->5074943) 00010000:00010000:3.0:1746066825.839012:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.839022:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.839027:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d25180 00000100:00100000:3.0:1746066825.839039:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2333 00000100:00100000:3.0:1746066825.839045:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882985839488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.842656:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985268352:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066825.842685:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2158592->2342911] (req 2158592->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.842702:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66c00, rc 0) 00000100:00100000:1.0:1746066825.843028:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:3905:x1830882985839232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4567us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.843035:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882985839488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3982us (4162us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746066825.843036:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21379 00000100:00100000:3.0:1746066825.843046:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2333 00002000:00100000:3.0:1746066825.843058:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a4d25180 x1830882985839488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.843067:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25180 with x1830882985839488 ext(4194304->5074943) 00010000:00010000:3.0:1746066825.843077:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.843091:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.843097:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d25180 00000100:00100000:0.0:1746066825.847494:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.847546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.847560:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839616 00000100:00100000:1.0:1746066825.847569:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839616 00000100:00100000:1.0:1746066825.847624:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21380 00000100:00100000:1.0:1746066825.847631:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985839616:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066825.847633:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839744 00000100:00100000:3.0:1746066825.847644:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839744 00010000:00010000:1.0:1746066825.847646:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.847662:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017200/0xf1867c21abfb3c41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d1d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.847677:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 47 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.847688:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.847699:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017200/0xf1867c21abfb3c41 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d1d expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.847708:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017200/0xf1867c21abfb3c41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d1d expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066825.847721:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9891 00010000:00010000:1.0:1746066825.847727:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017200, rc 0) 00000100:00100000:3.0:1746066825.847729:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882985839744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.847742:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.847762:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 46 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746066825.847766:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882985839616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 135us (280us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066825.847772:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21380 00010000:00010000:3.0:1746066825.847779:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 46 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.847799:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e400/0xf1867c21abfb3c17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d01 expref: 45 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.847817:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.847819:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.847826:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.847835:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.847930:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.847945:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985268480:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.848026:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.849478:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.849716:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985268480:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.849732:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.849815:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882985839744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2085us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.849825:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9891 00000100:00100000:0.0:1746066825.850154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.850262:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985839872 00000100:00100000:2.0:1746066825.850268:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985839872 00000100:00100000:2.0:1746066825.850303:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21381 00000100:00100000:2.0:1746066825.850308:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:3903:x1830882985839872:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066825.850351:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985840128 00000100:00100000:3.0:1746066825.850354:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985840128 00002000:00100000:3.0:1746066825.850379:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2158592->2162687) req@ffff8800a4d26680 x1830882985840128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.850388:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26680 with x1830882985840128 ext(2158592->2162687) 00002000:00010000:3.0:1746066825.850393:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d26680 00000100:00100000:3.0:1746066825.850404:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8171 00000100:00100000:3.0:1746066825.850408:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985840128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066825.850510:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2015:x1830882985840128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 100us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066825.850516:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8171 00002000:00100000:3.0:1746066825.850520:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x82:0x0] (2158592->2162687) req@ffff8800a4d26680 x1830882985840128/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.850526:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d26680 with x1830882985840128 ext(2158592->2162687) 00002000:00010000:3.0:1746066825.850529:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d26680 00010000:00010000:2.0:1746066825.850615:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.850631:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d24 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.850653:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.850660:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.850661:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.850664:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [5070848->5242879] (req 5070848->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 45 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.850690:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.850701:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 27 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066825.850712:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985268608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.851331:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.852263:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985268608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.852292:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [5070848->5242879] (req 5070848->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 45 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.852312:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a7dbb600, rc 0) 00000100:00100000:2.0:1746066825.852375:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:3903:x1830882985839872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2065us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.852383:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21381 00000100:00100000:0.0:1746066825.854055:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.854266:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985840384 00000100:00100000:1.0:1746066825.854275:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985840384 00002000:00100000:1.0:1746066825.854318:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2158592->2342911) req@ffff8800a4d25880 x1830882985840384/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.854327:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25880 with x1830882985840384 ext(2158592->2342911) 00010000:00010000:1.0:1746066825.854334:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 28 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.854347:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 28 pid: 20361 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066825.854354:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d25880 00000100:00100000:1.0:1746066825.854394:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2334 00000100:00100000:1.0:1746066825.854401:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+28:2013:x1830882985840384:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066825.857213:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985840384:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2795us (3150us total) trans 17179875574 rc 0/0 00000100:00100000:1.0:1746066825.857223:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2334 00002000:00100000:1.0:1746066825.857232:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2158592->2342911) req@ffff8800a4d25880 x1830882985840384/t17179875574(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.857245:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d25880 with x1830882985840384 ext(2158592->2342911) 00010000:00010000:1.0:1746066825.857253:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.857274:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066825.857280:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d25880 00000100:00100000:0.0:1746066825.859015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.859099:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985840512 00000100:00100000:3.0:1746066825.859107:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985840512 00010000:00010000:3.0:1746066825.859135:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066825.859168:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9892 00000100:00100000:3.0:1746066825.859174:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2014:x1830882985840512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.859188:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.859215:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.859230:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.859252:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66c00/0xf1867c21abfb3c3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2158592->2342911) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d16 expref: 30 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.859282:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.859283:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066825.859289:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.859295:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.859326:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.859337:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985268736:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.859407:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066825.860683:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985268736:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066825.860697:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066825.860722:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2014:x1830882985840512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1548us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.860730:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9892 00000100:00100000:0.0:1746066825.861418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.861515:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985840768 00000100:00100000:1.0:1746066825.861520:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985840768 00002000:00100000:1.0:1746066825.861548:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (5070848->5074943) req@ffff8800a4d24000 x1830882985840768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.861556:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24000 with x1830882985840768 ext(5070848->5074943) 00002000:00010000:1.0:1746066825.861560:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24000 00000100:00100000:1.0:1746066825.861586:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8172 00000100:00100000:1.0:1746066825.861592:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985840768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066825.861680:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882985840768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 88us (262us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.861686:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8172 00002000:00100000:1.0:1746066825.861691:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (5070848->5074943) req@ffff8800a4d24000 x1830882985840768/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.861697:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d24000 with x1830882985840768 ext(5070848->5074943) 00002000:00010000:1.0:1746066825.861700:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d24000 00000100:00100000:0.0:1746066825.895376:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.895481:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841024 00000100:00100000:2.0:1746066825.895490:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841024 00000100:00100000:2.0:1746066825.895548:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17470 00000100:00100000:2.0:1746066825.895556:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:3909:x1830882985841024:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.895575:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.895591:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb3c4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d2b expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.895680:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb3c56 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.895691:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb3c56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066825.895701:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb3c56 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066825.895709:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:2.0:1746066825.895785:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfb3c4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d2b expref: 47 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.895816:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb3c56 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d2b expref: 46 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.895824:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066825.895827:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066825.895829:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a000, rc 0) 00000100:00100000:2.0:1746066825.895903:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:3909:x1830882985841024:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 329us (617us total) trans 8589938009 rc 0/0 00000100:00100000:2.0:1746066825.895910:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17470 00000100:00100000:0.0:1746066825.912805:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.912942:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841152 00000100:00100000:2.0:1746066825.912954:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841152 00000100:00100000:2.0:1746066825.913023:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21382 00000100:00100000:2.0:1746066825.913030:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+51:3909:x1830882985841152:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066825.913045:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.913059:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d32 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.913085:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.913092:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.913098:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.913100:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.913103:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1220608->1626111] (req 1220608->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.913132:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.913144:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746066825.913154:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985268864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.913279:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.913287:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 40 pid: 9590 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066825.913294:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985268992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.913313:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.915070:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985268992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.915730:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985268864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.915759:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1220608->1626111] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.915773:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00000100:00100000:2.0:1746066825.915819:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+52:3909:x1830882985841152:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2788us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.915826:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21382 00000100:00100000:0.0:1746066825.917427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.917462:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.917518:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841408 00000100:00100000:1.0:1746066825.917522:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841280 00000100:00100000:3.0:1746066825.917525:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841408 00000100:00100000:1.0:1746066825.917526:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841280 00010000:00010000:3.0:1746066825.917552:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 41 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.917552:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746066825.917599:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9893 00000100:00100000:3.0:1746066825.917605:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2016:x1830882985841408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066825.917610:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9894 00000100:00100000:1.0:1746066825.917615:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882985841280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066825.917616:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.917623:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066825.917633:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 41 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.917633:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746066825.917712:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066825.917724:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 41 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.917744:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfb3bf4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd7 expref: 52 pid: 9592 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066825.917749:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfb3bd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cbb expref: 41 pid: 9590 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.917760:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.917762:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.917767:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 51 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.917774:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 51 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066825.917782:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066825.917802:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 51 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.917812:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985269120:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066825.917826:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2016:x1830882985841408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 220us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066825.917832:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9893 00000100:00100000:1.0:1746066825.918002:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.919021:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985269120:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.919036:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.919070:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:2014:x1830882985841280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1454us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.919077:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9894 00000100:00100000:0.0:1746066825.919548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.919616:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841664 00000100:00100000:1.0:1746066825.919621:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841664 00002000:00100000:1.0:1746066825.919651:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1224703) req@ffff8800a59c5c00 x1830882985841664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.919657:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5c00 with x1830882985841664 ext(1220608->1224703) 00002000:00010000:1.0:1746066825.919660:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5c00 00000100:00100000:1.0:1746066825.919676:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8173 00000100:00100000:1.0:1746066825.919680:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985841664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.919778:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882985841664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 96us (230us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.919784:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8173 00002000:00100000:1.0:1746066825.919788:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1224703) req@ffff8800a59c5c00 x1830882985841664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.919794:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5c00 with x1830882985841664 ext(1220608->1224703) 00002000:00010000:1.0:1746066825.919797:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c5c00 00000100:00100000:0.0:1746066825.924714:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.924802:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985841920 00000100:00100000:1.0:1746066825.924810:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985841920 00002000:00100000:1.0:1746066825.924845:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1622016->1626111) req@ffff8800a59c6680 x1830882985841920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.924860:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985841920 ext(1622016->1626111) 00002000:00010000:1.0:1746066825.924864:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:1.0:1746066825.924917:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8174 00000100:00100000:1.0:1746066825.924924:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985841920:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066825.925032:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985841920:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 109us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066825.925038:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8174 00002000:00100000:1.0:1746066825.925043:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1622016->1626111) req@ffff8800a59c6680 x1830882985841920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.925049:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6680 with x1830882985841920 ext(1622016->1626111) 00002000:00010000:1.0:1746066825.925052:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6680 00000100:00100000:0.0:1746066825.970016:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.970080:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.970103:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842048 00000100:00100000:2.0:1746066825.970112:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842048 00000100:00100000:0.0:1746066825.970123:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066825.970138:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842176 00000100:00100000:0.0:1746066825.970140:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842176 00000100:00100000:2.0:1746066825.970164:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21383 00000100:00100000:2.0:1746066825.970172:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+40:2013:x1830882985842048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.970189:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.970211:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb3c6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d39 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066825.970254:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269248:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066825.970323:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.970481:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842304 00000100:00100000:0.0:1746066825.970485:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842304 00000100:00100000:0.0:1746066825.970498:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21384 00000100:00100000:0.0:1746066825.970503:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2013:x1830882985842176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066825.970509:0:13726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066825.970518:0:13726:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d40 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066825.970528:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.970530:0:13726:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066825.970536:0:13726:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066825.970567:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21385 00000100:00100000:1.0:1746066825.970573:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2014:x1830882985842304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066825.970579:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066825.970585:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d47 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.970596:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.970597:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.970601:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 43 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.970611:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 43 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066825.970628:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016800, rc 0) 00010000:00010000:0.0:1746066825.970756:0:13726:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066825.970763:0:13726:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:0.0:1746066825.970792:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985842176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 289us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066825.970799:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21384 00000100:00100000:1.0:1746066825.970842:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+43:2014:x1830882985842304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 94us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.970847:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21385 00000100:00100000:2.0:1746066825.971649:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269248:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.971674:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb3c6b lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d39 expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.971683:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfb3c6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d39 expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.971741:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:2.0:1746066825.971774:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:2013:x1830882985842048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1602us (1765us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066825.971778:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21383 00000100:00100000:0.0:1746066825.976687:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.977419:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842432 00000100:00100000:2.0:1746066825.977428:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842432 00000100:00100000:2.0:1746066825.977473:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21386 00000100:00100000:2.0:1746066825.977478:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+41:3915:x1830882985842432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.977491:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.977503:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d4e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.977526:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 50 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.977531:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.977532:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066825.977534:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.977552:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 50 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.977559:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 50 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066825.977566:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066825.977629:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066825.979493:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066825.979526:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.979544:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ac00, rc 0) 00000100:00100000:2.0:1746066825.979583:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:3915:x1830882985842432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2103us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.979591:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21386 00000100:00100000:0.0:1746066825.980817:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.980934:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842560 00000100:00100000:3.0:1746066825.980946:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842560 00002000:00100000:3.0:1746066825.980992:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1626111) req@ffff8800a59c4380 x1830882985842560/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.981002:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4380 with x1830882985842560 ext(1220608->1626111) 00010000:00010000:3.0:1746066825.981010:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 51 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.981028:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 51 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.981035:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a59c4380 00000100:00100000:3.0:1746066825.981071:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2335 00000100:00100000:3.0:1746066825.981077:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882985842560:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066825.984252:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.984449:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842688 00000100:00100000:2.0:1746066825.984459:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842688 00000100:00100000:2.0:1746066825.984924:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21387 00000100:00100000:2.0:1746066825.984938:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+55:2016:x1830882985842688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.984953:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.984967:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb3c87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d55 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066825.984999:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985842560:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3920us (4184us total) trans 21474842920 rc 0/0 00000100:00100000:3.0:1746066825.985010:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2335 00000100:00100000:2.0:1746066825.985016:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269504:192.168.204.16@tcp:106: 00002000:00100000:3.0:1746066825.985021:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1220608->1626111) req@ffff8800a59c4380 x1830882985842560/t21474842920(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/448 e 0 to 0 dl 1746066836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.985029:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4380 with x1830882985842560 ext(1220608->1626111) 00010000:00010000:3.0:1746066825.985037:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066825.985049:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066825.985054:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a59c4380 00000100:00100000:2.0:1746066825.985099:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066825.986382:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.986403:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269504:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066825.986430:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb3c87 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d55 expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.986441:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfb3c87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d55 expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066825.986457:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b800, rc 0) 00000100:00100000:1.0:1746066825.986466:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842816 00000100:00100000:1.0:1746066825.986470:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842816 00000100:00100000:2.0:1746066825.986490:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+54:2016:x1830882985842688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1556us (2248us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066825.986496:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 54 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066825.986501:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21387 00000100:00100000:1.0:1746066825.986528:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9895 00000100:00100000:1.0:1746066825.986534:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985842816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066825.986544:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066825.986558:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.986567:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.986587:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfb3c64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1626111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d32 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066825.986607:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.986609:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066825.986616:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.986628:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066825.986657:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066825.986668:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985269632:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066825.986980:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d912600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066825.989205:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882985269632:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066825.989333:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066825.989379:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882985842816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2844us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066825.989389:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9895 00000100:00100000:0.0:1746066825.991062:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066825.991142:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985842944 00000100:00100000:2.0:1746066825.991154:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985842944 00000100:00100000:2.0:1746066825.991220:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21388 00000100:00100000:2.0:1746066825.991230:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+52:3918:x1830882985842944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066825.991246:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066825.991261:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d5c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.991285:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.991286:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066825.991291:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 53 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.991301:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 53 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066825.991308:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b000, rc 0) 00000100:00100000:2.0:1746066825.991374:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+53:3918:x1830882985842944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066825.991380:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21388 00000100:00100000:0.0:1746066825.992226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066825.992350:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985843200 00000100:00100000:3.0:1746066825.992355:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985843200 00002000:00100000:3.0:1746066825.992380:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c6a00 x1830882985843200/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.992388:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6a00 with x1830882985843200 ext(1048576->2097151) 00002000:00010000:3.0:1746066825.992392:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6a00 00000100:00100000:3.0:1746066825.992412:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8175 00000100:00100000:3.0:1746066825.992417:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985843200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066825.996052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066825.996171:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985843456 00000100:00100000:1.0:1746066825.996183:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985843456 00002000:00100000:1.0:1746066825.996245:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c7480 x1830882985843456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/0 e 0 to 0 dl 1746066836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066825.996256:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7480 with x1830882985843456 ext(1048576->2097151) 00002000:00010000:1.0:1746066825.996262:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c7480 00000100:00100000:1.0:1746066825.996307:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8176 00000100:00100000:1.0:1746066825.996314:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985843456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066825.997662:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985843200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5237us (5431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066825.997674:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8175 00002000:00100000:3.0:1746066825.997684:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c6a00 x1830882985843200/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066825.997693:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c6a00 with x1830882985843200 ext(1048576->2097151) 00002000:00010000:3.0:1746066825.997699:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c6a00 00000100:00100000:1.0:1746066826.002329:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985843456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6002us (6270us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066826.002411:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8176 00002000:00100000:1.0:1746066826.002424:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa1:0x0] (1048576->2097151) req@ffff8800a59c7480 x1830882985843456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:231/0 lens 488/440 e 0 to 0 dl 1746066836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.002434:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c7480 with x1830882985843456 ext(1048576->2097151) 00002000:00010000:1.0:1746066826.002440:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a59c7480 00000100:00100000:1.0:1746066826.014868:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.014991:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985843968 00000100:00100000:2.0:1746066826.015003:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985843968 00000100:00100000:1.0:1746066826.015010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.015049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066826.015079:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880095801500 x1830882985843968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066826.015086:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985843840 00002000:00100000:2.0:1746066826.015090:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882985843968 ext(2097152->4194303) 00000100:00100000:1.0:1746066826.015092:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985843840 00002000:00010000:2.0:1746066826.015095:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:2.0:1746066826.015116:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985844224 00000100:00100000:2.0:1746066826.015119:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985844224 00002000:00100000:1.0:1746066826.015129:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095801f80 x1830882985843840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.015144:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985843840 ext(2097152->4194303) 00002000:00010000:1.0:1746066826.015149:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801f80 00000100:00080000:0.0:1746066826.015168:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066826.015173:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066826.015262:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8177 00000100:00100000:1.0:1746066826.015272:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2015:x1830882985843968:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066826.015371:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095800000 x1830882985844224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.015378:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882985844224 ext(2097152->4194303) 00002000:00010000:2.0:1746066826.015381:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095800000 00000100:00100000:2.0:1746066826.015395:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8178 00000100:00100000:2.0:1746066826.015404:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985843840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066826.015492:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8179 00000100:00100000:0.0:1746066826.015499:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985844224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066826.027312:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2016:x1830882985843840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11901us (12292us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066826.027324:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8178 00002000:00100000:2.0:1746066826.027334:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095801f80 x1830882985843840/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.027344:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882985843840 ext(2097152->4194303) 00002000:00010000:2.0:1746066826.027349:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801f80 00000100:00100000:1.0:1746066826.043231:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2015:x1830882985843968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27954us (28368us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066826.043242:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8177 00002000:00100000:1.0:1746066826.043252:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880095801500 x1830882985843968/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.043259:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882985843968 ext(2097152->4194303) 00002000:00010000:1.0:1746066826.043264:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:2.0:1746066826.045153:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985844224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29648us (30095us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066826.045161:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8179 00002000:00100000:2.0:1746066826.045168:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff880095800000 x1830882985844224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.045176:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882985844224 ext(2097152->4194303) 00002000:00010000:2.0:1746066826.045180:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095800000 00000100:00100000:0.0:1746066826.053434:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.053527:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985844480 00000100:00100000:2.0:1746066826.053536:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985844480 00002000:00100000:2.0:1746066826.053572:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a59c4000 x1830882985844480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.053581:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4000 with x1830882985844480 ext(4194304->5074943) 00002000:00010000:2.0:1746066826.053586:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4000 00000100:00100000:2.0:1746066826.053616:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8180 00000100:00100000:2.0:1746066826.053623:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985844480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066826.057393:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.057926:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985844736 00000100:00100000:1.0:1746066826.057934:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985844736 00002000:00100000:1.0:1746066826.057969:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5070847) req@ffff8800a59c5880 x1830882985844736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.057979:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5880 with x1830882985844736 ext(4194304->5070847) 00002000:00010000:1.0:1746066826.057983:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5880 00000100:00100000:1.0:1746066826.058013:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8181 00000100:00100000:1.0:1746066826.058020:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985844736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066826.060817:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985844480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7187us (7383us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066826.060827:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8180 00002000:00100000:3.0:1746066826.060835:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff8800a59c4000 x1830882985844480/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.060844:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c4000 with x1830882985844480 ext(4194304->5074943) 00002000:00010000:3.0:1746066826.060848:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c4000 00000100:00100000:0.0:1746066826.065168:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.065220:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a59c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985844736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7199us (7832us total) trans 0 rc 876544/876544 00000100:00100000:1.0:1746066826.065229:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8181 00002000:00100000:1.0:1746066826.065236:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5070847) req@ffff8800a59c5880 x1830882985844736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.065242:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a59c5880 with x1830882985844736 ext(4194304->5070847) 00002000:00010000:1.0:1746066826.065245:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a59c5880 00000100:00100000:2.0:1746066826.065247:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985844864 00000100:00100000:2.0:1746066826.065253:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985844864 00000100:00100000:2.0:1746066826.065286:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21389 00000100:00100000:2.0:1746066826.065291:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+53:3920:x1830882985844864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066826.065303:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066826.065320:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d63 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.065345:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 54 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.065353:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066826.065358:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066826.065360:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066826.065363:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 5/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.065384:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 41 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066826.065393:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 41 pid: 20361 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746066826.065402:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269760:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066826.065466:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 54 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.065474:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 54 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066826.065481:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269888:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066826.065496:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066826.066469:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.066525:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985844992 00000100:00100000:1.0:1746066826.066529:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985844992 00000100:00100000:1.0:1746066826.066548:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21390 00000100:00100000:1.0:1746066826.066553:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:3913:x1830882985844992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066826.066560:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066826.066567:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d6a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.066579:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066826.066582:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.066592:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066826.066595:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3313664->4132863] (req 3313664->4132863) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.066614:0:20361:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [4001792->4194303] (req 4001792->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.066625:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [3313664->4132863] (req 3313664->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.066633:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017600, rc 0) 00000100:00100000:1.0:1746066826.066761:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+43:3913:x1830882985844992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 207us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.066767:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21390 00000100:00100000:0.0:1746066826.068767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.068799:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.068828:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.068979:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985845248 00000100:00100000:3.0:1746066826.068984:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985845248 00010000:00010000:3.0:1746066826.069009:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 43 pid: 20361 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746066826.069029:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985845376 00000100:00100000:3.0:1746066826.069031:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985845376 00010000:00010000:3.0:1746066826.069040:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 55 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066826.069054:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9896 00000100:00100000:3.0:1746066826.069060:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+43:2013:x1830882985845248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066826.069068:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066826.069083:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 43 pid: 20361 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066826.069092:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 43 pid: 20361 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066826.069109:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.069136:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e908e3f-1d55-4d67-a53d-13ae79f314a2+43:2013:x1830882985845248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.069142:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9896 00000100:00100000:3.0:1746066826.069155:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9897 00000100:00100000:3.0:1746066826.069159:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985845376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066826.069165:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066826.069170:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 55 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.069180:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 55 pid: 20361 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.069201:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.069203:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.069209:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60080000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.069216:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60080000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.069236:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.069246:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x70000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066826.069256:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985270144:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066826.069300:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746066826.069460:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097016800/0xf1867c21abfb3c79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d47 expref: 42 pid: 20361 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746066826.069475:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269760:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066826.069484:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfb3c1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d08 expref: 55 pid: 20361 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066826.069492:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985269888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066826.069512:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746066826.069519:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746066826.069527:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a400, rc 0) 00000100:00100000:2.0:1746066826.069548:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+54:3920:x1830882985844864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4257us (4387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.069554:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21389 00000100:00100000:2.0:1746066826.069566:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985845120 00000100:00100000:2.0:1746066826.069569:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985845120 00000100:00100000:2.0:1746066826.069582:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21391 00000100:00100000:2.0:1746066826.069586:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+54:2016:x1830882985845120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066826.069595:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066826.069602:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb3ca3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d71 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066826.069623:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985270272:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066826.069640:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066826.071115:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985270144:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066826.071132:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.071171:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985845376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2011us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.071178:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9897 00002000:00010000:2.0:1746066826.071275:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime: 1746066826 -> 1746066827 00000100:00100000:2.0:1746066826.071290:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882985270272:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066826.071312:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb3ca3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d71 expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066826.071322:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfb3ca3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d71 expref: 54 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066826.071375:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.071427:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985845632 00000100:00100000:1.0:1746066826.071432:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985845632 00002000:00100000:1.0:1746066826.071456:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4005887) req@ffff880093c4c380 x1830882985845632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.071464:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c380 with x1830882985845632 ext(4001792->4005887) 00010000:00010000:1.0:1746066826.071470:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066826.071480:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 54 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066826.071490:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4c380 00010000:00010000:2.0:1746066826.071501:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b200, rc 0) 00000100:00100000:1.0:1746066826.071504:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2336 00000100:00100000:1.0:1746066826.071510:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+54:2016:x1830882985845632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066826.071525:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+54:2016:x1830882985845120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1937us (2762us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066826.071531:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21391 00000100:00100000:1.0:1746066826.071593:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985845632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 83us (222us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066826.071599:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2336 00002000:00100000:1.0:1746066826.071603:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4005887) req@ffff880093c4c380 x1830882985845632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746066837 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.071610:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c4c380 with x1830882985845632 ext(4001792->4005887) 00010000:00010000:1.0:1746066826.071614:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066826.071622:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066826.071627:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093c4c380 00000100:00100000:0.0:1746066826.075402:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.075450:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.075523:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846016 00000100:00100000:1.0:1746066826.075530:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985845888 00000100:00100000:2.0:1746066826.075532:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846016 00000100:00100000:1.0:1746066826.075537:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985845888 00000100:00100000:2.0:1746066826.075574:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21392 00000100:00100000:2.0:1746066826.075579:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:3920:x1830882985846016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066826.075594:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066826.075610:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d78 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066826.075627:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4194303) req@ffff8800967aad80 x1830882985845888/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066826.075634:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066826.075636:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882985845888 ext(4001792->4194303) 00010000:00010000:2.0:1746066826.075641:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066826.075644:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746066826.075645:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066826.075646:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066826.075649:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.075665:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 53 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746066826.075672:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746066826.075672:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aad80 00010000:00010000:2.0:1746066826.075678:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 29 pid: 13726 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746066826.075687:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270400:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066826.075695:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2337 00000100:00100000:1.0:1746066826.075707:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882985845888:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746066826.075760:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.075768:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066826.075779:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066826.075807:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066826.078536:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+55:2016:x1830882985845888:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2826us (3135us total) trans 21474842921 rc 0/0 00000100:00100000:1.0:1746066826.078543:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2337 00002000:00100000:1.0:1746066826.078549:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (4001792->4194303) req@ffff8800967aad80 x1830882985845888/t21474842921(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/448 e 0 to 0 dl 1746066837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.078555:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882985845888 ext(4001792->4194303) 00010000:00010000:1.0:1746066826.078560:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066826.078567:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:1.0:1746066826.078571:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aad80 00000100:00100000:0.0:1746066826.080869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.080952:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270400:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066826.080967:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846144 00000100:00100000:3.0:1746066826.080973:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846144 00000100:00100000:2.0:1746066826.081002:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270528:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066826.081021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066826.081036:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066826.081050:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846272 00010000:00010000:2.0:1746066826.081052:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ac00, rc 0) 00000100:00100000:1.0:1746066826.081054:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846272 00010000:00010000:1.0:1746066826.081070:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066826.081071:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066826.081101:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:3920:x1830882985846016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5520us (5648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.081103:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9898 00000100:00100000:2.0:1746066826.081109:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21392 00000100:00100000:1.0:1746066826.081110:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882985846144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066826.081121:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066826.081136:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746066826.081145:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066826.081155:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9899 00000100:00100000:3.0:1746066826.081161:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2013:x1830882985846272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066826.081165:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7dbb600/0xf1867c21abfb3c48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5070848->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d24 expref: 46 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.081170:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066826.081179:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746066826.081181:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066826.081187:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746066826.081210:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357b600/0xf1867c21abfb3c72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d40 expref: 30 pid: 13726 timeout: 894 lvb_type: 1 00000100:00100000:1.0:1746066826.081217:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882985846144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.081223:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9898 00010000:00010000:3.0:1746066826.081229:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.081231:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.081236:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.081243:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.081266:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066826.081277:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985270656:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066826.081366:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066826.081591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.081718:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846400 00000100:00100000:3.0:1746066826.081721:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846400 00010000:00010000:3.0:1746066826.081732:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066826.081754:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9900 00000100:00100000:3.0:1746066826.081759:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882985846400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066826.081765:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066826.081773:0:7230:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066826 -> 1746066827 00002000:00010000:3.0:1746066826.081775:0:7230:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066826 -> 1746066827 00010000:00010000:3.0:1746066826.081779:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.081787:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.081798:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfb3c95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d63 expref: 55 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.081870:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.081872:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.081876:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.081899:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.081917:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3313664->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066826.081929:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985270784:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066826.082089:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066826.082282:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882985270656:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066826.082293:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.082310:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2013:x1830882985846272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1150us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.082316:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9899 00000100:00100000:0.0:1746066826.082706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.082820:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882985270784:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066826.082829:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.082845:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+54:2015:x1830882985846400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1086us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.082851:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9900 00000100:00100000:1.0:1746066826.082908:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846656 00000100:00100000:1.0:1746066826.082912:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846656 00002000:00100000:1.0:1746066826.082932:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4222976->4227071) req@ffff8800930e1180 x1830882985846656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.082940:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e1180 with x1830882985846656 ext(4222976->4227071) 00002000:00010000:1.0:1746066826.082943:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e1180 00000100:00100000:1.0:1746066826.082954:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8182 00000100:00100000:1.0:1746066826.082958:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985846656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066826.083149:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985846656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 189us (442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066826.083154:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8182 00002000:00100000:1.0:1746066826.083159:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (4222976->4227071) req@ffff8800930e1180 x1830882985846656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.083165:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e1180 with x1830882985846656 ext(4222976->4227071) 00002000:00010000:1.0:1746066826.083168:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930e1180 00000100:00100000:0.0:1746066826.083174:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.083209:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985846912 00000100:00100000:1.0:1746066826.083211:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985846912 00002000:00100000:1.0:1746066826.083221:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff8800930e2680 x1830882985846912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.083228:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2680 with x1830882985846912 ext(3313664->3317759) 00002000:00010000:1.0:1746066826.083230:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e2680 00000100:00100000:1.0:1746066826.083256:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8183 00000100:00100000:1.0:1746066826.083260:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985846912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066826.083305:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985846912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 44us (132us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066826.083310:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8183 00002000:00100000:1.0:1746066826.083314:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa3:0x0] (3313664->3317759) req@ffff8800930e2680 x1830882985846912/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.083320:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2680 with x1830882985846912 ext(3313664->3317759) 00002000:00010000:1.0:1746066826.083322:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e2680 00000100:00100000:0.0:1746066826.089490:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.089554:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985847168 00000100:00100000:3.0:1746066826.089562:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985847168 00002000:00100000:3.0:1746066826.089600:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (4128768->4132863) req@ffff8800930e0700 x1830882985847168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.089613:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0700 with x1830882985847168 ext(4128768->4132863) 00002000:00010000:3.0:1746066826.089617:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0700 00000100:00100000:3.0:1746066826.089649:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8184 00000100:00100000:3.0:1746066826.089655:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2013:x1830882985847168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066826.089776:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2013:x1830882985847168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066826.089784:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8184 00002000:00100000:3.0:1746066826.089790:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (4128768->4132863) req@ffff8800930e0700 x1830882985847168/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.089797:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e0700 with x1830882985847168 ext(4128768->4132863) 00002000:00010000:3.0:1746066826.089799:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930e0700 00000100:00100000:0.0:1746066826.180829:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.181913:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985847296 00000100:00100000:2.0:1746066826.181922:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985847296 00000100:00100000:2.0:1746066826.181972:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21393 00000100:00100000:2.0:1746066826.181981:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985847296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066826.181995:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066826.182008:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfb3cb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d7f expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066826.182047:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066826.182128:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00002000:00010000:2.0:1746066826.185141:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime: 1746066826 -> 1746066827 00002000:00010000:2.0:1746066826.185147:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime: 1746066826 -> 1746066827 00002000:00010000:2.0:1746066826.185149:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime: 1746066826 -> 1746066827 00000100:00100000:2.0:1746066826.185168:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985270912:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066826.185206:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfb3cb1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d7f expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066826.185219:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfb3cb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d7f expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066826.185246:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ba00, rc 0) 00000100:00100000:2.0:1746066826.185291:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:2016:x1830882985847296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3311us (4468us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066826.185299:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21393 00000100:00100000:0.0:1746066826.196011:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.196082:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985847424 00000100:00100000:2.0:1746066826.196091:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985847424 00000100:00100000:2.0:1746066826.196693:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21394 00000100:00100000:2.0:1746066826.196701:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+29:3927:x1830882985847424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066826.196718:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066826.196731:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d86 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.196757:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.196764:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066826.196766:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066826.196769:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.196796:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.196808:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 44 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746066826.196819:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985271040:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066826.198261:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066826.201070:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.201291:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882985271040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066826.201326:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066826.201346:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a800, rc 0) 00000100:00100000:2.0:1746066826.201388:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:3927:x1830882985847424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4688us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.201397:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21394 00000100:00100000:3.0:1746066826.201485:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985847552 00000100:00100000:3.0:1746066826.201492:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985847552 00002000:00100000:3.0:1746066826.201531:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4227071) req@ffff8800930e2a00 x1830882985847552/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.201540:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2a00 with x1830882985847552 ext(4194304->4227071) 00010000:00010000:3.0:1746066826.201547:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 45 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.201559:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 45 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066826.201565:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930e2a00 00000100:00100000:3.0:1746066826.201596:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 2338 00000100:00100000:3.0:1746066826.201602:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882985847552:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066826.203920:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882985847552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2281us (2826us total) trans 17179875575 rc 0/0 00000100:00100000:3.0:1746066826.203931:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 2338 00002000:00100000:3.0:1746066826.203942:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->4227071) req@ffff8800930e2a00 x1830882985847552/t17179875575(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:232/0 lens 488/448 e 0 to 0 dl 1746066837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.203952:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930e2a00 with x1830882985847552 ext(4194304->4227071) 00010000:00010000:3.0:1746066826.203961:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.203976:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746066826.203983:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930e2a00 00000100:00100000:0.0:1746066826.205754:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.205948:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985847680 00000100:00100000:3.0:1746066826.205959:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985847680 00010000:00010000:3.0:1746066826.205993:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746066826.206030:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9901 00000100:00100000:3.0:1746066826.206037:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882985847680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066826.206048:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066826.206065:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.206075:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.206098:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfb3caa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d78 expref: 47 pid: 12233 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746066826.206718:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.206721:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066826.206730:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.206744:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.206780:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066826.206793:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985271168:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066826.206936:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066826.211063:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882985271168:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066826.211087:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.211147:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882985847680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5108us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.211158:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9901 00000100:00100000:0.0:1746066826.220583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.220644:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.220757:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848064 00000100:00100000:1.0:1746066826.220767:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848064 00002000:00100000:1.0:1746066826.220818:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5765c00 x1830882985848064/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066826.220828:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985848064 ext(2097152->4194303) 00002000:00010000:1.0:1746066826.220833:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5765c00 00000100:00100000:3.0:1746066826.220844:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848192 00000100:00100000:3.0:1746066826.220848:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848192 00002000:00100000:3.0:1746066826.220867:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880094372680 x1830882985848192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 504/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066826.220873:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372680 with x1830882985848192 ext(2097152->4194303) 00002000:00010000:3.0:1746066826.220875:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372680 00000100:00100000:2.0:1746066826.221496:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8185 00000100:00100000:2.0:1746066826.221506:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985848064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066826.221521:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8186 00000100:00100000:0.0:1746066826.221527:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985848192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066826.231311:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985848192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9777us (10658us total) trans 0 rc 1277952/1277952 00000100:00100000:2.0:1746066826.231323:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8186 00002000:00100000:2.0:1746066826.231332:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0xa3:0x0] (2097152->4194303) req@ffff880094372680 x1830882985848192/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 504/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 1277952/1277952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.231346:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372680 with x1830882985848192 ext(2097152->4194303) 00002000:00010000:2.0:1746066826.231351:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372680 00000100:00100000:2.0:1746066826.237358:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985848064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15845us (16777us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066826.237368:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8185 00002000:00100000:2.0:1746066826.237377:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (2097152->4194303) req@ffff8800a5765c00 x1830882985848064/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.237386:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5765c00 with x1830882985848064 ext(2097152->4194303) 00002000:00010000:2.0:1746066826.237391:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5765c00 00000100:00100000:0.0:1746066826.241228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.241321:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848448 00000100:00100000:2.0:1746066826.241330:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848448 00002000:00100000:2.0:1746066826.241371:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094371500 x1830882985848448/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.241381:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371500 with x1830882985848448 ext(4194304->5074943) 00002000:00010000:2.0:1746066826.241385:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371500 00000100:00100000:2.0:1746066826.241407:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8187 00000100:00100000:2.0:1746066826.241414:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985848448:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066826.248895:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+30:2015:x1830882985848448:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7460us (7653us total) trans 0 rc 880640/880640 00000100:00100000:2.0:1746066826.248906:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8187 00002000:00100000:2.0:1746066826.248916:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x82:0x0] (4194304->5074943) req@ffff880094371500 x1830882985848448/t0(0) o3->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/440 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 880640/880640 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.248932:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094371500 with x1830882985848448 ext(4194304->5074943) 00002000:00010000:2.0:1746066826.248936:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094371500 00000100:00100000:0.0:1746066826.250243:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.250283:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.250315:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.250338:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848704 00000100:00100000:2.0:1746066826.250345:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848704 00000100:00100000:0.0:1746066826.250372:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.250396:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848960 00000100:00100000:0.0:1746066826.250397:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848832 00000100:00100000:2.0:1746066826.250398:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848960 00000100:00100000:0.0:1746066826.250399:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848832 00000100:00100000:2.0:1746066826.250413:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1027 00000100:00080000:1.0:1746066826.250573:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746066826.250750:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985848576 00000100:00100000:3.0:1746066826.250754:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985848576 00000100:00100000:3.0:1746066826.250780:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:3.0:1746066826.250786:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985848576:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066826.250833:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882985848576:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 48us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.250839:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 237 00000100:00100000:0.0:1746066826.250932:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1028 00000100:00100000:2.0:1746066826.250933:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985848704:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066826.250937:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985848960:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1746066826.250938:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 1029 00000100:00100000:1.0:1746066826.250946:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985848832:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066826.250961:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+5:2016:x1830882985848960:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 21us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.250967:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1028 00000100:00100000:2.0:1746066826.251111:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882985848704:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 178us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.251113:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2016:x1830882985848832:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 168us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.251116:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1027 00000100:00100000:1.0:1746066826.251119:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 1029 00000100:00100000:0.0:1746066826.396654:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.396771:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849088 00000100:00100000:2.0:1746066826.396781:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849088 00002000:00100000:2.0:1746066826.396833:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3227648->4132863) req@ffff880094372a00 x1830882985849088/t0(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/0 e 0 to 0 dl 1746066837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.396844:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372a00 with x1830882985849088 ext(3227648->4132863) 00002000:00010000:2.0:1746066826.396850:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372a00 00000100:00100000:2.0:1746066826.396918:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8188 00000100:00100000:2.0:1746066826.396927:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+42:2016:x1830882985849088:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066826.407632:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+44:2016:x1830882985849088:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10428us (10712us total) trans 21474842922 rc 0/0 00000100:00100000:2.0:1746066826.407647:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8188 00002000:00100000:2.0:1746066826.407660:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa3:0x0] (3227648->4132863) req@ffff880094372a00 x1830882985849088/t21474842922(0) o4->5e908e3f-1d55-4d67-a53d-13ae79f314a2@192.168.204.16@tcp:232/0 lens 488/448 e 0 to 0 dl 1746066837 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066826.407675:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094372a00 with x1830882985849088 ext(3227648->4132863) 00002000:00010000:2.0:1746066826.407681:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094372a00 00000001:00080000:0.0:1746066826.408650:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842922 is committed 00000001:00080000:0.0:1746066826.408661:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842921 is committed 00000001:00080000:0.0:1746066826.408711:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842908 is committed 00000001:00080000:0.0:1746066826.408741:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842892 is committed 00010000:00010000:2.0:1746066826.683382:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066826.799039:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799103:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799130:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799147:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.799223:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849344 00000100:00100000:0.0:1746066826.799232:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849344 00000100:00100000:0.0:1746066826.799280:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849600 00000100:00100000:0.0:1746066826.799282:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849600 00000100:00100000:0.0:1746066826.799294:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849856 00000100:00100000:0.0:1746066826.799295:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849856 00000100:00100000:0.0:1746066826.799306:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21395 00000100:00100000:0.0:1746066826.799312:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985849344:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066826.799384:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985849344:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.799390:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21395 00000100:00100000:0.0:1746066826.799401:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849216 00000100:00100000:0.0:1746066826.799403:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849216 00000100:00100000:0.0:1746066826.799411:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849472 00000100:00100000:0.0:1746066826.799412:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849472 00000100:00100000:0.0:1746066826.799419:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985849728 00000100:00100000:0.0:1746066826.799420:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985849728 00000100:00100000:0.0:1746066826.799430:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21396 00000100:00100000:0.0:1746066826.799434:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985849600:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066826.799476:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21397 00000100:00100000:0.0:1746066826.799481:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985849856:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066826.799505:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985849856:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.799513:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21397 00000100:00100000:0.0:1746066826.799521:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21398 00000100:00100000:0.0:1746066826.799525:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985849216:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066826.799545:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21399 00000100:00100000:0.0:1746066826.799549:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985849472:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066826.799571:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985849472:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.799575:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21399 00000100:00100000:0.0:1746066826.799582:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21400 00000100:00100000:0.0:1746066826.799586:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+32:2015:x1830882985849728:12345-192.168.204.16@tcp:16:kworker.0 00000001:00080000:0.0:1746066826.802159:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875575 is committed 00000001:00080000:0.0:1746066826.802176:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875574 is committed 00000001:00080000:0.0:1746066826.802212:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875568 is committed 00000001:00080000:0.0:1746066826.802245:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875550 is committed 00000100:00100000:0.0:1746066826.804834:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5e908e3f-1d55-4d67-a53d-13ae79f314a2+10:2015:x1830882985849600:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5386us (5742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.804851:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21396 00000100:00100000:1.0:1746066826.804879:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+9:2015:x1830882985849216:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5343us (5738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.804912:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21398 00000100:00100000:2.0:1746066826.805367:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2015:x1830882985849728:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5778us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.805375:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21400 00000100:00100000:0.0:1746066826.827199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066826.827274:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985850112 00000100:00100000:3.0:1746066826.827285:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985850112 00000100:00100000:3.0:1746066826.827343:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6635 00000100:00100000:3.0:1746066826.827351:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+25:3952:x1830882985850112:12345-192.168.204.16@tcp:35:umount.0 00000100:00100000:3.0:1746066826.827576:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3952:x1830882985850112:12345-192.168.204.16@tcp:35:umount.0 Request processed in 225us (397us total) trans 8589938010 rc 0/0 00000100:00100000:3.0:1746066826.827582:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6635 00000100:00100000:0.0:1746066826.831222:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.831286:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985850368 00000100:00100000:1.0:1746066826.831295:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985850368 00000100:00100000:1.0:1746066826.831378:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6636 00000100:00100000:1.0:1746066826.831385:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:3952:x1830882985850368:12345-192.168.204.16@tcp:35:umount.0 00000100:00100000:1.0:1746066826.831626:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:3952:x1830882985850368:12345-192.168.204.16@tcp:35:umount.0 Request processed in 240us (410us total) trans 8589938011 rc 0/0 00000100:00100000:1.0:1746066826.831632:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6636 00000100:00100000:0.0:1746066826.837678:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.838414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.838449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066826.838469:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985850624 00000100:00100000:1.0:1746066826.838470:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985850496 00000100:00100000:1.0:1746066826.838477:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985850496 00000100:00100000:0.0:1746066826.838477:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985850624 00000100:00100000:1.0:1746066826.838512:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985850752 00000100:00100000:1.0:1746066826.838514:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985850752 00000100:00100000:0.0:1746066826.838521:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 982 00000100:00100000:1.0:1746066826.838533:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 983 00000100:00100000:1.0:1746066826.838539:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+17:2014:x1830882985850624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066826.838549:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066826.838564:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b46f000/0xf1867c21abfa8155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2145 expref: 17 pid: 8138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066826.838569:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 984 00000100:00100000:3.0:1746066826.838575:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+16:2016:x1830882985850752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066826.838582:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066826.838590:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800962c8000/0xf1867c21abfa815c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d214c expref: 16 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066826.838611:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066826.838616:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2013:x1830882985850496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066826.838621:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066826.838627:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800962c8e00/0xf1867c21abfa814e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2114 expref: 15 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066826.838640:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066826.838645:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2014:x1830882985850624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.838650:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 983 00000100:00100000:0.0:1746066826.838656:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2013:x1830882985850496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.838661:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 982 00010000:00010000:3.0:1746066826.838722:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066826.838755:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+12:2016:x1830882985850752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 180us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.838759:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 984 00000100:00100000:0.0:1746066826.838872:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.838908:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985851264 00000100:00100000:2.0:1746066826.838912:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985851264 00000100:00100000:2.0:1746066826.838935:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21401 00000100:00100000:2.0:1746066826.838940:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2012:x1830882985851264:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746066826.838964:0:3528:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa8178 00000020:00010000:2.0:1746066826.838970:0:3528:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f86e800: total 0 00000100:00080000:2.0:1746066826.838973:0:3528:0:(import.c:66:import_set_state_nolock()) ffff88009f869800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746066826.839005:0:3528:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875575 00000020:00010000:0.0:1746066826.839119:0:7234:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f86e800: total 0 00010000:00010000:0.0:1746066826.839155:0:7234:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f86e800, canceled 0 locks, left on hash table 3. 00000100:00100000:2.0:1746066826.839167:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+6:2012:x1830882985851264:12345-192.168.204.16@tcp:9:umount.0 Request processed in 153us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.839173:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21401 00010000:00010000:0.0:1746066826.839490:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a600/0xf1867c21abfb3b14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c4b expref: 5 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066826.839511:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356a800/0xf1867c21abfb3cb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d86 expref: 4 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066826.839534:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfb380b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a92 expref: 3 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066826.839543:0:7234:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f86e800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746066826.839555:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746066826.839557:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746066826.839558:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066826.854588:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.854840:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985851776 00000100:00100000:2.0:1746066826.854850:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985851776 00000100:00100000:2.0:1746066826.854929:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21402 00000100:00100000:2.0:1746066826.854938:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+8:2012:x1830882985851776:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746066826.854972:0:3528:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa8171 00000020:00010000:2.0:1746066826.854978:0:3528:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f864800: total 0 00000100:00080000:2.0:1746066826.854982:0:3528:0:(import.c:66:import_set_state_nolock()) ffff88009f861800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746066826.855033:0:3528:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474842922 00000100:00100000:2.0:1746066826.855188:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:5e908e3f-1d55-4d67-a53d-13ae79f314a2+6:2012:x1830882985851776:12345-192.168.204.16@tcp:9:umount.0 Request processed in 240us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.855196:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21402 00000020:00010000:3.0:1746066826.855254:0:12257:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f864800: total 0 00010000:00010000:3.0:1746066826.855295:0:12257:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f864800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746066826.855345:0:12257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfb3c9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3313664->4132863) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d6a expref: 5 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.855392:0:12257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dbb400/0xf1867c21abfb3be6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cd0 expref: 4 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.855412:0:12257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629ac00/0xf1867c21abfb3c80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d4e expref: 3 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.855421:0:12257:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f864800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746066826.855432:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066826.855433:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066826.855435:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066826.860243:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066826.860704:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985852160 00000100:00100000:1.0:1746066826.860716:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985852160 00000100:00100000:1.0:1746066826.860783:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17471 00000100:00100000:1.0:1746066826.860790:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+27:2012:x1830882985852160:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:1.0:1746066826.860821:0:7245:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa8163 00000020:00010000:1.0:1746066826.860827:0:7245:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f86b000: total 0 00000100:00080000:1.0:1746066826.860830:0:7245:0:(import.c:66:import_set_state_nolock()) ffff88009f86d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746066826.860855:0:7245:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589938011 00000020:00010000:3.0:1746066826.861017:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f86b000: total 0 00010000:00010000:3.0:1746066826.861023:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066826.861043:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e908e3f-1d55-4d67-a53d-13ae79f314a2+26:2012:x1830882985852160:12345-192.168.204.16@tcp:39:umount.0 Request processed in 252us (811us total) trans 8589938012 rc 0/0 00000100:00100000:1.0:1746066826.861049:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17471 00010000:00010000:3.0:1746066826.861079:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f86b000, canceled 0 locks, left on hash table 6. 00010000:00010000:3.0:1746066826.861119:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066826.861123:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066826.861131:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfb37ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a7d expref: 25 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861161:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066826.861164:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066826.861167:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56400/0xf1867c21abfb3897 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8ae6 expref: 24 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861195:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066826.861197:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066826.861200:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c400/0xf1867c21abfab8ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d3f60 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861211:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066826.861214:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746066826.861217:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310f7e00/0xf1867c21abfa81ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d21f4 expref: 22 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861228:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066826.861230:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746066826.861242:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfab978 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d3fde expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861253:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066826.861255:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066826.861265:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbb200/0xf1867c21abfb3c2c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d0f expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066826.861274:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f86b000, canceled 6 locks, left on hash table 0. 00010000:00010000:3.0:1746066826.861284:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066826.861286:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066826.861288:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066826.868712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066826.869372:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985852288 00000100:00100000:2.0:1746066826.869381:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985852288 00000100:00100000:2.0:1746066826.869433:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17472 00000100:00100000:2.0:1746066826.869441:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+5:2012:x1830882985852288:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:2.0:1746066826.869469:0:10125:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa816a 00000100:00080000:2.0:1746066826.869475:0:10125:0:(import.c:66:import_set_state_nolock()) ffff88009f86f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746066826.869507:0:10125:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977721 00010000:00010000:3.0:1746066826.869669:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066826.870625:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e908e3f-1d55-4d67-a53d-13ae79f314a2+3:2012:x1830882985852288:12345-192.168.204.16@tcp:39:umount.0 Request processed in 1183us (1916us total) trans 4294977722 rc 0/0 00000100:00100000:2.0:1746066826.870632:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17472 00000100:00100000:2.0:1746066826.925427:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830882985271552:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925486:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.925537:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3774:1830882985272064:0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.925544:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882985271296:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925552:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.925563:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985272576:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925582:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066826.925642:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985271424:0@lo:400:kworker.0 00000100:00100000:1.0:1746066826.925694:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271552 00000100:00100000:1.0:1746066826.925700:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271552 00000100:00100000:1.0:1746066826.925736:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272064 00000100:00100000:1.0:1746066826.925737:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272064 00000100:00100000:1.0:1746066826.925758:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1746066826.925763:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882985271552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.925810:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.925814:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746066826.925819:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985271680:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925841:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.925844:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985271808:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925855:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3774:1830882985272192:0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.925864:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.925873:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.925878:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882985272320:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925901:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985272704:0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.925919:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.925923:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.925930:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882985272832:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.925949:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272576 00000100:00100000:2.0:1746066826.925952:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272576 00000100:00100000:2.0:1746066826.925971:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271680 00000100:00100000:2.0:1746066826.925973:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271680 00000100:00100000:2.0:1746066826.925985:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271808 00000100:00100000:2.0:1746066826.925987:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271808 00000100:00100000:2.0:1746066826.925999:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272704 00000100:00100000:2.0:1746066826.926000:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272704 00000100:00100000:2.0:1746066826.926011:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1746066826.926015:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985272576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926041:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985272576:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926047:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1746066826.926058:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1746066826.926061:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882985271680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926075:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882985271680:12345-0@lo:400:kworker.0 Request processed in 14us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926079:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1746066826.926084:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1746066826.926088:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985271808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926102:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882985271808:12345-0@lo:400:kworker.0 Request processed in 14us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926106:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1746066826.926111:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1746066826.926115:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985272704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.926119:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.926131:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882985272704:12345-0@lo:400:kworker.0 Request processed in 16us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926138:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1746066826.926156:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5961880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882985271808:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926161:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882985271680:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926168:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875568 gen 2 00000004:00080000:2.0:1746066826.926172:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0e680, transno 17179875490 00000004:00080000:2.0:1746066826.926204:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0df80, transno 17179875491 00000004:00080000:2.0:1746066826.926207:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0f100, transno 17179875492 00000100:00100000:3.0:1746066826.926209:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272192 00000004:00080000:2.0:1746066826.926209:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0c700, transno 17179875493 00000004:00080000:2.0:1746066826.926211:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0ea00, transno 17179875494 00000004:00080000:2.0:1746066826.926213:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0c380, transno 17179875495 00000100:00100000:3.0:1746066826.926214:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272192 00000004:00080000:2.0:1746066826.926216:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b165c00, transno 17179875496 00000004:00080000:2.0:1746066826.926218:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0ed80, transno 17179875497 00000004:00080000:2.0:1746066826.926220:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0d880, transno 17179875498 00000004:00080000:2.0:1746066826.926222:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b166680, transno 17179875499 00000004:00080000:2.0:1746066826.926224:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b164a80, transno 17179875500 00000004:00080000:2.0:1746066826.926226:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b166a00, transno 17179875501 00000004:00080000:2.0:1746066826.926228:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b164e00, transno 17179875502 00000004:00080000:2.0:1746066826.926230:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d857b80, transno 17179875503 00000004:00080000:2.0:1746066826.926232:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b167480, transno 17179875504 00000004:00080000:2.0:1746066826.926234:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b165180, transno 17179875505 00000004:00080000:2.0:1746066826.926236:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b167800, transno 17179875506 00000004:00080000:2.0:1746066826.926238:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b164000, transno 17179875507 00000004:00080000:2.0:1746066826.926240:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d854700, transno 17179875512 00000100:00100000:3.0:1746066826.926241:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272320 00000004:00080000:2.0:1746066826.926242:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d854a80, transno 17179875513 00000100:00100000:3.0:1746066826.926243:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272320 00000004:00080000:2.0:1746066826.926243:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855f80, transno 17179875514 00000004:00080000:2.0:1746066826.926245:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d854000, transno 17179875515 00000004:00080000:2.0:1746066826.926247:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d857100, transno 17179875516 00000004:00080000:2.0:1746066826.926249:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855880, transno 17179875517 00000004:00080000:2.0:1746066826.926251:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d857800, transno 17179875518 00000004:00080000:2.0:1746066826.926253:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855c00, transno 17179875519 00000004:00080000:2.0:1746066826.926255:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80380, transno 17179875520 00000004:00080000:2.0:1746066826.926258:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b03100, transno 17179875524 00000004:00080000:2.0:1746066826.926260:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00a80, transno 17179875525 00000100:00100000:3.0:1746066826.926262:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272832 00000004:00080000:2.0:1746066826.926262:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01f80, transno 17179875526 00000100:00100000:3.0:1746066826.926263:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272832 00000004:00080000:2.0:1746066826.926264:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00000, transno 17179875527 00000004:00080000:2.0:1746066826.926265:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b00380, transno 17179875528 00000004:00080000:2.0:1746066826.926267:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b02d80, transno 17179875529 00000004:00080000:2.0:1746066826.926269:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b01880, transno 17179875530 00000004:00080000:2.0:1746066826.926271:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b03480, transno 17179875531 00000004:00080000:2.0:1746066826.926272:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925500, transno 17179875532 00000100:00100000:3.0:1746066826.926274:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000004:00080000:2.0:1746066826.926275:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c777b80, transno 17179875539 00000004:00080000:2.0:1746066826.926276:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c775500, transno 17179875540 00000004:00080000:2.0:1746066826.926278:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967aaa00, transno 17179875541 00000100:00100000:3.0:1746066826.926279:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882985272064:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1746066826.926280:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c776680, transno 17179875542 00000004:00080000:2.0:1746066826.926282:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967a8000, transno 17179875543 00000004:00080000:2.0:1746066826.926285:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c777800, transno 17179875544 00000004:00080000:2.0:1746066826.926286:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c776a00, transno 17179875545 00000004:00080000:2.0:1746066826.926288:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967a9c00, transno 17179875546 00000004:00080000:2.0:1746066826.926291:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967a8e00, transno 17179875547 00000004:00080000:2.0:1746066826.926292:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803b80, transno 17179875551 00000004:00080000:2.0:1746066826.926294:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095800380, transno 17179875552 00000004:00080000:2.0:1746066826.926296:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095802300, transno 17179875553 00000004:00080000:2.0:1746066826.926297:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095802680, transno 17179875554 00000004:00080000:2.0:1746066826.926299:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095801180, transno 17179875555 00000004:00080000:2.0:1746066826.926301:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803800, transno 17179875556 00000004:00080000:2.0:1746066826.926303:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803100, transno 17179875557 00000004:00080000:2.0:1746066826.926305:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095800a80, transno 17179875558 00000004:00080000:2.0:1746066826.926306:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c68700, transno 17179875559 00000004:00080000:2.0:1746066826.926308:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e2680, transno 17179875560 00000004:00080000:2.0:1746066826.926311:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e3100, transno 17179875561 00000004:00080000:2.0:1746066826.926313:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e0000, transno 17179875562 00000004:00080000:2.0:1746066826.926315:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0d180, transno 17179875563 00000004:00080000:2.0:1746066826.926317:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c776d80, transno 17179875564 00000004:00080000:2.0:1746066826.926319:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0c000, transno 17179875565 00000004:00080000:2.0:1746066826.926320:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0d500, transno 17179875566 00000004:00080000:2.0:1746066826.926322:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666ca80, transno 17179875567 00000004:00080000:2.0:1746066826.926324:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5b0f800, transno 17179875568 00000100:00100000:2.0:1746066826.926327:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985272704:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926335:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842908 gen 2 00000004:00080000:2.0:1746066826.926337:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8a680, transno 21474842834 00000004:00080000:2.0:1746066826.926342:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88e00, transno 21474842835 00000004:00080000:2.0:1746066826.926344:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8bb80, transno 21474842836 00000004:00080000:2.0:1746066826.926346:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89f80, transno 21474842837 00000004:00080000:2.0:1746066826.926348:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88000, transno 21474842838 00000004:00080000:2.0:1746066826.926350:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8a300, transno 21474842839 00000004:00080000:2.0:1746066826.926351:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89180, transno 21474842840 00000004:00080000:2.0:1746066826.926353:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8b800, transno 21474842841 00000004:00080000:2.0:1746066826.926356:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3480, transno 21474842842 00000004:00080000:2.0:1746066826.926358:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1f80, transno 21474842843 00000004:00080000:2.0:1746066826.926361:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0e00, transno 21474842844 00000004:00080000:2.0:1746066826.926363:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3100, transno 21474842845 00000004:00080000:2.0:1746066826.926365:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3800, transno 21474842846 00000004:00080000:2.0:1746066826.926367:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0380, transno 21474842847 00000004:00080000:2.0:1746066826.926369:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1180, transno 21474842848 00000004:00080000:2.0:1746066826.926371:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011d855180, transno 21474842849 00000004:00080000:2.0:1746066826.926373:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767b80, transno 21474842857 00000004:00080000:2.0:1746066826.926375:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764e00, transno 21474842858 00000004:00080000:2.0:1746066826.926377:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767800, transno 21474842859 00000004:00080000:2.0:1746066826.926380:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764a80, transno 21474842860 00000004:00080000:2.0:1746066826.926382:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765500, transno 21474842861 00000004:00080000:2.0:1746066826.926384:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5766d80, transno 21474842862 00000004:00080000:2.0:1746066826.926386:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765180, transno 21474842863 00000004:00080000:2.0:1746066826.926388:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764380, transno 21474842864 00000004:00080000:2.0:1746066826.926390:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765880, transno 21474842868 00000004:00080000:2.0:1746066826.926391:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5764700, transno 21474842869 00000004:00080000:2.0:1746066826.926393:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5766a00, transno 21474842870 00000004:00080000:2.0:1746066826.926395:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967ab800, transno 21474842871 00000004:00080000:2.0:1746066826.926397:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5765f80, transno 21474842872 00000004:00080000:2.0:1746066826.926399:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800967ab100, transno 21474842873 00000004:00080000:2.0:1746066826.926400:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5767100, transno 21474842874 00000004:00080000:2.0:1746066826.926402:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5766300, transno 21474842875 00000004:00080000:2.0:1746066826.926404:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f55c00, transno 21474842882 00000004:00080000:2.0:1746066826.926406:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f54380, transno 21474842883 00000004:00080000:2.0:1746066826.926408:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e423100, transno 21474842884 00000004:00080000:2.0:1746066826.926409:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89c00, transno 21474842885 00000004:00080000:2.0:1746066826.926411:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f56a00, transno 21474842886 00000004:00080000:2.0:1746066826.926413:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098f57480, transno 21474842887 00000004:00080000:2.0:1746066826.926415:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e423800, transno 21474842888 00000004:00080000:2.0:1746066826.926417:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422300, transno 21474842889 00000004:00080000:2.0:1746066826.926419:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420e00, transno 21474842893 00000004:00080000:2.0:1746066826.926420:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420000, transno 21474842894 00000004:00080000:2.0:1746066826.926422:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421c00, transno 21474842895 00000004:00080000:2.0:1746066826.926424:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421880, transno 21474842896 00000004:00080000:2.0:1746066826.926426:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422d80, transno 21474842897 00000004:00080000:2.0:1746066826.926428:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421f80, transno 21474842898 00000004:00080000:2.0:1746066826.926430:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421500, transno 21474842899 00000004:00080000:2.0:1746066826.926432:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420380, transno 21474842900 00000004:00080000:2.0:1746066826.926433:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4fb80, transno 21474842901 00000004:00080000:2.0:1746066826.926436:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ce00, transno 21474842902 00000004:00080000:2.0:1746066826.926439:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677e680, transno 21474842903 00000004:00080000:2.0:1746066826.926441:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ed80, transno 21474842904 00000004:00080000:2.0:1746066826.926443:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677c380, transno 21474842905 00000004:00080000:2.0:1746066826.926446:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677fb80, transno 21474842906 00000004:00080000:2.0:1746066826.926447:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4f480, transno 21474842907 00000004:00080000:2.0:1746066826.926449:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c4ce00, transno 21474842908 00000100:00100000:2.0:1746066826.926452:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985272576:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926478:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1746066826.926483:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882985272064:12345-0@lo:400:kworker.0 Request processed in 203us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926483:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830882985272192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.926490:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1746066826.926504:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1746066826.926507:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3774:x1830882985272192:12345-0@lo:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.926509:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882985272320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926512:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1746066826.926524:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1746066826.926528:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882985272320:12345-0@lo:400:kworker.0 Request processed in 19us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926529:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882985272832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.926533:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1746066826.926546:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882985272832:12345-0@lo:400:kworker.0 Request processed in 17us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926551:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1746066826.926568:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3774:1830882985272192:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926576:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3774:1830882985272064:0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926608:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271296 00000100:00100000:2.0:1746066826.926611:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271296 00000100:00100000:2.0:1746066826.926626:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1746066826.926630:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882985271296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066826.926648:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882985271296:12345-0@lo:400:kworker.0 Request processed in 18us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.926653:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000004:00080000:3.0:1746066826.926906:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:3.0:1746066826.926926:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882985271296:0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.926935:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882985272320:0@lo:400:kworker.0 00000004:00080000:2.0:1746066826.926941:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 56 done 00000100:00100000:3.0:1746066826.926944:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882985272832:0@lo:400:kworker.0 00000100:00080000:2.0:1746066826.926959:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746066826.926963:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746066826.926965:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746066826.926967:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066826.927062:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066826.927100:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3777:1830882985271936:0@lo:400:kworker.0 00000100:00100000:0.0:1746066826.927116:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066826.927138:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985272448:0@lo:400:kworker.0 00000100:00100000:0.0:1746066826.927151:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.927233:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271424 00000100:00100000:3.0:1746066826.927236:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271424 00000100:00100000:3.0:1746066826.927253:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272448 00000100:00100000:3.0:1746066826.927255:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272448 00000100:00100000:3.0:1746066826.927262:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1746066826.927266:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882985271424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066826.927360:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882985271552:12345-0@lo:400:kworker.0 Request processed in 1597us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.927367:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1746066826.927378:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985271936 00000100:00100000:1.0:1746066826.927381:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985271936 00000100:00100000:1.0:1746066826.927395:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1746066826.927398:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3777:x1830882985271936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.927509:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882985271424:12345-0@lo:400:kworker.0 Request processed in 242us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.927514:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1746066826.927524:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1746066826.927528:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985272448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066826.927557:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3777:x1830882985271936:12345-0@lo:400:kworker.0 Request processed in 158us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066826.927561:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1746066826.927623:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882985271424:0@lo:400:kworker.0 00000100:00100000:0.0:1746066826.927631:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3777:1830882985271936:0@lo:400:kworker.0 00000100:00100000:3.0:1746066826.927661:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985272448:12345-0@lo:400:kworker.0 Request processed in 133us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.927666:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1746066826.927753:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985272448:0@lo:400:kworker.0 00000100:00080000:2.0:1746066826.927856:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066826.927872:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830882985271552:0@lo:400:kworker.0 00000100:00100000:0.0:1746066826.940542:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985272960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066826.940600:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066826.940746:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985272960 00000100:00100000:2.0:1746066826.940754:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985272960 00000100:00100000:2.0:1746066826.940789:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1746066826.940795:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985272960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746066826.940818:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 701823424 pending 0 free 3909910528 avail 3678388224 00000100:00100000:2.0:1746066826.940855:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882985272960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066826.940860:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1746066826.941821:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985272960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066826.956495:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985273216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066826.956548:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.956599:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066826.956604:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985273088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066826.956619:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066826.956642:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985273216 00000100:00100000:3.0:1746066826.956648:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985273216 00000100:00100000:3.0:1746066826.956675:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985273088 00000100:00100000:3.0:1746066826.956676:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985273088 00000100:00100000:3.0:1746066826.956684:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1746066826.956689:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985273216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746066826.956713:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445572608 avail 1316110336 00000100:00100000:3.0:1746066826.956740:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882985273216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.956745:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1746066826.956758:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1746066826.956761:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985273088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746066826.956772:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1445519360 avail 1316057088 00000100:00100000:3.0:1746066826.956788:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882985273088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 27us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066826.956792:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1746066826.956814:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985273088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066826.956820:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985273216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066826.972532:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985273344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746066826.972592:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066826.973621:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985273344 00000100:00100000:0.0:1746066826.973630:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985273344 00000100:00100000:0.0:1746066826.973676:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1746066826.973682:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985273344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066826.973708:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 801910080 pending 0 free 3906187264 avail 3674664960 00000100:00100000:0.0:1746066826.973743:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985273344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066826.973748:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1746066826.973765:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985273344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066827.190381:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.190427:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.190461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.190495:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985852544 00000100:00100000:1.0:1746066827.190504:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985852544 00000100:00100000:1.0:1746066827.190547:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985852672 00000100:00100000:1.0:1746066827.190549:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985852672 00000100:00100000:1.0:1746066827.190560:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985852416 00000100:00100000:1.0:1746066827.190562:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985852416 00000100:00100000:1.0:1746066827.190574:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 985 00000100:00100000:1.0:1746066827.190581:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2014:x1830882985852544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066827.190594:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066827.190609:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b46f200/0xf1867c21abfa817f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d217d expref: 14 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.190637:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066827.190676:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+13:2014:x1830882985852544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.190681:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 986 00000100:00100000:1.0:1746066827.190686:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 985 00000100:00100000:3.0:1746066827.190689:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+13:2013:x1830882985852672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066827.190697:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066827.190700:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 987 00000100:00100000:1.0:1746066827.190704:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+12:2016:x1830882985852416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066827.190705:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b46e000/0xf1867c21abfa818d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d21b5 expref: 12 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.190710:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066827.190718:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b46ea00/0xf1867c21abfa8186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d21ae expref: 11 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.190719:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066827.190725:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066827.190736:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+10:2013:x1830882985852672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.190739:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+10:2016:x1830882985852416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.190741:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 986 00000100:00100000:1.0:1746066827.190744:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 987 00000100:00100000:0.0:1746066827.190799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.190823:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985853312 00000100:00100000:0.0:1746066827.190826:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985853312 00000100:00100000:0.0:1746066827.190868:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21403 00000100:00100000:0.0:1746066827.190874:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+9:2012:x1830882985853312:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:0.0:1746066827.190917:0:20361:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa81a9 00000020:00010000:0.0:1746066827.190923:0:20361:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f86a800: total 0 00000100:00080000:0.0:1746066827.190927:0:20361:0:(import.c:66:import_set_state_nolock()) ffff88009f845000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746066827.190972:0:20361:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875575 00000100:00080000:2.0:1746066827.191026:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066827.191059:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31c94c27-8194-4112-9e80-db222abc766f+7:2012:x1830882985853312:12345-192.168.204.16@tcp:9:umount.0 Request processed in 184us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.191064:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21403 00000020:00010000:1.0:1746066827.191815:0:7234:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f86a800: total 0 00010000:00010000:1.0:1746066827.191863:0:7234:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f86a800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1746066827.191922:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094541e00/0xf1867c21abfab83d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 7360512->7364607) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d3f1a expref: 6 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.191946:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faca00/0xf1867c21abfb3a57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8be9 expref: 5 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.191958:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfb3b5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c67 expref: 4 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.191970:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfab836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3166208->3170303) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d3f13 expref: 3 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.191980:0:7234:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f86a800, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1746066827.191991:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066827.191993:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066827.191994:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066827.196071:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.196195:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985853440 00000100:00100000:2.0:1746066827.196204:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985853440 00000100:00100000:2.0:1746066827.196270:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21404 00000100:00100000:2.0:1746066827.196278:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+5:2012:x1830882985853440:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:2.0:1746066827.196305:0:9592:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa81a2 00000100:00080000:2.0:1746066827.196312:0:9592:0:(import.c:66:import_set_state_nolock()) ffff88009789e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746066827.196361:0:9592:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474842922 00010000:00010000:3.0:1746066827.196412:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746066827.196462:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066827.196599:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31c94c27-8194-4112-9e80-db222abc766f+2:2012:x1830882985853440:12345-192.168.204.16@tcp:9:umount.0 Request processed in 322us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.196605:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21404 00000100:00100000:0.0:1746066827.201379:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.203606:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985853824 00000100:00100000:1.0:1746066827.203618:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985853824 00000100:00100000:1.0:1746066827.203703:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17473 00000100:00100000:1.0:1746066827.203711:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+11:2012:x1830882985853824:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:1.0:1746066827.203745:0:7243:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa8194 00000020:00010000:1.0:1746066827.203751:0:7243:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8801312d3000: total 0 00000100:00080000:1.0:1746066827.203755:0:7243:0:(import.c:66:import_set_state_nolock()) ffff8801312d6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746066827.203778:0:7243:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589938012 00000020:00010000:3.0:1746066827.203843:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8801312d3000: total 0 00000100:00100000:1.0:1746066827.203923:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31c94c27-8194-4112-9e80-db222abc766f+10:2012:x1830882985853824:12345-192.168.204.16@tcp:39:umount.0 Request processed in 212us (2555us total) trans 8589938013 rc 0/0 00000100:00100000:1.0:1746066827.203930:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17473 00010000:00010000:3.0:1746066827.203940:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8801312d3000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746066827.203979:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066827.203983:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746066827.203992:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46e400/0xf1867c21abfa81b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d21e6 expref: 9 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.204026:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066827.204028:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066827.204032:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cc200/0xf1867c21abfb3bae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c9f expref: 8 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.204041:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8801312d3000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746066827.204053:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066827.204054:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066827.204056:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746066827.204112:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066827.209268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.209356:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985853952 00000100:00100000:2.0:1746066827.209365:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985853952 00000100:00100000:2.0:1746066827.209416:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17474 00000100:00100000:2.0:1746066827.209423:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+5:2012:x1830882985853952:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:2.0:1746066827.209460:0:17253:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abfa819b 00000100:00080000:2.0:1746066827.209468:0:17253:0:(import.c:66:import_set_state_nolock()) ffff88009f865000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746066827.209493:0:17253:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977722 00000100:00100000:2.0:1746066827.209602:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31c94c27-8194-4112-9e80-db222abc766f+3:2012:x1830882985853952:12345-192.168.204.16@tcp:39:umount.0 Request processed in 179us (344us total) trans 4294977723 rc 0/0 00000100:00100000:2.0:1746066827.209608:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17474 00010000:00010000:3.0:1746066827.209672:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066827.236681:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.236952:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854080 00000100:00100000:1.0:1746066827.236960:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854080 00000100:00100000:1.0:1746066827.237034:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21405 00000100:00100000:1.0:1746066827.237042:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985854080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066827.237063:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066827.237082:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d8d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066827.237105:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 5073344, mtime: 0x6812dd8b, atime: 0x6812dd8a, ctime: 0x6812dd8b, blocks: 0x16b8 00010000:00010000:1.0:1746066827.237126:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.237128:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.237136:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.237151:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.237166:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419c00, rc 0) 00000100:00100000:1.0:1746066827.237222:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985854080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 182us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.237228:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21405 00000100:00080000:0.0:1746066827.237432:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066827.240258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.240722:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854208 00000100:00100000:2.0:1746066827.240732:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854208 00000100:00100000:2.0:1746066827.240849:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21406 00000100:00100000:2.0:1746066827.240857:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882985854208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066827.240875:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.240922:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d94 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066827.240944:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd8b, atime: 0x6812dd8b, ctime: 0x6812dd8b, blocks: 0x1000 00010000:00010000:2.0:1746066827.240965:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.240967:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.240975:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.240990:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.241004:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428000, rc 0) 00000100:00100000:2.0:1746066827.241045:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882985854208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 189us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.241050:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21406 00000100:00080000:0.0:1746066827.241195:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066827.248713:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.248826:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854464 00000100:00100000:1.0:1746066827.248835:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854464 00000100:00100000:1.0:1746066827.249279:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6637 00000100:00100000:1.0:1746066827.249289:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:3973:x1830882985854464:12345-192.168.204.16@tcp:35:lfs.0 00000100:00080000:0.0:1746066827.249459:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066827.249518:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:3973:x1830882985854464:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 230us (815us total) trans 8589938014 rc 0/0 00000100:00100000:1.0:1746066827.249524:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6637 00000100:00100000:0.0:1746066827.252354:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.252555:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854720 00000100:00100000:1.0:1746066827.252564:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854720 00000100:00100000:1.0:1746066827.253434:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17475 00000100:00100000:1.0:1746066827.253444:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:3973:x1830882985854720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066827.253471:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066827.253474:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746066827.253503:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfb3c56 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d2b expref: 47 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.253524:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b46fa00/0xf1867c21abfab901 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d3f6e expref: 46 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.253533:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066827.253537:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066827.253549:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfb3ccd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8d9b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.253646:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.253658:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.253666:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066827.253676:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00010000:00010000:1.0:1746066827.253767:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfb3ccd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d9b expref: 48 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.253779:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d9b expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.253785:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066827.253788:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066827.253790:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419400, rc 0) 00000100:00100000:1.0:1746066827.253928:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:3973:x1830882985854720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 486us (1583us total) trans 8589938015 rc 0/0 00000100:00100000:1.0:1746066827.253934:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17475 00000100:00100000:0.0:1746066827.259299:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.259339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.259355:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.259660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.259801:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854848 00000100:00100000:3.0:1746066827.259805:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855104 00000100:00100000:1.0:1746066827.259811:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854848 00000100:00100000:3.0:1746066827.259816:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855104 00000100:00100000:1.0:1746066827.259851:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855360 00000100:00100000:1.0:1746066827.259854:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855360 00000100:00100000:3.0:1746066827.259859:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985854976 00000100:00100000:3.0:1746066827.259862:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985854976 00000100:00100000:1.0:1746066827.259872:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21407 00000100:00100000:1.0:1746066827.260119:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985854848:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066827.260181:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.260230:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21408 00000100:00100000:3.0:1746066827.260240:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985855104:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066827.260277:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.260293:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.260300:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.260302:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.260304:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.260334:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.260346:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 20 pid: 12255 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.260358:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985273472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.260429:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066827.260547:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.260668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.260686:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855232 00000100:00100000:0.0:1746066827.260689:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855232 00010000:00010000:1.0:1746066827.260879:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.260901:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.260903:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.260906:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.260933:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.260942:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 29 pid: 20361 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746066827.260953:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985273600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066827.260997:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066827.261013:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855488 00000100:00100000:1.0:1746066827.261016:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855488 00000100:00100000:2.0:1746066827.261231:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21409 00000100:00100000:2.0:1746066827.261247:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985855360:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066827.261271:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261288:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.261295:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.261296:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.261298:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261317:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.261325:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 29 pid: 20361 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.261334:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985273728:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066827.261369:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.261389:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21410 00000100:00100000:2.0:1746066827.261395:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985854976:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066827.261419:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261428:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261433:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.261435:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.261437:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261452:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.261460:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 21 pid: 12233 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746066827.261469:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985273856:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066827.261486:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066827.262341:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21411 00000100:00100000:0.0:1746066827.262352:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985855232:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066827.262381:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.262400:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066827.262407:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.262408:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.262410:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.262431:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066827.262440:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746066827.262450:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985273984:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066827.262504:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066827.262580:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21412 00000100:00100000:1.0:1746066827.262588:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985855488:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066827.262608:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.262619:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.262624:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.262625:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.262627:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.262642:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066827.262650:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 21 pid: 9592 timeout: 895 lvb_type: 1 00000100:00100000:1.0:1746066827.262658:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985274112:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066827.262678:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066827.264323:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985273472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.264344:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.270191:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.270258:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882985273856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.270333:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.270366:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855616 00000100:00100000:3.0:1746066827.270371:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855616 00010000:00010000:3.0:1746066827.270402:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 30 pid: 20361 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.270425:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882985273728:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.270434:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9902 00010000:00010000:2.0:1746066827.270439:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.270440:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882985855616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066827.270452:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066827.270471:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 30 pid: 20361 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.270484:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 30 pid: 20361 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.270503:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419c00/0xf1867c21abfb3cbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d8d expref: 30 pid: 20361 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.270519:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.270520:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.270524:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.270531:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.270546:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066827.270651:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882985274112:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066827.270665:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066827.270684:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882985273600:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.270688:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985855616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 247us (506us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066827.270693:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.270694:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9902 00000100:00100000:3.0:1746066827.270738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066827.270754:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270769:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270784:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270794:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270801:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.270802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.270805:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882985273984:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066827.270807:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e428600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066827.270810:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.270811:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855872 00000100:00100000:3.0:1746066827.270814:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855872 00010000:00010000:0.0:1746066827.270815:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270817:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.270826:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 22 pid: 12255 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.270827:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.270833:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfb3cf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.270845:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.270861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.270964:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985855744 00000100:00100000:3.0:1746066827.270968:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985855744 00000100:00100000:0.0:1746066827.270978:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856000 00010000:00010000:3.0:1746066827.270979:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 23 pid: 9592 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746066827.270981:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856000 00010000:00010000:0.0:1746066827.270993:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 24 pid: 12233 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746066827.270994:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856128 00000100:00100000:3.0:1746066827.270996:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856128 00010000:00010000:3.0:1746066827.271004:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746066827.271006:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9903 00000100:00100000:0.0:1746066827.271011:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985855872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066827.271014:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9904 00000100:00100000:3.0:1746066827.271018:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882985855744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066827.271018:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066827.271025:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066827.271029:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 24 pid: 12255 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.271033:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 24 pid: 9592 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746066827.271038:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 24 pid: 12255 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.271040:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 24 pid: 9592 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746066827.271049:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a7dba400/0xf1867c21abfb3c02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8cde expref: 24 pid: 12255 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.271051:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428000/0xf1867c21abfb3cc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d94 expref: 24 pid: 9592 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.271059:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.271060:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271062:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.271063:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271063:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271066:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271068:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271072:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271084:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066827.271087:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066827.271102:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985855744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.271104:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882985855872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.271107:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9904 00000100:00100000:0.0:1746066827.271111:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9903 00000100:00100000:3.0:1746066827.271118:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9905 00000100:00100000:3.0:1746066827.271122:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985856000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066827.271122:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9906 00000100:00100000:0.0:1746066827.271127:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985856128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066827.271128:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066827.271133:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066827.271140:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 20 pid: 12233 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746066827.271142:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746066827.271149:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746066827.271158:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfb384a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8abc expref: 29 pid: 13726 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746066827.271166:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271181:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271184:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271190:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271202:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066827.271216:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985856128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.271232:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9906 00010000:00010000:0.0:1746066827.271249:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271255:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271264:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 20 pid: 12233 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746066827.271265:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271271:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271275:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfb3c8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d5c expref: 20 pid: 12233 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746066827.271277:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271282:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.271283:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271283:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066827.271285:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271285:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271291:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271291:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271299:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271303:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066827.271305:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfb3cfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.271318:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882985856000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 195us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.271324:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9905 00000100:00100000:0.0:1746066827.271333:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985855232:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8984us (11329us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066827.271338:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.271340:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21411 00010000:00010000:3.0:1746066827.271344:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271355:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271361:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271367:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271372:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e429800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066827.271374:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271380:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.271380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066827.271388:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.271392:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856256 00010000:00010000:3.0:1746066827.271393:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfb3cf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.271395:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856256 00010000:00010000:0.0:1746066827.271405:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 27 pid: 20361 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746066827.271418:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9907 00000100:00100000:0.0:1746066827.271422:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985856256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066827.271424:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985854976:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 10029us (11764us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066827.271427:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066827.271430:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21410 00010000:00010000:0.0:1746066827.271434:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 27 pid: 20361 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746066827.271441:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 27 pid: 20361 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746066827.271447:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271451:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfb3b06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8c3d expref: 27 pid: 20361 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746066827.271454:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271458:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271459:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.271462:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271464:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271469:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271471:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271474:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271478:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066827.271480:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.271481:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066827.271485:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.271493:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.271493:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882985856256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.271498:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9907 00010000:00010000:3.0:1746066827.271499:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b800/0xf1867c21abfb3ce9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.271523:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+17:2016:x1830882985855104:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11286us (12184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.271529:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21408 00010000:00010000:1.0:1746066827.271711:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271718:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271729:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271734:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271740:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271744:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066827.271746:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271752:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271760:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271765:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2400/0xf1867c21abfb3d05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066827.271798:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+16:2016:x1830882985855488:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 9213us (11131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.271804:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21412 00010000:00010000:1.0:1746066827.271818:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271824:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271833:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271838:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271843:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271847:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096a59600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066827.271849:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271854:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271861:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.271866:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a59600/0xf1867c21abfb3ce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066827.271909:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985854848:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12029us (12622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.271915:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21407 00000100:00100000:2.0:1746066827.271996:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985855360:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 10752us (12638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.272003:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21409 00000100:00100000:0.0:1746066827.273755:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.273817:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856512 00000100:00100000:1.0:1746066827.273823:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856512 00000100:00100000:1.0:1746066827.273978:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17476 00000100:00100000:1.0:1746066827.273985:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:3973:x1830882985856512:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066827.274029:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746066827.274048:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57a00/0xf1867c21abfb38ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8aed expref: 47 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.274063:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428c00/0xf1867c21abfb37e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8a6f expref: 46 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.274072:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066827.274076:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066827.274095:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.274104:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.274111:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000040:00080000:1.0:1746066827.274328:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1348, 88 off126224 00000004:00080000:1.0:1746066827.274335:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795485451085ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.274379:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1341, 88 off125520 00000004:00080000:1.0:1746066827.274384:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795485500316ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275026:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1342, 88 off125608 00000004:00080000:1.0:1746066827.275030:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486147214ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275040:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1349, 88 off126312 00000004:00080000:1.0:1746066827.275042:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486158677ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275349:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1350, 88 off126400 00000004:00080000:1.0:1746066827.275353:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486469346ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275360:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1343, 88 off125696 00000004:00080000:1.0:1746066827.275362:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486478357ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275368:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1344, 88 off125784 00000004:00080000:1.0:1746066827.275370:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486486366ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275376:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1345, 88 off125872 00000004:00080000:1.0:1746066827.275378:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486494460ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275383:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1351, 88 off126488 00000004:00080000:1.0:1746066827.275385:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486501615ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275390:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1346, 88 off125960 00000004:00080000:1.0:1746066827.275392:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486508986ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275398:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1352, 88 off126576 00000004:00080000:1.0:1746066827.275399:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486516144ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275405:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1347, 88 off126048 00000004:00080000:1.0:1746066827.275407:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486523470ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.275412:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1353, 88 off126664 00000004:00080000:1.0:1746066827.275414:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486530491ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275419:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1354, 88 off126752 00000004:00080000:1.0:1746066827.275421:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486537729ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275426:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1355, 88 off126840 00000004:00080000:1.0:1746066827.275429:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486545715ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275434:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1356, 88 off126928 00000004:00080000:1.0:1746066827.275436:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795486553066ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.275441:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1348, 88 off126136 00000004:00080000:1.0:1746066827.275444:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795486560635ns, next at 733263917711ns, rc = 0 00000001:00080000:2.0:1746066827.277237:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938016 is committed 00000004:00080000:2.0:1746066827.277245:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1321 committed 00000004:00080000:2.0:1746066827.277370:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1331 committed 00000004:00080000:2.0:1746066827.277387:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1330 committed 00000004:00080000:2.0:1746066827.277388:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1329 committed 00000004:00080000:2.0:1746066827.277390:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1328 committed 00000004:00080000:2.0:1746066827.277392:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1320 committed 00000004:00080000:2.0:1746066827.277393:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1327 committed 00000004:00080000:2.0:1746066827.277394:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1319 committed 00000004:00080000:2.0:1746066827.277395:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1326 committed 00000004:00080000:2.0:1746066827.277397:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1318 committed 00000004:00080000:2.0:1746066827.277398:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1317 committed 00000004:00080000:2.0:1746066827.277399:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1316 committed 00000004:00080000:2.0:1746066827.277400:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1325 committed 00000004:00080000:2.0:1746066827.277402:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1324 committed 00000004:00080000:2.0:1746066827.277403:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1315 committed 00000004:00080000:2.0:1746066827.277404:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1314 committed 00000004:00080000:2.0:1746066827.277406:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1323 committed 00000001:00100000:2.0:1746066827.277413:0:8132:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 31c94c27-8194-4112-9e80-db222abc766f 00000001:00080000:2.0:1746066827.277417:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938013 is committed 00000001:00100000:2.0:1746066827.277422:0:8132:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e908e3f-1d55-4d67-a53d-13ae79f314a2 00000001:00080000:2.0:1746066827.277426:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938012 is committed 00000020:00000080:2.0:1746066827.277452:0:8132:0:(genops.c:904:class_export_put()) final put ffff8801312d3000/31c94c27-8194-4112-9e80-db222abc766f 00000020:00000080:2.0:1746066827.277486:0:8132:0:(genops.c:904:class_export_put()) final put ffff88009f86b000/5e908e3f-1d55-4d67-a53d-13ae79f314a2 00000020:00000080:2.0:1746066827.277508:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff8801312d3000/31c94c27-8194-4112-9e80-db222abc766f for lustre-MDT0000 00000100:00100000:3.0:1746066827.277647:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277703:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.277728:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985275008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277744:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.277759:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066827.277763:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277776:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.277786:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277799:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.277814:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985274624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277828:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.277838:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985275136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.277850:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746066827.277926:0:7243:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b166a00 reply state ffff88009889bc00 transno 8589938016 ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.277941:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.277948:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066827.277951:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066827.277954:0:7243:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746066827.278094:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985275520:0@lo:2:osp-syn-0-0.0 00000020:00000080:2.0:1746066827.278211:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88009f86b000/5e908e3f-1d55-4d67-a53d-13ae79f314a2 for lustre-MDT0000 00000020:00000080:2.0:1746066827.278237:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8801312d6800 for lustre-MDT0000 00000020:00000080:2.0:1746066827.278242:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009f86d000 for lustre-MDT0000 00000100:00100000:2.0:1746066827.278251:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985275392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.278735:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985275648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.278752:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1746066827.278796:0:7243:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066827.278808:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985856512:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 4822us (5055us total) trans 8589938016 rc 0/0 00000100:00100000:1.0:1746066827.278817:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17476 00000100:00100000:1.0:1746066827.278843:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985274240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.279001:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985276160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.279016:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.279046:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274496 00000100:00100000:0.0:1746066827.279052:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274496 00000100:00100000:0.0:1746066827.279083:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21413 00000100:00100000:0.0:1746066827.279091:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275008 00000100:00100000:0.0:1746066827.279093:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275008 00000100:00100000:0.0:1746066827.279105:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274368 00000100:00100000:0.0:1746066827.279107:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274368 00000100:00100000:0.0:1746066827.279121:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274880 00000100:00100000:0.0:1746066827.279123:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274880 00000100:00100000:0.0:1746066827.279133:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274624 00000100:00100000:0.0:1746066827.279134:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274624 00000100:00100000:0.0:1746066827.279143:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275136 00000100:00100000:0.0:1746066827.279145:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275136 00000100:00100000:0.0:1746066827.279150:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275648 00000100:00100000:0.0:1746066827.279151:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275648 00000100:00100000:0.0:1746066827.279159:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21414 00000100:00100000:0.0:1746066827.279163:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882985275008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279293:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985275008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (1547us total) trans 17179875576 rc 0/0 00000100:00100000:0.0:1746066827.279301:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21414 00000100:00100000:0.0:1746066827.279311:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21415 00000100:00100000:0.0:1746066827.279315:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882985274368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279362:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985274368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1586us total) trans 17179875577 rc 0/0 00000100:00100000:0.0:1746066827.279367:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21415 00000100:00100000:0.0:1746066827.279375:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21416 00000100:00100000:0.0:1746066827.279378:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882985274880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279426:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985274880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1625us total) trans 17179875578 rc 0/0 00000100:00100000:0.0:1746066827.279430:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21416 00000100:00100000:0.0:1746066827.279438:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21417 00000100:00100000:0.0:1746066827.279442:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882985274624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279486:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882985274624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (1657us total) trans 17179875579 rc 0/0 00000100:00100000:0.0:1746066827.279491:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21417 00000100:00100000:0.0:1746066827.279498:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21418 00000100:00100000:0.0:1746066827.279502:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882985275136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279547:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882985275136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (1695us total) trans 17179875580 rc 0/0 00000100:00100000:0.0:1746066827.279552:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21418 00000100:00100000:0.0:1746066827.279560:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21419 00000100:00100000:0.0:1746066827.279563:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882985275648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.279623:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3776:x1830882985275648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (870us total) trans 21474842923 rc 0/0 00000100:00100000:0.0:1746066827.279628:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21419 00000100:00100000:0.0:1746066827.279649:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882985274496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.279699:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882985274496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 611us (1996us total) trans 17179875581 rc 0/0 00000100:00100000:0.0:1746066827.279703:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21413 00010000:00010000:1.0:1746066827.280125:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280135:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280142:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280147:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f3200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066827.280151:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280158:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280181:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:1.0:1746066827.280185:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066827.280188:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066827.280194:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d0c lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066827.280606:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276160 00000100:00100000:2.0:1746066827.280612:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276160 00000100:00100000:2.0:1746066827.280632:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21420 00000100:00100000:2.0:1746066827.280637:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3776:x1830882985276160:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066827.280683:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea35f80/2, rc 0, transno 17179875579 00000100:00100000:3.0:1746066827.280692:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985274624:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066827.280701:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967aaa00/2, rc 0, transno 17179875580 00000100:00100000:3.0:1746066827.280703:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985275136:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066827.280716:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165180/2, rc 0, transno 21474842923 00000100:00100000:2.0:1746066827.280721:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3776:x1830882985276160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1704us total) trans 21474842924 rc 0/0 00000100:00100000:3.0:1746066827.280730:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985275648:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066827.280737:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165880/2, rc 0, transno 21474842924 00000100:00100000:3.0:1746066827.280740:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985276160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.280785:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066827.280791:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985276288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.280810:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.280829:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276288 00000100:00100000:3.0:1746066827.280831:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276288 00000100:00100000:2.0:1746066827.281098:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21420 00000100:00100000:1.0:1746066827.281106:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066827.281112:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275392 00000100:00100000:2.0:1746066827.281115:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275392 00000100:00100000:1.0:1746066827.281125:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985275904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.281128:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21421 00000100:00100000:2.0:1746066827.281133:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3774:x1830882985275392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.281143:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.281164:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275904 00000100:00100000:1.0:1746066827.281167:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275904 00000100:00100000:1.0:1746066827.281195:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21422 00000100:00100000:1.0:1746066827.281200:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3774:x1830882985275904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.281216:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3774:x1830882985275392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (109us total) trans 21474842925 rc 0/0 00000100:00100000:2.0:1746066827.281221:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21421 00000004:00080000:2.0:1746066827.281240:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164a80/2, rc 0, transno 21474842925 00000100:00100000:2.0:1746066827.281243:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985275392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.281263:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3774:x1830882985275904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (118us total) trans 21474842926 rc 0/0 00000100:00100000:1.0:1746066827.281268:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21422 00000004:00080000:2.0:1746066827.281281:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164000/2, rc 0, transno 21474842926 00000100:00100000:2.0:1746066827.281284:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985275904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.281286:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.281298:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985274752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.281313:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.281322:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274240 00000100:00100000:1.0:1746066827.281324:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274240 00000100:00100000:1.0:1746066827.281334:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985274752 00000100:00100000:1.0:1746066827.281336:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985274752 00000100:00100000:1.0:1746066827.281353:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21423 00000100:00100000:1.0:1746066827.281357:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985274240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066827.281379:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21424 00000100:00100000:2.0:1746066827.281384:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882985274752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.281417:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882985274240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (130us total) trans 17179875582 rc 0/0 00000100:00100000:1.0:1746066827.281421:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21423 00000100:00100000:1.0:1746066827.281437:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985275264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.281443:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882985274752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (129us total) trans 17179875583 rc 0/0 00000100:00100000:2.0:1746066827.281448:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21424 00000100:00100000:1.0:1746066827.281453:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066827.281461:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275264 00000100:00100000:1.0:1746066827.281463:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985275776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.281464:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275264 00000100:00100000:1.0:1746066827.281475:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066827.281480:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275776 00000100:00100000:2.0:1746066827.281481:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275776 00000100:00100000:1.0:1746066827.281486:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21425 00000100:00100000:1.0:1746066827.281490:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882985275264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.281493:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21426 00000100:00100000:2.0:1746066827.281497:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882985275776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.281540:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882985275264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (86us total) trans 21474842927 rc 0/0 00000100:00100000:1.0:1746066827.281545:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21425 00000100:00100000:2.0:1746066827.281554:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882985275776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (77us total) trans 21474842928 rc 0/0 00000100:00100000:2.0:1746066827.281559:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21426 00000004:00080000:1.0:1746066827.281564:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b167800/2, rc 0, transno 21474842928 00000100:00100000:1.0:1746066827.281568:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985275776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066827.281578:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d7ea00/2, rc 0, transno 17179875582 00000100:00100000:1.0:1746066827.281580:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985274240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.281737:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21427 00000100:00100000:3.0:1746066827.281743:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882985276288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.281802:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882985276288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (991us total) trans 17179875584 rc 0/0 00000100:00100000:3.0:1746066827.281807:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21427 00000004:00080000:3.0:1746066827.281828:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011d855180/2, rc 0, transno 17179875584 00000100:00100000:3.0:1746066827.281831:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985276288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066827.282118:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066827.282136:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985276032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.282153:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.282515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.282537:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856640 00000100:00100000:0.0:1746066827.282540:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856640 00000100:00100000:0.0:1746066827.282563:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17477 00000100:00100000:0.0:1746066827.282567:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:3973:x1830882985856640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066827.282580:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066827.282593:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8da2 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.282632:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.282642:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.282656:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066827.282659:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066827.282661:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfa00, rc 0) 00000100:00100000:0.0:1746066827.282688:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985856640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 120us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.282696:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17477 00000004:00080000:1.0:1746066827.282850:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80380/2, rc 0, transno 17179875583 00000100:00100000:1.0:1746066827.282855:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985274752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066827.282868:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164e00/2, rc 0, transno 21474842927 00000100:00100000:1.0:1746066827.282871:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882985275264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.283333:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985275520 00000100:00100000:3.0:1746066827.283337:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985275520 00000100:00100000:3.0:1746066827.283353:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985276032 00000100:00100000:3.0:1746066827.283355:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985276032 00000004:00080000:2.0:1746066827.283355:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea36680/2, rc 0, transno 17179875577 00000100:00100000:2.0:1746066827.283358:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066827.283365:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21428 00000004:00080000:2.0:1746066827.283366:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967ab800/2, rc 0, transno 17179875578 00000100:00100000:3.0:1746066827.283369:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985275520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.283369:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274880:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066827.283376:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea36a00/2, rc 0, transno 17179875581 00000100:00100000:2.0:1746066827.283379:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985274496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066827.283386:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967ab100/2, rc 0, transno 17179875576 00000100:00100000:2.0:1746066827.283388:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985275008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066827.283405:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21429 00000100:00100000:2.0:1746066827.283412:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882985276032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.283464:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882985275520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1346us total) trans 21474842929 rc 0/0 00000100:00100000:3.0:1746066827.283469:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21428 00000004:00080000:2.0:1746066827.283472:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b167480/2, rc 0, transno 21474842929 00000100:00100000:2.0:1746066827.283476:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985275520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.283509:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882985276032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1356us total) trans 21474842930 rc 0/0 00000100:00100000:2.0:1746066827.283515:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21429 00000004:00080000:3.0:1746066827.283522:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b164700/2, rc 0, transno 21474842930 00000100:00100000:3.0:1746066827.283526:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985276032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.286197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.286342:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856768 00000100:00100000:0.0:1746066827.286351:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856768 00000100:00100000:0.0:1746066827.286397:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17478 00000100:00100000:0.0:1746066827.286405:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985856768:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066827.286420:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066827.286434:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3d1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8da9 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.286532:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.286543:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.286553:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066827.286577:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x59:0x0]: returning size 9267648 00000004:00200000:0.0:1746066827.286580:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066827.286591:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.286611:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfb3d1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da9 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.286622:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da9 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.286628:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066827.286631:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066827.286634:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00000100:00100000:0.0:1746066827.286682:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:3973:x1830882985856768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 278us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.286687:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17478 00000100:00100000:0.0:1746066827.289286:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.289455:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.289508:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.289592:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.289859:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985856896 00000100:00100000:0.0:1746066827.289871:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.289872:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985856896 00000100:00100000:0.0:1746066827.289928:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.290208:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857152 00000100:00100000:2.0:1746066827.290208:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857024 00000100:00100000:3.0:1746066827.290210:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857152 00000100:00100000:2.0:1746066827.290215:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857024 00000100:00100000:3.0:1746066827.290228:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857280 00000100:00100000:3.0:1746066827.290230:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857280 00000100:00100000:2.0:1746066827.290230:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857408 00000100:00100000:2.0:1746066827.290232:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857408 00000100:00100000:3.0:1746066827.290241:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857536 00000100:00100000:3.0:1746066827.290243:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857536 00000100:00100000:3.0:1746066827.290259:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21430 00000100:00100000:2.0:1746066827.290267:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21431 00000100:00100000:3.0:1746066827.290271:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985856896:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066827.290275:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985857152:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.290291:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.290291:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.290307:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dbe expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.290308:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8db0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066827.290325:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa2:0x0] initial LVB size: 2097152, mtime: 0x6812dd8a, atime: 0x6812dd89, ctime: 0x6812dd8a, blocks: 0x800 00002000:00010000:3.0:1746066827.290326:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7f:0x0] initial LVB size: 1048576, mtime: 0x6812dd8a, atime: 0x6812dd89, ctime: 0x6812dd8a, blocks: 0x800 00010000:00010000:2.0:1746066827.290340:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.290341:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290342:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.290343:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290349:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.290351:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290361:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.290364:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290370:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428c00, rc 0) 00010000:00010000:3.0:1746066827.290378:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b800, rc 0) 00000100:00100000:2.0:1746066827.290406:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985857152:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 133us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.290412:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21431 00000100:00100000:3.0:1746066827.290416:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985856896:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 150us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.290422:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21430 00000100:00100000:2.0:1746066827.290429:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21432 00000100:00100000:2.0:1746066827.290434:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985857280:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066827.290437:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21433 00010000:00010000:2.0:1746066827.290441:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066827.290442:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985857536:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.290448:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.290450:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dc5 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.290457:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dd3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066827.290461:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x81:0x0] initial LVB size: 2097152, mtime: 0x6812dd89, atime: 0x6812dd89, ctime: 0x6812dd89, blocks: 0x800 00002000:00010000:3.0:1746066827.290467:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa3:0x0] initial LVB size: 4194304, mtime: 0x6812dd8b, atime: 0x6812dd8b, ctime: 0x6812dd8b, blocks: 0x1000 00010000:00010000:2.0:1746066827.290469:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290471:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290474:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.290480:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.290482:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290483:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.290486:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290489:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429800, rc 0) 00010000:00010000:3.0:1746066827.290495:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.290502:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:2.0:1746066827.290508:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985857280:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 73us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.290513:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21432 00000100:00100000:3.0:1746066827.290517:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985857536:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 75us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.290522:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21433 00000100:00100000:2.0:1746066827.290527:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21434 00000100:00100000:2.0:1746066827.290531:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882985857408:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066827.290536:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.290543:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dcc expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066827.290552:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x82:0x0] initial LVB size: 5073344, mtime: 0x6812dd8b, atime: 0x6812dd8a, ctime: 0x6812dd8b, blocks: 0x16b8 00010000:00010000:2.0:1746066827.290559:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290560:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290563:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290571:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290577:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428000, rc 0) 00000100:00100000:2.0:1746066827.290593:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985857408:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.290598:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21434 00000100:00100000:2.0:1746066827.290623:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21435 00000100:00100000:2.0:1746066827.290628:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882985857024:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066827.290633:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.290640:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8db7 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066827.290650:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0xa1:0x0] initial LVB size: 2097152, mtime: 0x6812dd8a, atime: 0x6812dd8a, ctime: 0x6812dd8a, blocks: 0x808 00010000:00010000:2.0:1746066827.290669:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290671:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.290674:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290682:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.290689:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31a00, rc 0) 00000100:00100000:2.0:1746066827.290718:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985857024:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 89us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.290723:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21435 00000100:00100000:2.0:1746066827.295303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.295345:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.295372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.295385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.295394:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857664 00000100:00100000:2.0:1746066827.295396:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.295403:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857664 00000100:00100000:2.0:1746066827.295418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.295443:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857920 00000100:00100000:2.0:1746066827.295446:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857920 00000100:00100000:2.0:1746066827.295464:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858176 00000100:00100000:2.0:1746066827.295466:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858176 00000100:00100000:3.0:1746066827.295470:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985857792 00000100:00100000:0.0:1746066827.295471:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858048 00000100:00100000:3.0:1746066827.295473:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985857792 00000100:00100000:0.0:1746066827.295474:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858048 00000100:00100000:2.0:1746066827.295480:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858304 00000100:00100000:2.0:1746066827.295482:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858304 00000100:00100000:3.0:1746066827.295486:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21436 00000100:00100000:3.0:1746066827.295493:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985857664:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066827.295500:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21437 00000100:00100000:2.0:1746066827.295510:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21438 00000100:00100000:0.0:1746066827.295510:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985857920:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066827.295514:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985858176:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066827.295555:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21439 00000100:00100000:1.0:1746066827.295560:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985858048:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066827.295576:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985857664:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.295576:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882985858176:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.295582:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21436 00000100:00100000:2.0:1746066827.295584:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21438 00000100:00100000:3.0:1746066827.295594:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21440 00000100:00100000:1.0:1746066827.295594:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882985858048:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.295598:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985858304:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066827.295599:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21439 00000100:00100000:3.0:1746066827.295624:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882985858304:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 25us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.295628:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21440 00000100:00100000:3.0:1746066827.295650:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21441 00000100:00100000:3.0:1746066827.295654:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985857792:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066827.295671:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985857920:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 165us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.295676:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21437 00000100:00100000:3.0:1746066827.295680:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+20:2014:x1830882985857792:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.295684:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21441 00000100:00100000:0.0:1746066827.298949:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.298983:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.299007:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.299025:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.299043:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858432 00000100:00100000:0.0:1746066827.299049:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858432 00000100:00100000:0.0:1746066827.299076:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858560 00000100:00100000:0.0:1746066827.299078:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858560 00000100:00100000:1.0:1746066827.299083:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858816 00000100:00100000:0.0:1746066827.299087:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858688 00000100:00100000:1.0:1746066827.299088:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858816 00000100:00100000:0.0:1746066827.299088:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858688 00000100:00100000:0.0:1746066827.299099:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21442 00000100:00100000:3.0:1746066827.299205:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21443 00000100:00100000:3.0:1746066827.299211:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985858560:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066827.299219:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21444 00000100:00100000:1.0:1746066827.299226:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985858688:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066827.299267:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21445 00000100:00100000:2.0:1746066827.299273:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985858816:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066827.299295:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985858688:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.299301:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21444 00000100:00100000:3.0:1746066827.299317:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985858560:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.299321:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21443 00000100:00100000:3.0:1746066827.299351:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.299368:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985858944 00000100:00100000:1.0:1746066827.299371:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985858944 00000100:00100000:1.0:1746066827.299386:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21446 00000100:00100000:1.0:1746066827.299390:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985858944:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066827.299392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.299402:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985859072 00000100:00100000:3.0:1746066827.299404:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985859072 00000100:00100000:3.0:1746066827.299416:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21447 00000100:00100000:3.0:1746066827.299420:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985859072:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066827.299430:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985858944:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 39us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066827.299435:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21446 00000100:00100000:3.0:1746066827.299451:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985859072:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 30us (57us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.299456:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21447 00000100:00100000:0.0:1746066827.299470:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985858432:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066827.299503:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985858432:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 398us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.299507:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21442 00000100:00100000:2.0:1746066827.299565:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985858816:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 292us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.299570:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21445 00000100:00100000:0.0:1746066827.304536:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.304628:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.305421:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985859328 00000100:00100000:2.0:1746066827.305431:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985859328 00000100:00100000:2.0:1746066827.305492:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985859584 00000100:00100000:2.0:1746066827.305495:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985859584 00000100:00100000:0.0:1746066827.305517:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8189 00000100:00100000:2.0:1746066827.305526:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8190 00000100:00100000:0.0:1746066827.305528:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985859328:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:2.0:1746066827.305532:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985859584:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066827.305556:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.305556:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.305567:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.305567:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.305569:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.305569:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.305573:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.305573:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.305583:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.305584:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.307531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.307564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.307610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.307657:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985859968 00000100:00100000:2.0:1746066827.307662:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985859968 00000100:00100000:2.0:1746066827.307699:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985860096 00000100:00100000:2.0:1746066827.307701:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985860096 00000100:00100000:1.0:1746066827.307702:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985860352 00000100:00100000:1.0:1746066827.307706:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985860352 00000100:00100000:2.0:1746066827.307717:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8191 00000100:00100000:2.0:1746066827.307723:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985859968:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:1.0:1746066827.307731:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8192 00000100:00100000:1.0:1746066827.307736:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985860096:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066827.307746:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.307752:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.307755:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.307757:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.307760:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.307760:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.307761:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.307764:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.307769:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.307772:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.307945:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8193 00000100:00100000:0.0:1746066827.307952:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985860352:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066827.307966:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.307978:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.307979:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.307982:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.307989:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.309337:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.309368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.309411:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.309427:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985860608 00000100:00100000:0.0:1746066827.309432:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985860608 00000100:00100000:0.0:1746066827.309468:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985860864 00000100:00100000:0.0:1746066827.309471:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985860864 00000100:00100000:0.0:1746066827.309485:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861120 00000100:00100000:0.0:1746066827.309486:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861120 00000100:00100000:1.0:1746066827.309634:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8194 00000100:00100000:1.0:1746066827.309641:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882985860608:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066827.309668:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.309676:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.309678:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066827.309681:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.309688:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.309739:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8195 00000100:00100000:0.0:1746066827.309745:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985860864:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066827.309759:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.309766:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.309767:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066827.309770:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.309777:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.310123:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 8196 00000100:00100000:3.0:1746066827.310131:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882985861120:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066827.310144:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/1,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.310152:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.310153:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.310155:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.310181:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317906:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317921:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317928:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317933:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066827.317937:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317944:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317960:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.317966:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfb3d59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.318046:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882985859328:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 12517us (13514us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066827.318056:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8189 00010000:00010000:3.0:1746066827.324209:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324224:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324232:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324238:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d31200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066827.324242:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324249:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324264:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.324269:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.324348:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882985859584:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18811us (19716us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066827.324358:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8190 00010000:00010000:2.0:1746066827.328196:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328216:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328223:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328229:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a22a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066827.328233:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328239:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328254:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.328259:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfb3d60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.328343:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985859968:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20617us (20815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066827.328352:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8191 00010000:00010000:1.0:1746066827.335368:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335379:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335384:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335387:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f3200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066827.335390:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335395:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335409:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.335413:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfb3d67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066827.335505:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985860096:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 27765us (27937us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066827.335512:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8192 00010000:00010000:2.0:1746066827.337739:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337751:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337766:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337772:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098890200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066827.337776:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337782:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337797:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.337802:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098890200/0xf1867c21abfb3d6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.337880:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985860352:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 29925us (30265us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066827.337908:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8193 00010000:00010000:1.0:1746066827.341636:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341650:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341658:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341664:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800964b0000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066827.341668:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341679:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341697:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.341708:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800964b0000/0xf1867c21abfb3d75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066827.341794:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985860608:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 32149us (32457us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066827.341804:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8194 00010000:00010000:0.0:1746066827.344781:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344795:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344801:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344807:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b46e000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066827.344810:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344816:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344829:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.344835:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b46e000/0xf1867c21abfb3d7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.345214:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985860864:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 35464us (35841us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066827.345223:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8195 00010000:00010000:3.0:1746066827.345532:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345547:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345554:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345561:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e428e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066827.345565:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345572:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345587:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.345593:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428e00/0xf1867c21abfb3d83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.345687:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985861120:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 35554us (36272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066827.345696:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 8196 00000100:00100000:0.0:1746066827.351503:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.351564:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861376 00000100:00100000:2.0:1746066827.351573:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861376 00000100:00100000:2.0:1746066827.352142:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17479 00000100:00100000:2.0:1746066827.352151:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:3973:x1830882985861376:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066827.352199:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.352224:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfb3d21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da9 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.352253:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066827.352256:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066827.352302:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.352312:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.352319:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00010000:2.0:1746066827.352398:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5b0f800 reply state ffff880129ea3000 transno 8589938017 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.352406:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.352411:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066827.352413:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746066827.352416:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066827.352483:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:3973:x1830882985861376:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 334us (986us total) trans 8589938017 rc 0/0 00000100:00100000:2.0:1746066827.352488:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17479 00000100:00100000:0.0:1746066827.354406:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.354619:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861504 00000100:00100000:3.0:1746066827.354627:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861504 00000100:00100000:3.0:1746066827.354665:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21448 00000100:00100000:3.0:1746066827.354670:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:3973:x1830882985861504:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.354684:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066827.354698:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dda expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.354721:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.354727:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.354728:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.354730:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dda expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.354753:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.354762:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.354771:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985276416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.354858:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066827.356249:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985276416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.356273:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dda expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.356284:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428400, rc 0) 00000100:00100000:3.0:1746066827.356318:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985861504:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1649us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.356324:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21448 00000100:00100000:0.0:1746066827.356645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.356714:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861632 00000100:00100000:3.0:1746066827.356719:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861632 00010000:00010000:3.0:1746066827.356740:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.356763:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9908 00000100:00100000:3.0:1746066827.356770:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985861632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066827.356783:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066827.356982:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.356999:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.357020:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfb3d2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db0 expref: 28 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746066827.357044:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.357046:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.357052:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dda expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.357059:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dda expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.357082:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfb3d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dda expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.357093:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985276544:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066827.357154:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066827.358784:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.358841:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861760 00000100:00100000:2.0:1746066827.358848:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861760 00000100:00100000:3.0:1746066827.358877:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d855f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985276544:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.358904:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21449 00000100:00100000:2.0:1746066827.358910:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:3973:x1830882985861760:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.358912:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066827.358925:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066827.358938:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8de1 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066827.358945:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985861632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2176us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.358952:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9908 00010000:00010000:2.0:1746066827.358959:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.358965:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.358967:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.358970:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de1 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.358993:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066827.359003:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.359013:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985276672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066827.359133:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.360231:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985276672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066827.360248:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de1 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.360257:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31200, rc 0) 00000100:00100000:2.0:1746066827.360295:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:3973:x1830882985861760:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1384us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.360300:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21449 00000100:00100000:3.0:1746066827.360629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.360978:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985861888 00000100:00100000:2.0:1746066827.360983:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985861888 00010000:00010000:2.0:1746066827.360999:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.361164:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9909 00000100:00100000:2.0:1746066827.361179:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882985861888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.361231:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.361246:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.361256:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.361272:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31a00/0xf1867c21abfb3d4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8db7 expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.361282:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.361284:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.361288:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de1 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.361295:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de1 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.361312:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d31200/0xf1867c21abfb3d98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de1 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.361320:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985276800:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.361735:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.364101:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985276800:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066827.364107:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066827.364118:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066827.364151:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882985861888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2972us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.364160:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9909 00000100:00100000:3.0:1746066827.364266:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862016 00000100:00100000:3.0:1746066827.364271:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862016 00000100:00100000:3.0:1746066827.364299:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21450 00000100:00100000:3.0:1746066827.364305:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:3973:x1830882985862016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.364318:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066827.364330:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8de8 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.364353:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.364359:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.364360:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.364364:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de8 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.364389:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.364400:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.364409:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985276928:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.364459:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066827.365689:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985276928:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.365706:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de8 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066827.365718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066827.365721:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d2000, rc 0) 00000100:00100000:3.0:1746066827.365745:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:3973:x1830882985862016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1440us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.365750:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21450 00000100:00100000:2.0:1746066827.365842:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862144 00000100:00100000:2.0:1746066827.365847:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862144 00010000:00010000:2.0:1746066827.365867:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.365917:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9910 00000100:00100000:2.0:1746066827.365923:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985862144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.365932:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.365947:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.365956:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.365972:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428c00/0xf1867c21abfb3d28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dbe expref: 20 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.365982:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.365984:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.365988:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de8 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.366000:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de8 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.366021:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfb3d9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8de8 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.366030:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985277056:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.366089:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066827.367440:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.367481:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862272 00000100:00100000:3.0:1746066827.367485:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862272 00000100:00100000:3.0:1746066827.367510:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21451 00000100:00100000:3.0:1746066827.367515:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:3973:x1830882985862272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.367526:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066827.367537:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8def expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.367553:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.367559:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.367560:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.367563:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8def expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.367579:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.367588:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.367602:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985277184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.368095:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.368343:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985277056:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066827.368355:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066827.368621:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882985862144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2697us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.368629:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9910 00000100:00100000:3.0:1746066827.369298:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985277184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.369314:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8def expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.369326:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3600, rc 0) 00000100:00100000:3.0:1746066827.369482:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985862272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1965us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.369487:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21451 00000100:00100000:0.0:1746066827.369596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.369747:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862400 00000100:00100000:2.0:1746066827.369753:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862400 00010000:00010000:2.0:1746066827.369771:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.369798:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9911 00000100:00100000:2.0:1746066827.369804:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985862400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.369812:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.369828:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.369844:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.369861:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfb3d36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dc5 expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.369872:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.369873:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.369878:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8def expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.369904:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8def expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.369925:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3600/0xf1867c21abfb3da6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8def expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.369934:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985277312:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.369987:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.370969:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985277312:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066827.370985:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066827.371015:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985862400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1210us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.371022:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9911 00000100:00100000:0.0:1746066827.371075:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.371180:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862528 00000100:00100000:3.0:1746066827.371184:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862528 00000100:00100000:3.0:1746066827.371203:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21452 00000100:00100000:3.0:1746066827.371208:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:3973:x1830882985862528:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.371218:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066827.371232:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8df6 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.371248:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.371254:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.371255:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.371258:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8df6 expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.371278:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.371288:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.371297:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985277440:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.371526:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066827.373536:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882985277440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.373556:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8df6 expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.373569:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6a00, rc 0) 00000100:00100000:3.0:1746066827.373672:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:3973:x1830882985862528:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2462us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.373679:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21452 00000100:00100000:0.0:1746066827.374056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.374510:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862656 00000100:00100000:2.0:1746066827.374515:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862656 00010000:00010000:2.0:1746066827.374535:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.374552:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9912 00000100:00100000:2.0:1746066827.374557:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882985862656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.374566:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.374582:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.374590:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.374608:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428000/0xf1867c21abfb3d44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dcc expref: 28 pid: 1893 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.374771:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.374773:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.374779:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8df6 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.374786:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8df6 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.374809:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acda6a00/0xf1867c21abfb3dad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8df6 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.374818:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985277568:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.375209:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.376922:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882985277568:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066827.376938:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066827.376966:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882985862656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2408us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.376974:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9912 00000100:00100000:0.0:1746066827.378372:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.378658:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862784 00000100:00100000:3.0:1746066827.378666:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862784 00000100:00100000:3.0:1746066827.378699:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21453 00000100:00100000:3.0:1746066827.378706:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:3973:x1830882985862784:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066827.378720:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066827.378734:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8dfd expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.378762:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.378769:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.378770:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066827.378773:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dfd expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.378799:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066827.378809:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746066827.378820:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985277696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066827.378942:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800967c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066827.380396:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011d854000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882985277696:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066827.380416:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dfd expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066827.380426:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6200, rc 0) 00000100:00100000:3.0:1746066827.380458:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:3973:x1830882985862784:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1752us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066827.380465:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21453 00000100:00100000:0.0:1746066827.380938:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.380993:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985862912 00000100:00100000:2.0:1746066827.380999:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985862912 00010000:00010000:2.0:1746066827.381021:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746066827.381050:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9913 00000100:00100000:2.0:1746066827.381055:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882985862912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.381064:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.381080:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.381089:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.381105:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a000/0xf1867c21abfb3d3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dd3 expref: 20 pid: 13363 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746066827.381121:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.381123:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066827.381128:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dfd expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.381138:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dfd expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.381160:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfb3db4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8dfd expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066827.381181:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985277824:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066827.381242:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066827.383147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.383188:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.383228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.383521:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863040 00000100:00100000:3.0:1746066827.383528:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863040 00000100:00100000:2.0:1746066827.383536:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863168 00000100:00100000:2.0:1746066827.383540:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863168 00000100:00100000:3.0:1746066827.383557:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863296 00000100:00100000:3.0:1746066827.383559:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863296 00000100:00100000:2.0:1746066827.383563:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21454 00000100:00100000:2.0:1746066827.383569:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882985863040:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066827.383573:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21455 00000100:00100000:3.0:1746066827.383578:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882985863168:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066827.383670:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066827.383670:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066827.383673:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066826 -> 1746066827 00002000:00010000:2.0:1746066827.383673:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066826 -> 1746066827 00002000:00010000:3.0:1746066827.383675:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066826 -> 1746066827 00002000:00010000:2.0:1746066827.383675:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066825 -> 1746066827 00002000:00010000:3.0:1746066827.383677:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066826 -> 1746066828 00002000:00010000:2.0:1746066827.383677:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066826 -> 1746066828 00002000:00010000:3.0:1746066827.383679:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746066827.383679:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066827.383722:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882985863040:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 152us (578us total) trans 17179875585 rc 0/0 00000100:00100000:2.0:1746066827.383728:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21454 00000100:00100000:1.0:1746066827.383738:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21456 00000100:00100000:1.0:1746066827.383745:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985863296:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066827.383789:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066827.383791:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066826 -> 1746066827 00002000:00010000:1.0:1746066827.383793:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066825 -> 1746066827 00002000:00010000:1.0:1746066827.383795:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066826 -> 1746066828 00002000:00010000:1.0:1746066827.383796:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066827.383816:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985863296:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 72us (588us total) trans 21474842932 rc 0/0 00000100:00100000:1.0:1746066827.383821:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21456 00000100:00100000:3.0:1746066827.383994:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985863168:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 415us (805us total) trans 21474842931 rc 0/0 00000100:00100000:3.0:1746066827.384003:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21455 00000100:00100000:2.0:1746066827.384133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.384161:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.384180:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863424 00000100:00100000:1.0:1746066827.384184:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863424 00000100:00100000:2.0:1746066827.384192:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.384232:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863552 00000100:00100000:1.0:1746066827.384234:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863552 00000100:00100000:1.0:1746066827.384245:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863680 00000100:00100000:1.0:1746066827.384247:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863680 00000100:00100000:1.0:1746066827.384303:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21457 00000100:00100000:1.0:1746066827.384309:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985863424:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066827.384351:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066827.384354:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066825 -> 1746066827 00002000:00010000:1.0:1746066827.384355:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066825 -> 1746066827 00002000:00010000:1.0:1746066827.384357:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066825 -> 1746066828 00002000:00010000:1.0:1746066827.384359:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066827.384404:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21458 00000100:00100000:2.0:1746066827.384410:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985863552:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066827.384451:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:2.0:1746066827.384453:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:2.0:1746066827.384455:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066826 -> 1746066827 00002000:00010000:2.0:1746066827.384456:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066827 -> 1746066828 00002000:00010000:2.0:1746066827.384458:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:0.0:1746066827.384566:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882985277824:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066827.384583:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066827.384618:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 21459 00000100:00100000:3.0:1746066827.384625:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985863680:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066827.384664:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066827.384666:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:3.0:1746066827.384668:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:3.0:1746066827.384669:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066827 -> 1746066828 00002000:00010000:3.0:1746066827.384671:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066827.384706:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882985863424:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 396us (572us total) trans 17179875586 rc 0/0 00000100:00100000:1.0:1746066827.384711:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21457 00000100:00100000:2.0:1746066827.384773:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985863552:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 362us (610us total) trans 17179875587 rc 0/0 00000100:00100000:2.0:1746066827.384778:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21458 00000100:00100000:0.0:1746066827.384857:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882985862912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3801us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.384863:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9913 00000100:00100000:3.0:1746066827.384912:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882985863680:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 288us (720us total) trans 21474842933 rc 0/0 00000100:00100000:3.0:1746066827.384918:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 21459 00000100:00100000:0.0:1746066827.388426:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.388515:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985863936 00000100:00100000:2.0:1746066827.388523:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985863936 00000100:00100000:2.0:1746066827.388560:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17480 00000100:00100000:2.0:1746066827.388566:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:3973:x1830882985863936:12345-192.168.204.16@tcp:55:lfs.0 00010000:00010000:2.0:1746066827.388615:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.388629:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.388636:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 4/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.388662:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066827.388673:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 30 pid: 7244 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746066827.388689:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985277952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066827.389336:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066827.391849:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882985277952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066827.391874:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066827.392080:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.392148:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985864064 00000100:00100000:2.0:1746066827.392153:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985864064 00010000:00010000:2.0:1746066827.392201:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 31 pid: 7244 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746066827.392219:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9914 00000100:00100000:2.0:1746066827.392225:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882985864064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.392236:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.392240:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 31 pid: 7244 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.392248:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 31 pid: 7244 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.392263:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfab9b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x59:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d4001 expref: 31 pid: 7244 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.392291:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066827.392295:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.392306:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.392312:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066827.392404:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066827.392457:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392462:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392491:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392500:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392505:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392509:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbebe00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066827.392512:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392518:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392526:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066827.392528:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1746066827.392530:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066827.392535:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebe00/0xf1867c21abfb3dbb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066827.392576:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:3973:x1830882985863936:12345-192.168.204.16@tcp:55:lfs.0 Request processed in 4010us (4155us total) trans 0 rc -22/-22 00000100:00100000:0.0:1746066827.392584:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17480 00000100:00100000:2.0:1746066827.392613:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882985864064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 210us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066827.392618:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9914 00000100:00100000:0.0:1746066827.394106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066827.394148:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985864320 00000100:00100000:1.0:1746066827.394153:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985864320 00000100:00100000:1.0:1746066827.394198:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6638 00000100:00100000:1.0:1746066827.394204:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:3973:x1830882985864320:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:1.0:1746066827.394245:0:10554:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x59:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d9b expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.394272:0:10554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066827.394279:0:10554:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.394285:0:10554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066827.394306:0:10554:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066827.394315:0:10554:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 29 pid: 7243 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746066827.394329:0:10554:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985278080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066827.394612:0:10554:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066827.395847:0:10554:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882985278080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066827.395865:0:10554:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000100:00100000:0.0:1746066827.397091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066827.397149:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985864448 00000100:00100000:2.0:1746066827.397156:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985864448 00010000:00010000:2.0:1746066827.397194:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 30 pid: 7243 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746066827.397229:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 9915 00000100:00100000:2.0:1746066827.397235:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882985864448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066827.397246:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066827.397251:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 30 pid: 7243 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.397261:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 30 pid: 7243 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.397277:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfb3d13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8da2 expref: 30 pid: 7243 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746066827.397302:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:2.0:1746066827.397306:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066827.397313:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066827.397318:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:2.0:1746066827.397336:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066827.397368:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882985864448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066827.397368:0:10554:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000100:00100000:2.0:1746066827.397374:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 9915 00010000:00010000:1.0:1746066827.397375:0:10554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000040:00080000:1.0:1746066827.397700:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1357, 88 off127016 00000004:00080000:1.0:1746066827.397705:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795608821585ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397748:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1349, 88 off126224 00000004:00080000:1.0:1746066827.397752:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795608868364ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397782:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1350, 88 off126312 00000004:00080000:1.0:1746066827.397786:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795608902206ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397795:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1358, 88 off127104 00000004:00080000:1.0:1746066827.397798:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795608914276ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397819:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1359, 88 off127192 00000004:00080000:1.0:1746066827.397823:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795608939484ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397834:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1351, 88 off126400 00000004:00080000:1.0:1746066827.397836:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795608952771ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397855:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1352, 88 off126488 00000004:00080000:1.0:1746066827.397859:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795608975309ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397865:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1353, 88 off126576 00000004:00080000:1.0:1746066827.397868:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795608984969ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397877:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1360, 88 off127280 00000004:00080000:1.0:1746066827.397880:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795608996301ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397926:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1354, 88 off126664 00000004:00080000:1.0:1746066827.397929:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795609045600ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397938:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1361, 88 off127368 00000004:00080000:1.0:1746066827.397941:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795609057331ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397953:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1355, 88 off126752 00000004:00080000:1.0:1746066827.397956:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795609072301ns, next at 733263917711ns, rc = 0 00000040:00080000:1.0:1746066827.397962:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1362, 88 off127456 00000004:00080000:1.0:1746066827.397965:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795609081755ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397971:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1363, 88 off127544 00000004:00080000:1.0:1746066827.397974:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795609090676ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397980:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1364, 88 off127632 00000004:00080000:1.0:1746066827.397983:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795609099331ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397988:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1365, 88 off127720 00000004:00080000:1.0:1746066827.397991:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795609107407ns, next at 733263941116ns, rc = 0 00000040:00080000:1.0:1746066827.397997:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1356, 88 off126840 00000004:00080000:1.0:1746066827.398000:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795609116500ns, next at 733263917711ns, rc = 0 00000001:00080000:3.0:1746066827.401893:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938018 is committed 00000004:00080000:3.0:1746066827.401907:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1329 committed 00010000:00010000:1.0:1746066827.401910:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066827.401919:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000004:00080000:3.0:1746066827.401922:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1340 committed 00010000:00010000:1.0:1746066827.401925:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066827.401929:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd15600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066827.401934:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000004:00080000:3.0:1746066827.401936:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1339 committed 00000004:00080000:3.0:1746066827.401937:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1338 committed 00000004:00080000:3.0:1746066827.401939:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1337 committed 00000004:00080000:3.0:1746066827.401940:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1328 committed 00010000:00010000:1.0:1746066827.401940:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000004:00080000:3.0:1746066827.401943:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1336 committed 00000004:00080000:3.0:1746066827.401944:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1327 committed 00000004:00080000:3.0:1746066827.401945:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1335 committed 00000004:00080000:3.0:1746066827.401946:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1326 committed 00000004:00080000:3.0:1746066827.401948:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1325 committed 00000004:00080000:3.0:1746066827.401949:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1324 committed 00000004:00080000:3.0:1746066827.401950:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1334 committed 00000004:00080000:3.0:1746066827.401951:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1333 committed 00010000:00010000:1.0:1746066827.401953:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00000004:00080000:3.0:1746066827.401954:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1323 committed 00000004:00080000:3.0:1746066827.401955:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1322 committed 00010000:00010000:1.0:1746066827.401956:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1746066827.401957:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1332 committed 00010000:00010000:1.0:1746066827.401960:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066827.401965:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15600/0xf1867c21abfb3d8a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000004:00010000:3.0:1746066827.401995:0:10554:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88006e210380 reply state ffff88012db9f800 transno 8589938018 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066827.402010:0:10554:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066827.402017:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066827.402019:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066827.402023:0:10554:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066827.402027:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:3.0:1746066827.402029:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066827.402034:0:10554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfb3cd4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x59:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8d9b expref: 26 pid: 7243 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746066827.402114:0:10554:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066827.402123:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:3973:x1830882985864320:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 7919us (8020us total) trans 8589938018 rc 0/0 00010000:00010000:0.0:1746066827.402125:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:0.0:1746066827.402131:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066827.402134:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6638 00010000:00010000:0.0:1746066827.402138:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00010000:00010000:0.0:1746066827.402142:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066827.402144:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00010000:00010000:0.0:1746066827.402149:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10554 initiator: MDT0 00010000:00010000:0.0:1746066827.402156:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff88012ea05400) 00010000:00010000:0.0:1746066827.402157:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066827.402160:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278336:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746066827.402160:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00010000:00010000:0.0:1746066827.402163:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfb3dc2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066827.402207:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.402229:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402241:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.402253:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066827.402257:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402269:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.402279:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402288:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066827.402305:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278336 00000100:00100000:0.0:1746066827.402305:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278848 00000100:00100000:3.0:1746066827.402310:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278336 00000100:00100000:0.0:1746066827.402310:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278848 00000100:00100000:3.0:1746066827.402334:0:13726:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278720 00000100:00100000:0.0:1746066827.402334:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278208 00000100:00100000:0.0:1746066827.402335:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278208 00000100:00100000:3.0:1746066827.402336:0:13726:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278720 00000100:00100000:0.0:1746066827.402346:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21460 00000100:00100000:3.0:1746066827.402349:0:13726:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21461 00000100:00100000:0.0:1746066827.402350:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985278336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402352:0:13726:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985278848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.402365:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21462 00000100:00100000:0.0:1746066827.402368:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882985278208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402433:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21463 00000100:00100000:3.0:1746066827.402437:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985278720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066827.402444:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066827.402446:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402448:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402450:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:0.0:1746066827.402452:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa1:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066827.402476:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985278208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (206us total) trans 21474842934 rc 0/0 00000100:00100000:0.0:1746066827.402481:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21462 00000100:00100000:3.0:1746066827.402486:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985278720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (197us total) trans 21474842936 rc 0/0 00000100:00100000:3.0:1746066827.402491:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21463 00000004:00080000:0.0:1746066827.402507:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212a00/2, rc 0, transno 21474842934 00000100:00100000:0.0:1746066827.402511:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066827.402517:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e213100/2, rc 0, transno 21474842936 00000100:00100000:0.0:1746066827.402519:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066827.402558:0:13726:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985278848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (315us total) trans 21474842935 rc 0/0 00002000:00010000:0.0:1746066827.402560:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066827.402562:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00000100:00100000:3.0:1746066827.402563:0:13726:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21461 00002000:00010000:0.0:1746066827.402564:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402565:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:0.0:1746066827.402567:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa2:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066827.402582:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011d854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985278336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (375us total) trans 21474842937 rc 0/0 00000100:00100000:0.0:1746066827.402586:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21460 00000004:00080000:0.0:1746066827.402601:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212300/2, rc 0, transno 21474842937 00000100:00100000:0.0:1746066827.402604:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066827.402609:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e210e00/2, rc 0, transno 21474842935 00000100:00100000:0.0:1746066827.402611:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985278848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.402616:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.402639:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.402654:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.402657:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278464 00000100:00100000:0.0:1746066827.402659:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278464 00000100:00100000:1.0:1746066827.402666:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.402671:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278976 00000100:00100000:0.0:1746066827.402673:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278976 00000100:00100000:1.0:1746066827.402678:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066827.402682:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.402683:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21464 00000100:00100000:0.0:1746066827.402687:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882985278464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.402694:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.402702:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.402712:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066827.402721:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066827.402723:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402725:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402726:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:0.0:1746066827.402728:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0xa3:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066827.402730:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985278592 00000100:00100000:1.0:1746066827.402733:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985278592 00000100:00100000:1.0:1746066827.402748:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279104 00000100:00100000:0.0:1746066827.402749:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985278464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (109us total) trans 21474842938 rc 0/0 00000100:00100000:1.0:1746066827.402750:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279104 00000100:00100000:0.0:1746066827.402753:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21464 00000100:00100000:1.0:1746066827.402763:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21465 00000100:00100000:1.0:1746066827.402767:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985278976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.402767:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21466 00000100:00100000:0.0:1746066827.402771:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985278592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.402788:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21467 00000100:00100000:2.0:1746066827.402794:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882985279104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.402807:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.402826:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.402831:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985278976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (163us total) trans 21474842939 rc 0/0 00000100:00100000:1.0:1746066827.402836:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21465 00000100:00100000:0.0:1746066827.402839:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.402845:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279360 00000100:00100000:2.0:1746066827.402846:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985279104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (132us total) trans 21474842941 rc 0/0 00000100:00100000:1.0:1746066827.402847:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279360 00000100:00100000:2.0:1746066827.402851:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21467 00000100:00100000:0.0:1746066827.402851:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.402857:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279872 00000100:00100000:1.0:1746066827.402858:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279872 00000100:00100000:0.0:1746066827.402860:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066827.402861:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21468 00000100:00100000:0.0:1746066827.402864:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066827.402865:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3775:x1830882985279360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.402866:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21469 00000100:00100000:1.0:1746066827.402869:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3775:x1830882985279872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.402876:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.402898:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.402915:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.402928:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279232 00000100:00100000:0.0:1746066827.402930:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279232 00002000:00010000:2.0:1746066827.402931:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066827.402933:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:2.0:1746066827.402935:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:2.0:1746066827.402936:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:2.0:1746066827.402938:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x81:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066827.402939:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279744 00000100:00100000:0.0:1746066827.402940:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279744 00000100:00100000:0.0:1746066827.402947:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21470 00000100:00100000:0.0:1746066827.402950:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985279232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.402954:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985279872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (101us total) trans 17179875589 rc 0/0 00000100:00100000:2.0:1746066827.402956:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985279360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (129us total) trans 17179875588 rc 0/0 00000100:00100000:1.0:1746066827.402959:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21469 00000100:00100000:2.0:1746066827.402962:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21468 00000100:00100000:1.0:1746066827.402969:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21471 00000100:00100000:1.0:1746066827.402973:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882985279744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066827.402987:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066827.402990:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402991:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.402993:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:0.0:1746066827.402994:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7f:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066827.403011:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882985279232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (134us total) trans 17179875590 rc 0/0 00000100:00100000:0.0:1746066827.403015:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21470 00000100:00100000:1.0:1746066827.403024:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882985279744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (108us total) trans 17179875591 rc 0/0 00000100:00100000:1.0:1746066827.403028:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21471 00000004:00080000:0.0:1746066827.403033:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493480/2, rc 0, transno 17179875590 00000100:00100000:1.0:1746066827.403043:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.403050:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403058:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066827.403058:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710a80/2, rc 0, transno 17179875591 00000100:00100000:0.0:1746066827.403061:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403067:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985280000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066827.403067:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5b0fb80/2, rc 0, transno 17179875588 00000100:00100000:0.0:1746066827.403070:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066827.403075:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b165c00/2, rc 0, transno 17179875589 00000100:00100000:0.0:1746066827.403077:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882985279872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403078:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066827.403091:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e213480/2, rc 0, transno 21474842941 00000100:00100000:1.0:1746066827.403094:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066827.403099:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211880/2, rc 0, transno 21474842938 00000100:00100000:0.0:1746066827.403100:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279488 00000100:00100000:1.0:1746066827.403101:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066827.403102:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279488 00000004:00080000:1.0:1746066827.403106:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211c00/2, rc 0, transno 21474842939 00000100:00100000:1.0:1746066827.403108:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066827.403114:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066827.403114:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280000 00000100:00100000:0.0:1746066827.403115:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280000 00000100:00100000:1.0:1746066827.403117:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.403124:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21472 00000100:00100000:0.0:1746066827.403127:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3776:x1830882985279488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403128:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.403136:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985280128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403146:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066827.403158:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985279616 00000100:00100000:1.0:1746066827.403160:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985279616 00002000:00010000:0.0:1746066827.403163:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb size from disk: 5073344 -> 5073344 00002000:00010000:0.0:1746066827.403177:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb mtime from disk: 1746066827 -> 1746066827 00002000:00010000:0.0:1746066827.403179:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb atime from disk: 1746066827 -> 1746066827 00000100:00100000:1.0:1746066827.403181:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280128 00002000:00010000:0.0:1746066827.403181:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb ctime from disk: 1746066828 -> 1746066828 00002000:00010000:0.0:1746066827.403182:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x82:0x0] updating lvb blocks from disk: 5816 -> 5816 00000100:00100000:1.0:1746066827.403183:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280128 00000100:00100000:1.0:1746066827.403191:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21473 00000100:00100000:1.0:1746066827.403194:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985280000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.403201:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882985279488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (143us total) trans 17179875592 rc 0/0 00000100:00100000:0.0:1746066827.403206:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21472 00000100:00100000:0.0:1746066827.403215:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21474 00000100:00100000:0.0:1746066827.403218:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985279616:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066827.403233:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f710000/2, rc 0, transno 17179875592 00000100:00100000:1.0:1746066827.403236:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403265:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985280000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (186us total) trans 17179875593 rc 0/0 00000100:00100000:0.0:1746066827.403268:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985279616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (139us total) trans 17179875594 rc 0/0 00000100:00100000:1.0:1746066827.403270:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21473 00000100:00100000:0.0:1746066827.403273:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21474 00000100:00100000:1.0:1746066827.403278:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21475 00000100:00100000:1.0:1746066827.403281:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985280128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.403303:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882985278592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 533us (608us total) trans 21474842940 rc 0/0 00000100:00100000:0.0:1746066827.403307:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21466 00000100:00100000:2.0:1746066827.403411:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985280256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066827.403426:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066827.403433:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280256 00000100:00100000:0.0:1746066827.403435:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280256 00000100:00100000:0.0:1746066827.403447:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21476 00000100:00100000:0.0:1746066827.403451:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882985280256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066827.403502:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882985280256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (74us total) trans 17179875595 rc 0/0 00000100:00100000:0.0:1746066827.403506:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21476 00000004:00080000:2.0:1746066827.403522:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d24e00/2, rc 0, transno 17179875595 00000100:00100000:2.0:1746066827.403526:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882985280256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066827.403557:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882985280128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (409us total) trans 17179875596 rc 0/0 00000100:00100000:1.0:1746066827.403562:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21475 00000004:00080000:1.0:1746066827.403580:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f712300/2, rc 0, transno 17179875594 00000100:00100000:1.0:1746066827.403583:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985279616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066827.403588:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d26300/2, rc 0, transno 17179875596 00000100:00100000:1.0:1746066827.403591:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985280128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066827.403596:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b166680/2, rc 0, transno 17179875593 00000100:00100000:1.0:1746066827.403599:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985280000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066827.403605:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212d80/2, rc 0, transno 21474842940 00000100:00100000:1.0:1746066827.403607:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882985278592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066827.405869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066827.406588:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985864576 00000100:00100000:0.0:1746066827.406595:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985864576 00000100:00100000:0.0:1746066827.406689:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 17481 00000100:00100000:0.0:1746066827.406696:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:3973:x1830882985864576:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066827.406714:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066827.406730:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfb3dc9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d8e04 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.406778:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfb3dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8e04 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.406790:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfb3dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d8e04 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066827.406804:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x59:0x0].0x0 (ffff880097855d00) 00010000:00010000:0.0:1746066827.406806:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066827.406809:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecee00, rc 0) 00000100:00100000:0.0:1746066827.406861:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:3973:x1830882985864576:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 166us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066827.406866:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 17481 00000100:00100000:0.0:1746066827.409554:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066827.409636:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985864832 00000100:00100000:3.0:1746066827.409651:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985864832 00000100:00100000:3.0:1746066827.409720:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6639 00000100:00100000:3.0:1746066827.409728:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:3973:x1830882985864832:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066827.410513:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:3973:x1830882985864832:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 784us (967us total) trans 8589938019 rc 0/0 00000100:00100000:3.0:1746066827.410520:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6639 00010000:00010000:1.0:1746066827.684237:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746066827.986844:0:13806:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00000100:00100000:2.0:1746066828.172174:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985280384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746066828.172231:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066828.172481:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882985280384 00000100:00100000:1.0:1746066828.172489:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882985280384 00000100:00100000:1.0:1746066828.172530:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1746066828.172538:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985280384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746066828.172555:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490125760 pending 0 free 3909910528 avail 3678388224 00000100:00100000:1.0:1746066828.172587:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3775:x1830882985280384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066828.172593:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00080000:1.0:1746066828.172615:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066828.172679:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882985280384:0@lo:13:osp-pre-0-1.0 Debug log: 70477 lines, 70477 kept, 0 dropped, 0 bad.